May 29 17:29:44.579549 ip-10-0-138-69 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 29 17:29:44.579559 ip-10-0-138-69 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 29 17:29:44.579567 ip-10-0-138-69 systemd[1]: kubelet.service: Failed with result 'resources'.
May 29 17:29:44.579791 ip-10-0-138-69 systemd[1]: Failed to start Kubernetes Kubelet.
May 29 17:29:54.828781 ip-10-0-138-69 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 29 17:29:54.828800 ip-10-0-138-69 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 389ca4ea73a14b81aefe22da235a57db --
May 29 17:32:26.917048 ip-10-0-138-69 systemd[1]: Starting Kubernetes Kubelet...
May 29 17:32:27.265832 ip-10-0-138-69 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 17:32:27.265832 ip-10-0-138-69 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 17:32:27.265832 ip-10-0-138-69 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 17:32:27.265832 ip-10-0-138-69 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 17:32:27.265832 ip-10-0-138-69 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 17:32:27.267077 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.266989    2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 17:32:27.270369 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270350    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 17:32:27.270369 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270368    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270372    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270376    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270379    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270382    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270385    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270388    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270390    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270394    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270397    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270400    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270402    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270405    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270407    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270410    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270419    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270421    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270424    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270429    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270433    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 17:32:27.270436 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270436    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270439    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270442    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270445    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270448    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270451    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270453    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270457    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270459    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270463    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270475    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270480    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270483    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270486    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270489    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270492    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270494    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270497    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270502    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 17:32:27.270995 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270505    2558 feature_gate.go:328] unrecognized feature gate: Example
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270508    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270510    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270513    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270517    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270520    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270523    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270526    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270528    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270531    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270534    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270536    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270539    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270541    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270544    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270547    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270550    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270554    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270556    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 17:32:27.271462 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270559    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270562    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270565    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270569    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270572    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270574    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270577    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270579    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270582    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270585    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270587    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270590    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270593    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270596    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270598    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270601    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270603    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270606    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270608    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270611    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 17:32:27.271943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270613    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270616    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270618    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270621    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270624    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270626    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.270629    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271061    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271070    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271075    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271078    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271081    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271084    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271087    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271089    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271092    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271095    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271097    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271100    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271103    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 17:32:27.272439 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271105    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271108    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271110    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271113    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271116    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271119    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271121    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271124    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271127    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271129    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271132    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271134    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271137    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271140    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271142    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271145    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271147    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271150    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271152    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271155    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 17:32:27.272943 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271158    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271161    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271164    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271167    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271169    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271172    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271175    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271177    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271181    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271183    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271186    2558 feature_gate.go:328] unrecognized feature gate: Example
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271189    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271191    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271194    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271196    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271198    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271201    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271204    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271207    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 17:32:27.273474 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271209    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271212    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271214    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271217    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271219    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271222    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271224    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271227    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271229    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271232    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271234    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271237    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271239    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271243    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271246    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271249    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271251    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271254    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271257    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271259    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 17:32:27.273956 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271261    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271265    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271267    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271270    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271272    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271275    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271277    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271280    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271282    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271286    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271290    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271293    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271296    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.271299    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271378    2558 flags.go:64] FLAG: --address="0.0.0.0"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271395    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271404    2558 flags.go:64] FLAG: --anonymous-auth="true"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271411    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271416    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271420    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271425    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 17:32:27.274445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271430    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271433    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271436    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271440    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271444    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271447    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271451    2558 flags.go:64] FLAG: --cgroup-root=""
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271454    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271457    2558 flags.go:64] FLAG: --client-ca-file=""
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271460    2558 flags.go:64] FLAG: --cloud-config=""
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271463    2558 flags.go:64] FLAG: --cloud-provider="external"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271466    2558 flags.go:64] FLAG: --cluster-dns="[]"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271470    2558 flags.go:64] FLAG: --cluster-domain=""
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271473    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271476    2558 flags.go:64] FLAG: --config-dir=""
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271479    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271483    2558 flags.go:64] FLAG: --container-log-max-files="5"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271487    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271490    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271493    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271496    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271499    2558 flags.go:64] FLAG: --contention-profiling="false"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271502    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271506    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271510    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 17:32:27.274987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271513    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271517    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271520    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271523    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271526    2558 flags.go:64] FLAG: --enable-load-reader="false"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271529    2558 flags.go:64] FLAG: --enable-server="true"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271532    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271537    2558 flags.go:64] FLAG: --event-burst="100"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271540    2558 flags.go:64] FLAG: --event-qps="50"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271543    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271546    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271552    2558 flags.go:64] FLAG: --eviction-hard=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271556    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271559    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271562    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271565    2558 flags.go:64] FLAG: --eviction-soft=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271569    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271571    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271574    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271578    2558 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271581    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271583    2558 flags.go:64] FLAG: --fail-swap-on="true"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271586    2558 flags.go:64] FLAG: --feature-gates=""
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271590    2558 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271594    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 17:32:27.275600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271597    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271600    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271603    2558 flags.go:64] FLAG: --healthz-port="10248"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271605    2558 flags.go:64] FLAG: --help="false"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271609    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-69.ec2.internal"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271612    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271615    2558 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271618    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271622    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271625    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271628    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271631    2558 flags.go:64] FLAG: --image-service-endpoint=""
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271634    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271637    2558 flags.go:64] FLAG: --kube-api-burst="100"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271640    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271643    2558 flags.go:64] FLAG: --kube-api-qps="50"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271646    2558 flags.go:64] FLAG: --kube-reserved=""
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271649    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271653    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271656    2558 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271660    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271663    2558 flags.go:64] FLAG: --lock-file=""
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271666    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271669    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 17:32:27.276233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271672    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271677    2558 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271680    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271683    2558 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271686    2558 flags.go:64] FLAG: --logging-format="text"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271689    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271692    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271695    2558 flags.go:64] FLAG: --manifest-url=""
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271698    2558 flags.go:64] FLAG: --manifest-url-header=""
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271703    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271706    2558 flags.go:64] FLAG: --max-open-files="1000000"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271710    2558 flags.go:64] FLAG: --max-pods="110"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271713    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271716    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271719    2558 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271722    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271726    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271729    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271732    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271740    2558 flags.go:64] FLAG: --node-status-max-images="50"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271743    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271746    2558 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271761    2558 flags.go:64] FLAG: --pod-cidr=""
May 29 17:32:27.276834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271765    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271771    2558 flags.go:64] FLAG: --pod-manifest-path=""
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271774    2558 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271783    2558 flags.go:64] FLAG: --pods-per-core="0"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271786    2558 flags.go:64] FLAG: --port="10250"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271789    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271792    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0239b4f5d6e543278"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271795    2558 flags.go:64] FLAG: --qos-reserved=""
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271798    2558 flags.go:64] FLAG: --read-only-port="10255"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271801    2558 flags.go:64] FLAG: --register-node="true"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271804    2558 flags.go:64] FLAG: --register-schedulable="true"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271807    2558 flags.go:64] FLAG: --register-with-taints=""
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271811    2558 flags.go:64] FLAG: --registry-burst="10"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271814    2558 flags.go:64] FLAG: --registry-qps="5"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271817    2558 flags.go:64] FLAG: --reserved-cpus=""
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271820    2558 flags.go:64] FLAG: --reserved-memory=""
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271824    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271826    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271829    2558 flags.go:64] FLAG: --rotate-certificates="false"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271832    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271835    2558 flags.go:64] FLAG: --runonce="false"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271838    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271845    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271848    2558 flags.go:64] FLAG: --seccomp-default="false"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271851    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271854    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 17:32:27.277395 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271859    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271862    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271865    2558 flags.go:64] FLAG: --storage-driver-password="root"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271868    2558 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271871    2558 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271874    2558 flags.go:64] FLAG: --storage-driver-user="root"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271877    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271880    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271883    2558 flags.go:64] FLAG: --system-cgroups=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271887    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271892    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271895    2558 flags.go:64] FLAG: --tls-cert-file=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271898    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271902    2558 flags.go:64] FLAG: --tls-min-version=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271905    2558 flags.go:64] FLAG: --tls-private-key-file=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271908    2558 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271911    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271914    2558 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271917    2558 flags.go:64] FLAG: --v="2"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271921    2558 flags.go:64] FLAG: --version="false"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271925    2558 flags.go:64] FLAG: --vmodule=""
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271929    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.271933    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272043    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 17:32:27.278318 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272050    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272054    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272057    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272060    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272064    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272068    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272071    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272074    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272077    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272088    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272091    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272094    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272096    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272099    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272101    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272104    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272107    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272112    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272115    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 17:32:27.279327 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272119    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272122    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272124    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272127    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272130    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272133    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272136    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272138    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272141    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272143    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272146    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272149    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272151    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272154    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272156    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272159    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272162    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272166    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272169    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272171    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 17:32:27.280247 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272174    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272176    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272179    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272182    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272185    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272187    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272190    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272193    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272195    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272198    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272202    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272204    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272207    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272210    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272212    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272215    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272217    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272220    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272224    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272227    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 17:32:27.281246 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272230    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272233    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272235    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272238    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272240    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272243    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272246    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272248    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272251    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272254    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272257    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272260    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272262    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272265    2558 feature_gate.go:328] unrecognized feature gate: Example
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272268    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272270    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272273    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272276    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272278    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272281    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 17:32:27.281790 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272283    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272286    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272290    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272292    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272295    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.272297    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.272783    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.280121    2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.280141    2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280212    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280220    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280226    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280230    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280235    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280239    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280244    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 17:32:27.282371 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280248    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280252    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280256    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280260    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280265    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280269    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280274    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280278    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280282    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280287    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280291    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280296    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280300    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280305    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280309    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280313    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280318    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280322    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280327    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280331    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 17:32:27.283058 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280335    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280340    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280344    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280348    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280355    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280360    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280364    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280368    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280372    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280377    2558 feature_gate.go:328] unrecognized feature gate: Example
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280381    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280386    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280390    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280394    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280398    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280402    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280407    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280411    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280415    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280420    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 17:32:27.283710 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280424    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280428    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280432    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280436    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280440    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280445    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280450    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280454    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280458    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280462    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280466    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280469    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280473    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280477    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280480    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280486    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280490    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280497    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280504    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 17:32:27.284268 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280509    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280513    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280518    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280524    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280530    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280535    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280539    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280542    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280546    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280550    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280554    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280558    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280562    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280567    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280571    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280575    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280579    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280583    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280586    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 17:32:27.284891 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280591    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.280599    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280776    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280786    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280791    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280796    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280800    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280804    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280809    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280814    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280818    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280822    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280828    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280832    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280836    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 17:32:27.285484 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280840    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280844    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280848    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280853    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280856    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280861    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280865    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280869    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280873    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280879    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280886    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280890    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280895    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280899    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280903    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280907    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280911    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280915    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280919    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 17:32:27.286026 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280923    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280928    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280932    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280937    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280941    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280945    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280949    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280954    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280958    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280962    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280966    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280971    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280975    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280980    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280984    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280988    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280992    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.280997    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281001    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281006    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 17:32:27.286658 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281010    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281014    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281018    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281023    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281027    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281031    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281035    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281040    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281044    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281048    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281052    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281056    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281060    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281064    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281069    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281073    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281077    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281081    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281085    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281089    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 17:32:27.287198 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281093    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281098    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281102    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281106    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281111    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281115    2558 feature_gate.go:328] unrecognized feature gate: Example
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281119    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281123    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281128    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281133    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281137    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281141    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281145    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:27.281149    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.281158    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 17:32:27.287684 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.281906    2558 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 17:32:27.288085 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.286395    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 17:32:27.288129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.288101    2558 server.go:1019] "Starting client certificate rotation"
May 29 17:32:27.288229 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.288209    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 17:32:27.288921 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.288908    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 17:32:27.307379 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.307351    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 17:32:27.309059 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.309038    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 17:32:27.322384 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.322360    2558 log.go:25] "Validated CRI v1 runtime API"
May 29 17:32:27.327571 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.327554    2558 log.go:25] "Validated CRI v1 image API"
May 29 17:32:27.328728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.328685    2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 17:32:27.330599 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.330577    2558 fs.go:135] Filesystem UUIDs: map[66e9b17b-9540-404f-9992-7f6dcd404eb6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ed2451ef-0931-49b4-86ce-5fb7b9ab4225:/dev/nvme0n1p4]
May 29 17:32:27.330700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.330597    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 17:32:27.334928 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.334817    2558 manager.go:217] Machine: {Timestamp:2026-05-29 17:32:27.334286675 +0000 UTC m=+0.320108674 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099559 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228ef2c2557046e19754e8c2413b35 SystemUUID:ec228ef2-c255-7046-e197-54e8c2413b35 BootID:389ca4ea-73a1-4b81-aefe-22da235a57db Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:02:f9:4a:d5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:02:f9:4a:d5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:09:39:82:0d:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 17:32:27.335531 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.335521    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 17:32:27.335618 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.335607    2558 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 17:32:27.336196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.336181    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 17:32:27.338236 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.338206    2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 17:32:27.338380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.338240    2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 17:32:27.338422 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.338390    2558 topology_manager.go:138] "Creating topology manager with none policy"
May 29 17:32:27.338422 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.338400    2558 container_manager_linux.go:306] "Creating device plugin manager"
May 29 17:32:27.338422 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.338408    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 17:32:27.338835 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.338825    2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 17:32:27.340257 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.340246    2558 state_mem.go:36] "Initialized new in-memory state store"
May 29 17:32:27.340370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.340361    2558 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 17:32:27.342211 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.342201    2558 kubelet.go:491] "Attempting to sync node with API server"
May 29 17:32:27.342263 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.342215    2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 17:32:27.342263 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.342226    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 17:32:27.342263 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.342237    2558 kubelet.go:397] "Adding apiserver pod source"
May 29 17:32:27.342263 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.342245    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 17:32:27.343215 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.343199    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 17:32:27.343274 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.343229    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 17:32:27.345860 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.345841    2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
May 29 17:32:27.347612 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.347598    2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 17:32:27.350149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350135    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350153    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350162    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350186    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350196    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350202    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350207    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350214    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350220    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 17:32:27.350227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350227    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 17:32:27.350467 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350239    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 17:32:27.350467 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.350244    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 17:32:27.351649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.351625    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 17:32:27.351768 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.351655    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 17:32:27.353413 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.353379    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 17:32:27.353715 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.353689    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 17:32:27.354353 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.354334    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pvxcf"
May 29 17:32:27.356394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.356379    2558 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 17:32:27.356441 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.356432    2558 server.go:1295] "Started kubelet"
May 29 17:32:27.356533 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.356491    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 17:32:27.356812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.356742    2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 17:32:27.356883 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.356833    2558 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 17:32:27.357280 ip-10-0-138-69 systemd[1]: Started Kubernetes Kubelet.
May 29 17:32:27.357940 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.357926    2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 17:32:27.359029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.359013    2558 server.go:317] "Adding debug handlers to kubelet server"
May 29 17:32:27.360474 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.360439    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pvxcf"
May 29 17:32:27.361966 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.361947    2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 29 17:32:27.362791 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.362014    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-69.ec2.internal.18b419a49365179d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-69.ec2.internal,UID:ip-10-0-138-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-69.ec2.internal,},FirstTimestamp:2026-05-29 17:32:27.356395421 +0000 UTC m=+0.342217400,LastTimestamp:2026-05-29 17:32:27.356395421 +0000 UTC m=+0.342217400,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-69.ec2.internal,}"
May 29 17:32:27.363569 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.363549    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 17:32:27.363569 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.363560    2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 17:32:27.364054 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.364036    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 17:32:27.364192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.364172    2558 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 17:32:27.364192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.364190    2558 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 17:32:27.364346 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.364296    2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 17:32:27.364398 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.364356    2558 reconstruct.go:97] "Volume reconstruction finished"
May 29 17:32:27.364398 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.364364    2558 reconciler.go:26] "Reconciler: start to sync state"
May 29 17:32:27.364950 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.364930    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.365088 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365070    2558 factory.go:153] Registering CRI-O factory
May 29 17:32:27.365164 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365092    2558 factory.go:223] Registration of the crio container factory successfully
May 29 17:32:27.365164 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365158    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 17:32:27.365234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365168    2558 factory.go:55] Registering systemd factory
May 29 17:32:27.365234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365177    2558 factory.go:223] Registration of the systemd container factory successfully
May 29 17:32:27.365234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365195    2558 factory.go:103] Registering Raw factory
May 29 17:32:27.365234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365207    2558 manager.go:1196] Started watching for new ooms in manager
May 29 17:32:27.365623 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.365611    2558 manager.go:319] Starting recovery of all containers
May 29 17:32:27.371107 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.371083    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 17:32:27.374382 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.374353    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-69.ec2.internal\" not found" node="ip-10-0-138-69.ec2.internal"
May 29 17:32:27.377361 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.377208    2558 manager.go:324] Recovery completed
May 29 17:32:27.381938 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.381925    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 17:32:27.383803 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.383743    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientMemory"
May 29 17:32:27.383859 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.383817    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasNoDiskPressure"
May 29 17:32:27.383859 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.383828    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientPID"
May 29 17:32:27.384363 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.384349    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 17:32:27.384363 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.384361    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 17:32:27.384473 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.384422    2558 state_mem.go:36] "Initialized new in-memory state store"
May 29 17:32:27.386499 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.386487    2558 policy_none.go:49] "None policy: Start"
May 29 17:32:27.386542 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.386503    2558 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 17:32:27.386542 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.386512    2558 state_mem.go:35] "Initializing new in-memory state store"
May 29 17:32:27.431471 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.431449    2558 manager.go:341] "Starting Device Plugin manager"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.431490    2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.431501    2558 server.go:85] "Starting device plugin registration server"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.431814    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.431831    2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.431957    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.432058    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.432068    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.432545    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 17:32:27.442472 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.432591    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.504704 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.504665    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 17:32:27.505796 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.505781    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 17:32:27.505860 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.505802    2558 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 17:32:27.505860 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.505821    2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 17:32:27.505860 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.505829    2558 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 17:32:27.505982 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.505878    2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 17:32:27.508123 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.508100    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 17:32:27.532267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.532211    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 17:32:27.533597 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.533583    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientMemory"
May 29 17:32:27.533651 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.533613    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasNoDiskPressure"
May 29 17:32:27.533651 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.533627    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientPID"
May 29 17:32:27.533651 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.533650    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-69.ec2.internal"
May 29 17:32:27.541272 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.541257    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-69.ec2.internal"
May 29 17:32:27.541319 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.541284    2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-69.ec2.internal\": node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.555650 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.555624    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.606812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.606785    2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"]
May 29 17:32:27.606886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.606859    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 17:32:27.607772 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.607744    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientMemory"
May 29 17:32:27.607834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.607785    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasNoDiskPressure"
May 29 17:32:27.607834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.607796    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientPID"
May 29 17:32:27.608993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.608981    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 17:32:27.609152 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609139    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.609208 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609198    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 17:32:27.609672 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609657    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientMemory"
May 29 17:32:27.609737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609679    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasNoDiskPressure"
May 29 17:32:27.609737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609693    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientPID"
May 29 17:32:27.609737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609710    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientMemory"
May 29 17:32:27.609737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609726    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasNoDiskPressure"
May 29 17:32:27.609737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.609737    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientPID"
May 29 17:32:27.610873 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.610858    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.610937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.610889    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 17:32:27.611588 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.611575    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientMemory"
May 29 17:32:27.611667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.611599    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasNoDiskPressure"
May 29 17:32:27.611667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.611609    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeHasSufficientPID"
May 29 17:32:27.625300 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.625281    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-69.ec2.internal\" not found" node="ip-10-0-138-69.ec2.internal"
May 29 17:32:27.629285 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.629271    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-69.ec2.internal\" not found" node="ip-10-0-138-69.ec2.internal"
May 29 17:32:27.655872 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.655854    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.756699 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.756650    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.765971 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.765946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1330ceee6fcbb89d1606f2672ec11098-config\") pod \"kube-apiserver-proxy-ip-10-0-138-69.ec2.internal\" (UID: \"1330ceee6fcbb89d1606f2672ec11098\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.766105 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.765975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebfb94786244dd307dcbc36209e184ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal\" (UID: \"ebfb94786244dd307dcbc36209e184ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.766105 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.765997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebfb94786244dd307dcbc36209e184ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal\" (UID: \"ebfb94786244dd307dcbc36209e184ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.857437 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.857367    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:27.866722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.866693    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1330ceee6fcbb89d1606f2672ec11098-config\") pod \"kube-apiserver-proxy-ip-10-0-138-69.ec2.internal\" (UID: \"1330ceee6fcbb89d1606f2672ec11098\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.866834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.866730    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebfb94786244dd307dcbc36209e184ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal\" (UID: \"ebfb94786244dd307dcbc36209e184ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.866834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.866775    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebfb94786244dd307dcbc36209e184ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal\" (UID: \"ebfb94786244dd307dcbc36209e184ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.866834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.866799    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1330ceee6fcbb89d1606f2672ec11098-config\") pod \"kube-apiserver-proxy-ip-10-0-138-69.ec2.internal\" (UID: \"1330ceee6fcbb89d1606f2672ec11098\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.866834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.866810    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ebfb94786244dd307dcbc36209e184ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal\" (UID: \"ebfb94786244dd307dcbc36209e184ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.866834 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.866830    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebfb94786244dd307dcbc36209e184ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal\" (UID: \"ebfb94786244dd307dcbc36209e184ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.927855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.927816    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.932582 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:27.932564    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"
May 29 17:32:27.958247 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:27.958220    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:28.058736 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:28.058702    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:28.159222 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:28.159167    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:28.259800 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:28.259774    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:28.287246 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.287225    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 17:32:28.287671 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.287349    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 17:32:28.287671 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.287366    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 17:32:28.360737 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:28.360711    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:28.362907 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.362863    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 17:27:27 +0000 UTC" deadline="2027-11-01 09:09:57.428574828 +0000 UTC"
May 29 17:32:28.362966 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.362909    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12495h37m29.065670133s"
May 29 17:32:28.364426 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.364410    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 17:32:28.380176 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.380155    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 17:32:28.403397 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.403359    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-949gp"
May 29 17:32:28.410424 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.410342    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-949gp"
May 29 17:32:28.461630 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:28.461597    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-69.ec2.internal\" not found"
May 29 17:32:28.471225 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:28.471189    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebfb94786244dd307dcbc36209e184ce.slice/crio-b1a2ee1fc3a6e50a6e670d19ef9d713a531b3aa713a70f1b9f47fccc347970da WatchSource:0}: Error finding container b1a2ee1fc3a6e50a6e670d19ef9d713a531b3aa713a70f1b9f47fccc347970da: Status 404 returned error can't find the container with id b1a2ee1fc3a6e50a6e670d19ef9d713a531b3aa713a70f1b9f47fccc347970da
May 29 17:32:28.471392 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:28.471372    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1330ceee6fcbb89d1606f2672ec11098.slice/crio-768134a1098b5ce7d6c0791cd30a5142a358cb3cc85af0fcfda1809b6ae403f1 WatchSource:0}: Error finding container 768134a1098b5ce7d6c0791cd30a5142a358cb3cc85af0fcfda1809b6ae403f1: Status 404 returned error can't find the container with id 768134a1098b5ce7d6c0791cd30a5142a358cb3cc85af0fcfda1809b6ae403f1
May 29 17:32:28.474965 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.474952    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:32:28.479618 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.479603    2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 17:32:28.508836 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.508795    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal" event={"ID":"1330ceee6fcbb89d1606f2672ec11098","Type":"ContainerStarted","Data":"768134a1098b5ce7d6c0791cd30a5142a358cb3cc85af0fcfda1809b6ae403f1"}
May 29 17:32:28.510118 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.510097    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal" event={"ID":"ebfb94786244dd307dcbc36209e184ce","Type":"ContainerStarted","Data":"b1a2ee1fc3a6e50a6e670d19ef9d713a531b3aa713a70f1b9f47fccc347970da"}
May 29 17:32:28.564265 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.564238    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal"
May 29 17:32:28.578216 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.578193    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 17:32:28.579635 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.579620    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal"
May 29 17:32:28.585822 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.585808    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 17:32:28.772800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:28.772700    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 17:32:29.343480 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.343450    2558 apiserver.go:52] "Watching apiserver"
May 29 17:32:29.349097 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.349072    2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 17:32:29.350129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.350097    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-gtnl4","openshift-image-registry/node-ca-8224g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal","openshift-multus/multus-additional-cni-plugins-6z2vs","openshift-multus/network-metrics-daemon-x8rpq","openshift-network-diagnostics/network-check-target-cqgl2","openshift-network-operator/iptables-alerter-q4mgf","openshift-ovn-kubernetes/ovnkube-node-xc8s7","kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb","openshift-cluster-node-tuning-operator/tuned-njvdv","openshift-dns/node-resolver-nq698","openshift-multus/multus-z6g7s"]
May 29 17:32:29.351366 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.351349    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.352329 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.352304    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.353332 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.353313    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.353976 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.353952    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 17:32:29.354068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.354053    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 17:32:29.354159 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.354078    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8967m\""
May 29 17:32:29.354267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.354249    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 17:32:29.354615 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.354596    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.354691 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.354670    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:29.354764 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.354713    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 17:32:29.355050 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355027    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9vf8v\""
May 29 17:32:29.355050 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355041    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 17:32:29.355050 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355034    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 17:32:29.355776 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355555    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m9hv6\""
May 29 17:32:29.355776 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355613    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 17:32:29.355952 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355840    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 17:32:29.355952 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.355923    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 17:32:29.356063 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.356030    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 17:32:29.356145 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.356129    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 17:32:29.357029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.356912    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:29.357029 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.356989    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:29.357029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.357006    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.358469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.358246    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.358981 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.358961    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 17:32:29.359610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.359497    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6tc8s\""
May 29 17:32:29.359610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.359555    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 17:32:29.361702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.360212    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 17:32:29.361702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.360216    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 17:32:29.361702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.360463    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.361702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.360984    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 17:32:29.361702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.361075    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.361702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.360985    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-78rc7\""
May 29 17:32:29.362697 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.362310    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 17:32:29.362697 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.362623    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 17:32:29.362884 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.362735    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 17:32:29.363210 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.363063    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 17:32:29.363296 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.363242    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 17:32:29.363496 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.363412    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpn7x\""
May 29 17:32:29.363878 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.363858    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 17:32:29.364030 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.363995    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 17:32:29.364134 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.364035    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r7vg8\""
May 29 17:32:29.364134 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.364105    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 17:32:29.364550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.364524    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.366559 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.366537    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 17:32:29.366725 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.366707    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-786jx\""
May 29 17:32:29.366847 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.366832    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 17:32:29.367107 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.367088    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.368954 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.368938    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5mtls\""
May 29 17:32:29.369048 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.369005    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 17:32:29.374015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.373994    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-multus-certs\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.374115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374060    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysconfig\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovnkube-config\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.374115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-cni-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7mcd\" (UniqueName: \"kubernetes.io/projected/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-kube-api-access-b7mcd\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374135    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-modprobe-d\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374155    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysctl-conf\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-var-lib-kubelet\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374196    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-tuned\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374215    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-system-cni-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-system-cni-dir\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-registration-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-sys\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-run-ovn-kubernetes\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-cni-binary-copy\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-host\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovn-node-metrics-cert\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374417    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-cnibin\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374443    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-env-overrides\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/051a81d9-5332-4e43-93fa-76a9d9b0c540-cni-binary-copy\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmp9\" (UniqueName: \"kubernetes.io/projected/051a81d9-5332-4e43-93fa-76a9d9b0c540-kube-api-access-mqmp9\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdda3bd2-9418-450f-93ba-732c8fedd587-host-slash\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-kubernetes\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-cni-bin\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-socket-dir-parent\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.374694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-netns\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-daemon-config\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdda3bd2-9418-450f-93ba-732c8fedd587-iptables-alerter-script\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374836    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysctl-d\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-os-release\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-systemd-units\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-systemd\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-node-log\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnrr\" (UniqueName: \"kubernetes.io/projected/cdda3bd2-9418-450f-93ba-732c8fedd587-kube-api-access-slnrr\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-lib-modules\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.374980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjbdz\" (UniqueName: \"kubernetes.io/projected/ee4c0957-aa37-4727-b9b1-de41023a6e13-kube-api-access-qjbdz\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375018    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-serviceca\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375041    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-hostroot\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-conf-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.375425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-os-release\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-etc-selinux\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-run\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375152    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-cni-bin\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-cni-multus\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375241    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndct2\" (UniqueName: \"kubernetes.io/projected/6ecfb99b-8aa4-472e-a985-06c40f2b3089-kube-api-access-ndct2\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375269    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-kubelet\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jjt\" (UniqueName: \"kubernetes.io/projected/41263631-aeb1-4e4a-b74d-81ebab5a3046-kube-api-access-p2jjt\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7fr\" (UniqueName: \"kubernetes.io/projected/645d24d3-06ba-4b59-95ca-3c06dab54c1f-kube-api-access-zj7fr\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4c0957-aa37-4727-b9b1-de41023a6e13-tmp-dir\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375466    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-cni-netd\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375500    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwbp8\" (UniqueName: \"kubernetes.io/projected/1afc6f59-e725-4558-8cd4-975d4ed8ba37-kube-api-access-qwbp8\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375528    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-sys-fs\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-systemd\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.376096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/645d24d3-06ba-4b59-95ca-3c06dab54c1f-tmp\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee4c0957-aa37-4727-b9b1-de41023a6e13-hosts-file\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrhk7\" (UniqueName: \"kubernetes.io/projected/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-kube-api-access-qrhk7\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-slash\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375728    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-k8s-cni-cncf-io\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-cnibin\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d26816d-e3f1-4d7d-805e-795e7c551506-konnectivity-ca\") pod \"konnectivity-agent-gtnl4\" (UID: \"5d26816d-e3f1-4d7d-805e-795e7c551506\") " pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375803    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-socket-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-device-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375851    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-run-netns\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375877    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-etc-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375894    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-kubelet\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-etc-kubernetes\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d26816d-e3f1-4d7d-805e-795e7c551506-agent-certs\") pod \"konnectivity-agent-gtnl4\" (UID: \"5d26816d-e3f1-4d7d-805e-795e7c551506\") " pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375954    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-host\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.376593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-var-lib-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.377139 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.375997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-ovn\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.377139 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.376015    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-log-socket\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.377139 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.376035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovnkube-script-lib\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.411232 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.411197    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 17:27:28 +0000 UTC" deadline="2028-01-20 18:34:13.835999969 +0000 UTC"
May 29 17:32:29.411232 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.411225    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14425h1m44.424778361s"
May 29 17:32:29.465175 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.465149    2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 17:32:29.476173 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476153    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 17:32:29.476173 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476166    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-kubelet\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476196    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-etc-kubernetes\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476212    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d26816d-e3f1-4d7d-805e-795e7c551506-agent-certs\") pod \"konnectivity-agent-gtnl4\" (UID: \"5d26816d-e3f1-4d7d-805e-795e7c551506\") " pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476233    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-host\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476252    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-var-lib-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476267    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-ovn\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476289    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-log-socket\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476295    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-etc-kubernetes\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476310    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovnkube-script-lib\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476317    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-ovn\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476317    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-host\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.476745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476343    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-kubelet\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476360    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-log-socket\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476706    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-multus-certs\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.476881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476769    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.476881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476798    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysconfig\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.476881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476842    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovnkube-config\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.476881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476871    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-cni-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.477023 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476903    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7mcd\" (UniqueName: \"kubernetes.io/projected/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-kube-api-access-b7mcd\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.477023 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476932    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-modprobe-d\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.477023 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476964    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysctl-conf\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.477023 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476988    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-var-lib-kubelet\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.477023 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477018    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-tuned\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.477183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477047    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-system-cni-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.477183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477078    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-system-cni-dir\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.477183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477107    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-registration-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.477183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477131    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-sys\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.477183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477165    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.477394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477239    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-run-ovn-kubernetes\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.477394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.476379    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-var-lib-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.477394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477306    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-multus-certs\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.477394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.477555 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477415    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysconfig\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.477993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.477966    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovnkube-config\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.478093 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.478071    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-cni-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.478456 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.478426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-modprobe-d\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.478591 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.478572    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysctl-conf\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.478687 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.478632    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-var-lib-kubelet\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.478953 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.478914    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 17:32:29.479579 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.479558    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-system-cni-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.480016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.479994    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-system-cni-dir\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.480100 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.480070    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-registration-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.480140 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.480121    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-sys\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.480188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.480170    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.480652 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.480629    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovnkube-script-lib\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.482022 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.481952    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-run-ovn-kubernetes\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.482111 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482031    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-cni-binary-copy\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.482111 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482065    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-host\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.482212 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482146    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovn-node-metrics-cert\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.482212 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482175    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-cnibin\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482212 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482207    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-env-overrides\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.482309 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482248    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/051a81d9-5332-4e43-93fa-76a9d9b0c540-cni-binary-copy\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482342 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482294    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmp9\" (UniqueName: \"kubernetes.io/projected/051a81d9-5332-4e43-93fa-76a9d9b0c540-kube-api-access-mqmp9\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482377 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482343    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdda3bd2-9418-450f-93ba-732c8fedd587-host-slash\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.482408 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482371    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-tuned\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.482454 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482393    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.482545 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482528    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-cnibin\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482540    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-kubernetes\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.482600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482586    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-cni-bin\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.482677 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482616    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-socket-dir-parent\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482677 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482647    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-netns\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482744 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482696    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-daemon-config\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.482810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482746    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdda3bd2-9418-450f-93ba-732c8fedd587-iptables-alerter-script\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.482810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482792    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.482902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482816    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.482902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482846    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysctl-d\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.482902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482861    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-os-release\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.483031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482923    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-systemd-units\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.483031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482946    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-systemd\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.483031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482968    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-node-log\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.483031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.482997    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-slnrr\" (UniqueName: \"kubernetes.io/projected/cdda3bd2-9418-450f-93ba-732c8fedd587-kube-api-access-slnrr\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.483210 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483030    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-lib-modules\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.483210 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-cni-binary-copy\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.483210 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483066    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qjbdz\" (UniqueName: \"kubernetes.io/projected/ee4c0957-aa37-4727-b9b1-de41023a6e13-kube-api-access-qjbdz\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.483344 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483248    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-host\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.483722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483616    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-socket-dir-parent\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.483814 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483489    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-serviceca\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.483867 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483764    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-cni-bin\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.483867 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483829    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-hostroot\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.483867 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483858    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d26816d-e3f1-4d7d-805e-795e7c551506-agent-certs\") pod \"konnectivity-agent-gtnl4\" (UID: \"5d26816d-e3f1-4d7d-805e-795e7c551506\") " pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.484011 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483872    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-conf-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484011 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.483930    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-hostroot\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484016    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cdda3bd2-9418-450f-93ba-732c8fedd587-host-slash\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.484101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484067    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1afc6f59-e725-4558-8cd4-975d4ed8ba37-env-overrides\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.484249 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484133    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-serviceca\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.484249 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484204    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-os-release\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.484340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484249    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-etc-selinux\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.484340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484238    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.484340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484248    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-os-release\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.484340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484331    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-run\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484363    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-cni-bin\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484362    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-kubernetes\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484403    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-etc-selinux\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484430    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-node-log\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484437    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-cni-bin\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484496    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-conf-dir\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484497    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-os-release\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484525    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-netns\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484546    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-cni-multus\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484529    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484576    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndct2\" (UniqueName: \"kubernetes.io/projected/6ecfb99b-8aa4-472e-a985-06c40f2b3089-kube-api-access-ndct2\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484599    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-systemd-units\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484608    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484626    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-sysctl-d\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484664    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-run\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484711    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-kubelet\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484738    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jjt\" (UniqueName: \"kubernetes.io/projected/41263631-aeb1-4e4a-b74d-81ebab5a3046-kube-api-access-p2jjt\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484789    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7fr\" (UniqueName: \"kubernetes.io/projected/645d24d3-06ba-4b59-95ca-3c06dab54c1f-kube-api-access-zj7fr\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484801    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/051a81d9-5332-4e43-93fa-76a9d9b0c540-cni-binary-copy\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484822    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4c0957-aa37-4727-b9b1-de41023a6e13-tmp-dir\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.484863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484854    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-kubelet\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.484984    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-run-systemd\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.484993    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485048    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-var-lib-cni-multus\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.485128    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:29.985068384 +0000 UTC m=+2.970890368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485159    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-cni-netd\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485191    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwbp8\" (UniqueName: \"kubernetes.io/projected/1afc6f59-e725-4558-8cd4-975d4ed8ba37-kube-api-access-qwbp8\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485250    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4c0957-aa37-4727-b9b1-de41023a6e13-tmp-dir\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485264    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-sys-fs\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485298    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-systemd\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485349    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/645d24d3-06ba-4b59-95ca-3c06dab54c1f-tmp\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485418    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee4c0957-aa37-4727-b9b1-de41023a6e13-hosts-file\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485458    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrhk7\" (UniqueName: \"kubernetes.io/projected/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-kube-api-access-qrhk7\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485462    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-lib-modules\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.485505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485509    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-cni-netd\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485519    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-slash\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485562    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/645d24d3-06ba-4b59-95ca-3c06dab54c1f-etc-systemd\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485583    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485631    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-sys-fs\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485785    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ee4c0957-aa37-4727-b9b1-de41023a6e13-hosts-file\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485811    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485873    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-slash\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.486226 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.485888    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-k8s-cni-cncf-io\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.486571 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.486535    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-cnibin\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.486630 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.486573    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d26816d-e3f1-4d7d-805e-795e7c551506-konnectivity-ca\") pod \"konnectivity-agent-gtnl4\" (UID: \"5d26816d-e3f1-4d7d-805e-795e7c551506\") " pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.486694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.486675    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-socket-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.486745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.486706    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-device-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.486950 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.486931    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7mcd\" (UniqueName: \"kubernetes.io/projected/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-kube-api-access-b7mcd\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487166    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-socket-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487214    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/051a81d9-5332-4e43-93fa-76a9d9b0c540-host-run-k8s-cni-cncf-io\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487216    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-run-netns\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487252    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-etc-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487264    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-host-run-netns\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487332    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67-device-dir\") pod \"aws-ebs-csi-driver-node-kzldb\" (UID: \"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487332    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41263631-aeb1-4e4a-b74d-81ebab5a3046-cnibin\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.487380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487370    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1afc6f59-e725-4558-8cd4-975d4ed8ba37-etc-openvswitch\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.487806 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.486894    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/051a81d9-5332-4e43-93fa-76a9d9b0c540-multus-daemon-config\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.487806 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487692    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1afc6f59-e725-4558-8cd4-975d4ed8ba37-ovn-node-metrics-cert\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.487806 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487725    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41263631-aeb1-4e4a-b74d-81ebab5a3046-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.487806 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.487732    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d26816d-e3f1-4d7d-805e-795e7c551506-konnectivity-ca\") pod \"konnectivity-agent-gtnl4\" (UID: \"5d26816d-e3f1-4d7d-805e-795e7c551506\") " pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.488080 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.488062    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cdda3bd2-9418-450f-93ba-732c8fedd587-iptables-alerter-script\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.489028 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.488990    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/645d24d3-06ba-4b59-95ca-3c06dab54c1f-tmp\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.490675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.490657    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjbdz\" (UniqueName: \"kubernetes.io/projected/ee4c0957-aa37-4727-b9b1-de41023a6e13-kube-api-access-qjbdz\") pod \"node-resolver-nq698\" (UID: \"ee4c0957-aa37-4727-b9b1-de41023a6e13\") " pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.505675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.505650    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmp9\" (UniqueName: \"kubernetes.io/projected/051a81d9-5332-4e43-93fa-76a9d9b0c540-kube-api-access-mqmp9\") pod \"multus-z6g7s\" (UID: \"051a81d9-5332-4e43-93fa-76a9d9b0c540\") " pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.506836 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.506816    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:32:29.506930 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.506841    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:32:29.506930 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.506862    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:29.507044 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.506940    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:32:30.006920967 +0000 UTC m=+2.992742951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:29.509505 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.509479    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrhk7\" (UniqueName: \"kubernetes.io/projected/c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8-kube-api-access-qrhk7\") pod \"node-ca-8224g\" (UID: \"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8\") " pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.510488 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.510075    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnrr\" (UniqueName: \"kubernetes.io/projected/cdda3bd2-9418-450f-93ba-732c8fedd587-kube-api-access-slnrr\") pod \"iptables-alerter-q4mgf\" (UID: \"cdda3bd2-9418-450f-93ba-732c8fedd587\") " pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.510488 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.510170    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndct2\" (UniqueName: \"kubernetes.io/projected/6ecfb99b-8aa4-472e-a985-06c40f2b3089-kube-api-access-ndct2\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.510631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.510541    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jjt\" (UniqueName: \"kubernetes.io/projected/41263631-aeb1-4e4a-b74d-81ebab5a3046-kube-api-access-p2jjt\") pod \"multus-additional-cni-plugins-6z2vs\" (UID: \"41263631-aeb1-4e4a-b74d-81ebab5a3046\") " pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.510631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.510562    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwbp8\" (UniqueName: \"kubernetes.io/projected/1afc6f59-e725-4558-8cd4-975d4ed8ba37-kube-api-access-qwbp8\") pod \"ovnkube-node-xc8s7\" (UID: \"1afc6f59-e725-4558-8cd4-975d4ed8ba37\") " pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.510631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.510570    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7fr\" (UniqueName: \"kubernetes.io/projected/645d24d3-06ba-4b59-95ca-3c06dab54c1f-kube-api-access-zj7fr\") pod \"tuned-njvdv\" (UID: \"645d24d3-06ba-4b59-95ca-3c06dab54c1f\") " pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.664685 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.664582    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q4mgf"
May 29 17:32:29.677549 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.677525    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8224g"
May 29 17:32:29.687082 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.687062    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nq698"
May 29 17:32:29.691779 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.691747    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6z2vs"
May 29 17:32:29.697323 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.697304    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:29.704926 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.704908    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:29.711536 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.711516    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb"
May 29 17:32:29.718079 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.718063    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-njvdv"
May 29 17:32:29.721640 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.721624    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z6g7s"
May 29 17:32:29.801278 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.801247    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 17:32:29.990851 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:29.990780    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:29.990994 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.990902    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:29.990994 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:29.990964    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:30.99094408 +0000 UTC m=+3.976766051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:30.057333 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.057295    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdda3bd2_9418_450f_93ba_732c8fedd587.slice/crio-f0a9d24b96979353c1dad16f2dd21c20f74a58ce80886ba14b9224a0a781ff05 WatchSource:0}: Error finding container f0a9d24b96979353c1dad16f2dd21c20f74a58ce80886ba14b9224a0a781ff05: Status 404 returned error can't find the container with id f0a9d24b96979353c1dad16f2dd21c20f74a58ce80886ba14b9224a0a781ff05
May 29 17:32:30.058388 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.058354    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41263631_aeb1_4e4a_b74d_81ebab5a3046.slice/crio-c0a4cbf9719713bf24b3e7de9db812a19fff79c0370bf865bbcc431ca2ee6d6f WatchSource:0}: Error finding container c0a4cbf9719713bf24b3e7de9db812a19fff79c0370bf865bbcc431ca2ee6d6f: Status 404 returned error can't find the container with id c0a4cbf9719713bf24b3e7de9db812a19fff79c0370bf865bbcc431ca2ee6d6f
May 29 17:32:30.061426 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.061405    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4c0957_aa37_4727_b9b1_de41023a6e13.slice/crio-fdb61b856f8ff47429ff8fe88d81e0430b172cf7bb9e8e5c3d61252482f9c9b2 WatchSource:0}: Error finding container fdb61b856f8ff47429ff8fe88d81e0430b172cf7bb9e8e5c3d61252482f9c9b2: Status 404 returned error can't find the container with id fdb61b856f8ff47429ff8fe88d81e0430b172cf7bb9e8e5c3d61252482f9c9b2
May 29 17:32:30.062515 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.062490    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afc6f59_e725_4558_8cd4_975d4ed8ba37.slice/crio-d9843f778ae40e64b5e708e5c7e924c45a42ae53e381deeb00fddc572c43445e WatchSource:0}: Error finding container d9843f778ae40e64b5e708e5c7e924c45a42ae53e381deeb00fddc572c43445e: Status 404 returned error can't find the container with id d9843f778ae40e64b5e708e5c7e924c45a42ae53e381deeb00fddc572c43445e
May 29 17:32:30.063826 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.063501    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051a81d9_5332_4e43_93fa_76a9d9b0c540.slice/crio-c2e2ef080e1de3237164ecbcaea97ec21a9f90777af786c622b33e6ea9edf530 WatchSource:0}: Error finding container c2e2ef080e1de3237164ecbcaea97ec21a9f90777af786c622b33e6ea9edf530: Status 404 returned error can't find the container with id c2e2ef080e1de3237164ecbcaea97ec21a9f90777af786c622b33e6ea9edf530
May 29 17:32:30.064697 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.064064    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645d24d3_06ba_4b59_95ca_3c06dab54c1f.slice/crio-0c484e7dd69bfdf7c7781a10d9523b0cd6269d9ef6f7a215a3cf470982e3e07a WatchSource:0}: Error finding container 0c484e7dd69bfdf7c7781a10d9523b0cd6269d9ef6f7a215a3cf470982e3e07a: Status 404 returned error can't find the container with id 0c484e7dd69bfdf7c7781a10d9523b0cd6269d9ef6f7a215a3cf470982e3e07a
May 29 17:32:30.065065 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.064856    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c4bbc0_d6bb_4fc2_90aa_0e34e2bdaeb8.slice/crio-0b4be6741e70f9579eab76a1f1f63a464dc6abdb35d9574bd8570e8c0551f238 WatchSource:0}: Error finding container 0b4be6741e70f9579eab76a1f1f63a464dc6abdb35d9574bd8570e8c0551f238: Status 404 returned error can't find the container with id 0b4be6741e70f9579eab76a1f1f63a464dc6abdb35d9574bd8570e8c0551f238
May 29 17:32:30.066460 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.066429    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c89cd1_5615_46a3_97a6_ea4c0f7c9e67.slice/crio-16c34caa1ff8c081851bf0e59fe53dc965cbda78c5bfc6f451c5f805e459fd65 WatchSource:0}: Error finding container 16c34caa1ff8c081851bf0e59fe53dc965cbda78c5bfc6f451c5f805e459fd65: Status 404 returned error can't find the container with id 16c34caa1ff8c081851bf0e59fe53dc965cbda78c5bfc6f451c5f805e459fd65
May 29 17:32:30.067465 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:32:30.067444    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d26816d_e3f1_4d7d_805e_795e7c551506.slice/crio-6ef0e5abeac9fd9b096f0e6e89bb249608ba49a5b01ed304abc96915d1d65192 WatchSource:0}: Error finding container 6ef0e5abeac9fd9b096f0e6e89bb249608ba49a5b01ed304abc96915d1d65192: Status 404 returned error can't find the container with id 6ef0e5abeac9fd9b096f0e6e89bb249608ba49a5b01ed304abc96915d1d65192
May 29 17:32:30.091644 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.091623    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:30.091784 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.091769    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:32:30.091872 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.091787    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:32:30.091872 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.091797    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:30.091872 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.091846    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:32:31.091828191 +0000 UTC m=+4.077650181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:30.411398 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.411346    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 17:27:28 +0000 UTC" deadline="2028-01-22 13:50:23.888428778 +0000 UTC"
May 29 17:32:30.411398 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.411386    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14468h17m53.477047149s"
May 29 17:32:30.507053 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.507023    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:30.507551 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.507164    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:30.513508 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.513480    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb" event={"ID":"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67","Type":"ContainerStarted","Data":"16c34caa1ff8c081851bf0e59fe53dc965cbda78c5bfc6f451c5f805e459fd65"}
May 29 17:32:30.515021 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.514976    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6g7s" event={"ID":"051a81d9-5332-4e43-93fa-76a9d9b0c540","Type":"ContainerStarted","Data":"c2e2ef080e1de3237164ecbcaea97ec21a9f90777af786c622b33e6ea9edf530"}
May 29 17:32:30.516764 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.516715    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"d9843f778ae40e64b5e708e5c7e924c45a42ae53e381deeb00fddc572c43445e"}
May 29 17:32:30.519044 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.519021    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nq698" event={"ID":"ee4c0957-aa37-4727-b9b1-de41023a6e13","Type":"ContainerStarted","Data":"fdb61b856f8ff47429ff8fe88d81e0430b172cf7bb9e8e5c3d61252482f9c9b2"}
May 29 17:32:30.521649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.521624    2558 generic.go:358] "Generic (PLEG): container finished" podID="ebfb94786244dd307dcbc36209e184ce" containerID="a62792b6f0dead203948aec451f347828de5a0132c5c20d32e2086d31be5eaaa" exitCode=0
May 29 17:32:30.521733 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.521690    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal" event={"ID":"ebfb94786244dd307dcbc36209e184ce","Type":"ContainerDied","Data":"a62792b6f0dead203948aec451f347828de5a0132c5c20d32e2086d31be5eaaa"}
May 29 17:32:30.526919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.526896    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtnl4" event={"ID":"5d26816d-e3f1-4d7d-805e-795e7c551506","Type":"ContainerStarted","Data":"6ef0e5abeac9fd9b096f0e6e89bb249608ba49a5b01ed304abc96915d1d65192"}
May 29 17:32:30.536218 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.536148    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8224g" event={"ID":"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8","Type":"ContainerStarted","Data":"0b4be6741e70f9579eab76a1f1f63a464dc6abdb35d9574bd8570e8c0551f238"}
May 29 17:32:30.539248 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.539209    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-njvdv" event={"ID":"645d24d3-06ba-4b59-95ca-3c06dab54c1f","Type":"ContainerStarted","Data":"0c484e7dd69bfdf7c7781a10d9523b0cd6269d9ef6f7a215a3cf470982e3e07a"}
May 29 17:32:30.546013 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.545953    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerStarted","Data":"c0a4cbf9719713bf24b3e7de9db812a19fff79c0370bf865bbcc431ca2ee6d6f"}
May 29 17:32:30.552015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.551963    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q4mgf" event={"ID":"cdda3bd2-9418-450f-93ba-732c8fedd587","Type":"ContainerStarted","Data":"f0a9d24b96979353c1dad16f2dd21c20f74a58ce80886ba14b9224a0a781ff05"}
May 29 17:32:30.556166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.555613    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal" event={"ID":"1330ceee6fcbb89d1606f2672ec11098","Type":"ContainerStarted","Data":"623bc3aad398760a130ba9ab011d95a8d5176076799f68b041200f8fcf4430ad"}
May 29 17:32:30.998474 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:30.998381    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:30.998638 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.998523    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:30.998638 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:30.998585    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:32.998565637 +0000 UTC m=+5.984387616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:31.099817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:31.099183    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:31.099817 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:31.099375    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:32:31.099817 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:31.099398    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:32:31.099817 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:31.099412    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:31.099817 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:31.099479    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:32:33.099460452 +0000 UTC m=+6.085282428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:31.509482 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:31.509013    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:31.509482 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:31.509134    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:31.582396 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:31.582359    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal" event={"ID":"ebfb94786244dd307dcbc36209e184ce","Type":"ContainerStarted","Data":"9ddd6a5daa62df1abd18578d97aac9e660dcef0a8c35f3ff9838b38d0de88499"}
May 29 17:32:31.597503 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:31.596279    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-69.ec2.internal" podStartSLOduration=3.59625832 podStartE2EDuration="3.59625832s" podCreationTimestamp="2026-05-29 17:32:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:32:30.574235434 +0000 UTC m=+3.560057424" watchObservedRunningTime="2026-05-29 17:32:31.59625832 +0000 UTC m=+4.582080290"
May 29 17:32:32.506207 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:32.506178    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:32.506386 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:32.506311    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:33.013448 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:33.013411    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:33.013958 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.013586    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:33.013958 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.013652    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:37.013633052 +0000 UTC m=+9.999455024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:33.114115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:33.114034    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:33.114300 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.114208    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:32:33.114300 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.114227    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:32:33.114300 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.114239    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:33.114480 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.114303    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:32:37.114283881 +0000 UTC m=+10.100105853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:33.507359 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:33.507278    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:33.507521 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:33.507411    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:34.506715 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:34.506678    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:34.507198 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:34.506839    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:35.506078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:35.506046    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:35.506257 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:35.506174    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:36.506308 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:36.506273    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:36.506709 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:36.506424    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:37.047805 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:37.047260    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:37.047805 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.047410    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:37.047805 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.047472    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:32:45.047452174 +0000 UTC m=+18.033274142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:37.148296 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:37.148255    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:37.148477 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.148448    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:32:37.148477 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.148472    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:32:37.148586 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.148486    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:37.148586 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.148554    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:32:45.148535341 +0000 UTC m=+18.134357331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:37.507548 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:37.507472    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:37.507962 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:37.507572    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:38.506407 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:38.506369    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:38.506595 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:38.506511    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:39.506497 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:39.505996    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:39.506497 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:39.506120    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:40.506890 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:40.506834    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:40.507282 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:40.506984    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:41.506399 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:41.506365    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:41.506622 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:41.506477    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:42.506231 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:42.506203    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:42.506697 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:42.506329    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:43.507079 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:43.507045    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:43.507513 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:43.507168    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:44.506762 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:44.506722    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:44.506958 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:44.506887    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:45.109256 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:45.109213    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:45.109662 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.109334    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:45.109662 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.109396    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:01.109378471 +0000 UTC m=+34.095200442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:32:45.210491 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:45.210443    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:45.210681 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.210620    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:32:45.210681 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.210641    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:32:45.210681 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.210651    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:45.210867 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.210709    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:01.210690314 +0000 UTC m=+34.196512306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:32:45.507090 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:45.506994    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:45.507239 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:45.507110    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:46.507005 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:46.506972    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:46.507490 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:46.507105    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:47.509712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:47.509681    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:47.510165 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:47.509778    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:48.506497 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.506327    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:48.506599 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:48.506582    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:48.613332 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.613157    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gtnl4" event={"ID":"5d26816d-e3f1-4d7d-805e-795e7c551506","Type":"ContainerStarted","Data":"0351727515eeb779647ad3f5976bb1155c59f063641ac36b42c5b13482b9c64e"}
May 29 17:32:48.619075 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.619044    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8224g" event={"ID":"c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8","Type":"ContainerStarted","Data":"94eb0f6dab0e4a1a0c400bb52df1e16fba7dc056c3713b67582e3302b8bf35e0"}
May 29 17:32:48.620356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.620333    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-njvdv" event={"ID":"645d24d3-06ba-4b59-95ca-3c06dab54c1f","Type":"ContainerStarted","Data":"3d3ac65cb231444d0919798a25b37c40c5763e97e90a8455b38f808288f8ec56"}
May 29 17:32:48.621743 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.621717    2558 generic.go:358] "Generic (PLEG): container finished" podID="41263631-aeb1-4e4a-b74d-81ebab5a3046" containerID="d7f2b7f5f965a12d6ea305d90f512e993df34ae3d411d7b724d5e78237284b66" exitCode=0
May 29 17:32:48.621882 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.621812    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerDied","Data":"d7f2b7f5f965a12d6ea305d90f512e993df34ae3d411d7b724d5e78237284b66"}
May 29 17:32:48.623565 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.623544    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb" event={"ID":"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67","Type":"ContainerStarted","Data":"21024f49083e49d996e68ace198d764d9c70382e311ef12a8a8eaf3ef3c98049"}
May 29 17:32:48.625126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.624972    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z6g7s" event={"ID":"051a81d9-5332-4e43-93fa-76a9d9b0c540","Type":"ContainerStarted","Data":"f9f227297351c2c9f3cc0ad6b0859c86f48a38b6b1fef0370fccec12724cb670"}
May 29 17:32:48.627017 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.626913    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gtnl4" podStartSLOduration=11.732840711 podStartE2EDuration="21.626898887s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.069088149 +0000 UTC m=+3.054910134" lastFinishedPulling="2026-05-29 17:32:39.96314633 +0000 UTC m=+12.948968310" observedRunningTime="2026-05-29 17:32:48.626353905 +0000 UTC m=+21.612175895" watchObservedRunningTime="2026-05-29 17:32:48.626898887 +0000 UTC m=+21.612720900"
May 29 17:32:48.627111 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.627067    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-69.ec2.internal" podStartSLOduration=20.627059781 podStartE2EDuration="20.627059781s" podCreationTimestamp="2026-05-29 17:32:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:32:31.597486228 +0000 UTC m=+4.583308219" watchObservedRunningTime="2026-05-29 17:32:48.627059781 +0000 UTC m=+21.612881771"
May 29 17:32:48.628610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.628590    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:32:48.628934 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.628902    2558 generic.go:358] "Generic (PLEG): container finished" podID="1afc6f59-e725-4558-8cd4-975d4ed8ba37" containerID="c8a68215dcb143262da4876466579b6bf722f8449e61f5bc23f31219023c4dfc" exitCode=1
May 29 17:32:48.629015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.628930    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"4d5396856d84173c8d46a21af353a2297d585f0f63658a0e9eeb6fa02d20b9dc"}
May 29 17:32:48.629015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.628957    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"54f9c52bc7d55ef418b975d25092db860b164ff24a81cdab805d9c7ffef3aa44"}
May 29 17:32:48.629015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.628989    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"06116d29a7a7f40505fcc3853f9c27eb86cefd971af46d33f00916555340d23f"}
May 29 17:32:48.629015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.629000    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerDied","Data":"c8a68215dcb143262da4876466579b6bf722f8449e61f5bc23f31219023c4dfc"}
May 29 17:32:48.629204 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.629016    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"2070f88f854623e54346976003e6bf2a902bb655d69a62fb8db9eece266ffb8b"}
May 29 17:32:48.630177 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.630156    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nq698" event={"ID":"ee4c0957-aa37-4727-b9b1-de41023a6e13","Type":"ContainerStarted","Data":"4aeb241aee2c9e38a4f2e995b97ca1c2c3cad3ac7cde29b8e5d1205e65cacd16"}
May 29 17:32:48.639502 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.639464    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8224g" podStartSLOduration=4.121484684 podStartE2EDuration="21.639454361s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.067037289 +0000 UTC m=+3.052859264" lastFinishedPulling="2026-05-29 17:32:47.585006957 +0000 UTC m=+20.570828941" observedRunningTime="2026-05-29 17:32:48.638794703 +0000 UTC m=+21.624616685" watchObservedRunningTime="2026-05-29 17:32:48.639454361 +0000 UTC m=+21.625276349"
May 29 17:32:48.673581 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.673477    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-z6g7s" podStartSLOduration=3.773923751 podStartE2EDuration="21.67345892s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.065125258 +0000 UTC m=+3.050947241" lastFinishedPulling="2026-05-29 17:32:47.96466044 +0000 UTC m=+20.950482410" observedRunningTime="2026-05-29 17:32:48.672820596 +0000 UTC m=+21.658642586" watchObservedRunningTime="2026-05-29 17:32:48.67345892 +0000 UTC m=+21.659280911"
May 29 17:32:48.694727 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.694689    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-njvdv" podStartSLOduration=3.8088590140000003 podStartE2EDuration="21.694674467s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.06601981 +0000 UTC m=+3.051841777" lastFinishedPulling="2026-05-29 17:32:47.95183525 +0000 UTC m=+20.937657230" observedRunningTime="2026-05-29 17:32:48.694245288 +0000 UTC m=+21.680067278" watchObservedRunningTime="2026-05-29 17:32:48.694674467 +0000 UTC m=+21.680496457"
May 29 17:32:48.708038 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:48.707994    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nq698" podStartSLOduration=4.186112595 podStartE2EDuration="21.70797886s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.063138502 +0000 UTC m=+3.048960469" lastFinishedPulling="2026-05-29 17:32:47.585004764 +0000 UTC m=+20.570826734" observedRunningTime="2026-05-29 17:32:48.707382711 +0000 UTC m=+21.693204702" watchObservedRunningTime="2026-05-29 17:32:48.70797886 +0000 UTC m=+21.693800853"
May 29 17:32:49.272193 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.272156    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 17:32:49.444475 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.444365    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T17:32:49.27218837Z","UUID":"ad5dd18c-fb88-482b-bb7e-baf95a9bbac7","Handler":null,"Name":"","Endpoint":""}
May 29 17:32:49.445942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.445920    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 17:32:49.445942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.445945    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 17:32:49.506621 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.506552    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:49.506742 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:49.506636    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:49.633229 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.633199    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q4mgf" event={"ID":"cdda3bd2-9418-450f-93ba-732c8fedd587","Type":"ContainerStarted","Data":"e751e56bbf8d8fd763f5d1b2a36724375e5063ca36e834d97a56ed8d03c5e05d"}
May 29 17:32:49.634868 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.634845    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb" event={"ID":"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67","Type":"ContainerStarted","Data":"6bf1fe6fd4f1a6bbe2eb0d7cf2baf9f72cc793e23650e791b394f4a154a9b2f2"}
May 29 17:32:49.636966 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.636948    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:32:49.637308 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.637286    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"5bc8412a535ce44e083bdbd07823292a9cdef382fbbbafddba40aaa6319b73f4"}
May 29 17:32:49.647558 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.647517    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q4mgf" podStartSLOduration=4.809998646 podStartE2EDuration="22.647506109s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.059570148 +0000 UTC m=+3.045392118" lastFinishedPulling="2026-05-29 17:32:47.897077599 +0000 UTC m=+20.882899581" observedRunningTime="2026-05-29 17:32:49.647401548 +0000 UTC m=+22.633223550" watchObservedRunningTime="2026-05-29 17:32:49.647506109 +0000 UTC m=+22.633328097"
May 29 17:32:49.885183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.885106    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:49.885766 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:49.885733    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:50.506551 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:50.506528    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:50.506644 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:50.506628    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:50.642613 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:50.642527    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb" event={"ID":"d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67","Type":"ContainerStarted","Data":"459eab161e5ab1446935ae42d235b3301bc24bca9acccd8d05da85689450412d"}
May 29 17:32:50.643024 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:50.642901    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:50.643338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:50.643322    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gtnl4"
May 29 17:32:50.675690 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:50.675655    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzldb" podStartSLOduration=3.361869722 podStartE2EDuration="23.675643757s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.068099099 +0000 UTC m=+3.053921066" lastFinishedPulling="2026-05-29 17:32:50.381873116 +0000 UTC m=+23.367695101" observedRunningTime="2026-05-29 17:32:50.660039115 +0000 UTC m=+23.645861103" watchObservedRunningTime="2026-05-29 17:32:50.675643757 +0000 UTC m=+23.661465745"
May 29 17:32:51.506557 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:51.506526    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:51.506719 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:51.506627    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:51.646648 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:51.646624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:32:51.647033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:51.647001    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"7d7b22daf5bb81dc87e4ca12dcf267d385e0a9877aadff335b6d760cad8bca69"}
May 29 17:32:52.506895 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:52.506859    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:52.507050 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:52.507003    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:53.506841 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:53.506653    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:53.507230 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:53.506930    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:54.506517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.506477    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:54.506689 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:54.506601    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:54.654546 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.654494    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:32:54.655340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.654852    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"afbca9d5704f4822959ac32bdf6c9c241c2a2b086745e7190e12efeb9d2b65a5"}
May 29 17:32:54.655340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.655121    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:54.655340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.655146    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:54.655340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.655231    2558 scope.go:117] "RemoveContainer" containerID="c8a68215dcb143262da4876466579b6bf722f8449e61f5bc23f31219023c4dfc"
May 29 17:32:54.656606 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.656582    2558 generic.go:358] "Generic (PLEG): container finished" podID="41263631-aeb1-4e4a-b74d-81ebab5a3046" containerID="e040d3ebe2f019a4954b228b3850a5f5e5b9150acc6dcf5d25f28ea5510de86a" exitCode=0
May 29 17:32:54.656720 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.656622    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerDied","Data":"e040d3ebe2f019a4954b228b3850a5f5e5b9150acc6dcf5d25f28ea5510de86a"}
May 29 17:32:54.670559 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:54.670537    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:55.507152 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:55.506972    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:55.507312 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:55.507223    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:55.663332 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:55.663309    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:32:55.663722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:55.663651    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" event={"ID":"1afc6f59-e725-4558-8cd4-975d4ed8ba37","Type":"ContainerStarted","Data":"171c5c9e58cf3605d8edd93179204403ecb2a53c2f396d1f8c0093ffb2d94a62"}
May 29 17:32:55.663882 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:55.663867    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:55.678906 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:55.678884    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:32:55.689712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:55.689666    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7" podStartSLOduration=10.752068456 podStartE2EDuration="28.689653207s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.064531034 +0000 UTC m=+3.050353007" lastFinishedPulling="2026-05-29 17:32:48.002115786 +0000 UTC m=+20.987937758" observedRunningTime="2026-05-29 17:32:55.688972715 +0000 UTC m=+28.674794717" watchObservedRunningTime="2026-05-29 17:32:55.689653207 +0000 UTC m=+28.675475195"
May 29 17:32:56.050787 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:56.050700    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cqgl2"]
May 29 17:32:56.050913 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:56.050836    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:56.050962 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:56.050945    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:56.052884 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:56.052863    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x8rpq"]
May 29 17:32:56.052982 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:56.052971    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:56.053056 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:56.053042    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:56.666859 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:56.666829    2558 generic.go:358] "Generic (PLEG): container finished" podID="41263631-aeb1-4e4a-b74d-81ebab5a3046" containerID="96bdacb8aa3b98c5f812065f62d947be119138f2de2fd8d7cf3e63e0d4a95390" exitCode=0
May 29 17:32:56.667224 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:56.666922    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerDied","Data":"96bdacb8aa3b98c5f812065f62d947be119138f2de2fd8d7cf3e63e0d4a95390"}
May 29 17:32:57.507714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:57.507686    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:57.507890 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:57.507795    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:57.507890 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:57.507836    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:57.507890 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:57.507857    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:32:58.672427 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:58.672349    2558 generic.go:358] "Generic (PLEG): container finished" podID="41263631-aeb1-4e4a-b74d-81ebab5a3046" containerID="686c34a90545cd1b7b79b5b85af650a629efc2433eceebc7bc27077657b8cf9c" exitCode=0
May 29 17:32:58.672427 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:58.672386    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerDied","Data":"686c34a90545cd1b7b79b5b85af650a629efc2433eceebc7bc27077657b8cf9c"}
May 29 17:32:59.507182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:59.507012    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:32:59.507340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:32:59.507046    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:32:59.507340 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:59.507265    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8rpq" podUID="6ecfb99b-8aa4-472e-a985-06c40f2b3089"
May 29 17:32:59.507418 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:32:59.507366    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqgl2" podUID="49f341be-bb0c-40ba-8c5d-74c694497c9d"
May 29 17:33:00.862019 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.861956    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-69.ec2.internal" event="NodeReady"
May 29 17:33:00.862371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.862054    2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 17:33:00.908731 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.908698    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nv548"]
May 29 17:33:00.924560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.924533    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h9972"]
May 29 17:33:00.924745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.924695    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nv548"
May 29 17:33:00.927061 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.927037    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 17:33:00.927318 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.927302    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x9xz\""
May 29 17:33:00.927407 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.927347    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 17:33:00.936894 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.936875    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nv548"]
May 29 17:33:00.936894 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.936896    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h9972"]
May 29 17:33:00.937057 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.936987    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:00.939528 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.939508    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 17:33:00.939528 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.939517    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sf6m9\""
May 29 17:33:00.939682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.939580    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 17:33:00.939682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:00.939510    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 17:33:01.034662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.034637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxrp8\" (UniqueName: \"kubernetes.io/projected/4f0113ab-ed45-42fa-be67-ab6406ec6525-kube-api-access-cxrp8\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.034832 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.034675    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f0113ab-ed45-42fa-be67-ab6406ec6525-config-volume\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.034832 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.034706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvwm2\" (UniqueName: \"kubernetes.io/projected/c09e52f2-310d-4da7-abee-295e3689f5bf-kube-api-access-qvwm2\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:01.034832 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.034767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.034832 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.034783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f0113ab-ed45-42fa-be67-ab6406ec6525-tmp-dir\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.034832 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.034818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:01.135722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.135646    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cxrp8\" (UniqueName: \"kubernetes.io/projected/4f0113ab-ed45-42fa-be67-ab6406ec6525-kube-api-access-cxrp8\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.135722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.135690    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f0113ab-ed45-42fa-be67-ab6406ec6525-config-volume\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.135728    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvwm2\" (UniqueName: \"kubernetes.io/projected/c09e52f2-310d-4da7-abee-295e3689f5bf-kube-api-access-qvwm2\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.135772    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.135804    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.135881    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.135890    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.135937    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls podName:4f0113ab-ed45-42fa-be67-ab6406ec6525 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:01.635918611 +0000 UTC m=+34.621740580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls") pod "dns-default-nv548" (UID: "4f0113ab-ed45-42fa-be67-ab6406ec6525") : secret "dns-default-metrics-tls" not found
May 29 17:33:01.135951 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.135953    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:33.135945292 +0000 UTC m=+66.121767260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 17:33:01.136260 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.136053    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f0113ab-ed45-42fa-be67-ab6406ec6525-tmp-dir\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.136260 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.136125    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:01.136260 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.136238    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 17:33:01.136383 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.136283    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert podName:c09e52f2-310d-4da7-abee-295e3689f5bf nodeName:}" failed. No retries permitted until 2026-05-29 17:33:01.63626731 +0000 UTC m=+34.622089278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert") pod "ingress-canary-h9972" (UID: "c09e52f2-310d-4da7-abee-295e3689f5bf") : secret "canary-serving-cert" not found
May 29 17:33:01.136383 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.136340    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4f0113ab-ed45-42fa-be67-ab6406ec6525-tmp-dir\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.136468 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.136445    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4f0113ab-ed45-42fa-be67-ab6406ec6525-config-volume\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.146993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.146969    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxrp8\" (UniqueName: \"kubernetes.io/projected/4f0113ab-ed45-42fa-be67-ab6406ec6525-kube-api-access-cxrp8\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.147153 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.147003    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvwm2\" (UniqueName: \"kubernetes.io/projected/c09e52f2-310d-4da7-abee-295e3689f5bf-kube-api-access-qvwm2\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:01.236584 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.236544    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:33:01.236736 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.236705    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 17:33:01.236736 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.236723    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 17:33:01.236736 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.236732    2558 projected.go:194] Error preparing data for projected volume kube-api-access-sw228 for pod openshift-network-diagnostics/network-check-target-cqgl2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:33:01.236896 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.236793    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228 podName:49f341be-bb0c-40ba-8c5d-74c694497c9d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:33.236778328 +0000 UTC m=+66.222600294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw228" (UniqueName: "kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228") pod "network-check-target-cqgl2" (UID: "49f341be-bb0c-40ba-8c5d-74c694497c9d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 17:33:01.506526 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.506487    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:33:01.506740 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.506501    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:33:01.509196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.509174    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 17:33:01.511716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.509642    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 17:33:01.511716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.510031    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlz48\""
May 29 17:33:01.511716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.510137    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 17:33:01.513617 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.513454    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6stw\""
May 29 17:33:01.639550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.639517    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:01.639550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:01.639551    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:01.639766 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.639662    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 17:33:01.639766 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.639728    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls podName:4f0113ab-ed45-42fa-be67-ab6406ec6525 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:02.639709028 +0000 UTC m=+35.625531009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls") pod "dns-default-nv548" (UID: "4f0113ab-ed45-42fa-be67-ab6406ec6525") : secret "dns-default-metrics-tls" not found
May 29 17:33:01.639766 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.639739    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 17:33:01.639929 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:01.639823    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert podName:c09e52f2-310d-4da7-abee-295e3689f5bf nodeName:}" failed. No retries permitted until 2026-05-29 17:33:02.639805258 +0000 UTC m=+35.625627230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert") pod "ingress-canary-h9972" (UID: "c09e52f2-310d-4da7-abee-295e3689f5bf") : secret "canary-serving-cert" not found
May 29 17:33:02.645501 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:02.645469    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:02.646138 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:02.645507    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:02.646138 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:02.645613    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 17:33:02.646138 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:02.645688    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert podName:c09e52f2-310d-4da7-abee-295e3689f5bf nodeName:}" failed. No retries permitted until 2026-05-29 17:33:04.645669 +0000 UTC m=+37.631490996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert") pod "ingress-canary-h9972" (UID: "c09e52f2-310d-4da7-abee-295e3689f5bf") : secret "canary-serving-cert" not found
May 29 17:33:02.646138 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:02.645613    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 17:33:02.646138 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:02.645790    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls podName:4f0113ab-ed45-42fa-be67-ab6406ec6525 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:04.645767676 +0000 UTC m=+37.631589664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls") pod "dns-default-nv548" (UID: "4f0113ab-ed45-42fa-be67-ab6406ec6525") : secret "dns-default-metrics-tls" not found
May 29 17:33:04.661986 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:04.661951    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:04.662611 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:04.662069    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:04.662611 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:04.662096    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 17:33:04.662611 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:04.662179    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert podName:c09e52f2-310d-4da7-abee-295e3689f5bf nodeName:}" failed. No retries permitted until 2026-05-29 17:33:08.662157585 +0000 UTC m=+41.647979575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert") pod "ingress-canary-h9972" (UID: "c09e52f2-310d-4da7-abee-295e3689f5bf") : secret "canary-serving-cert" not found
May 29 17:33:04.662611 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:04.662178    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 17:33:04.662611 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:04.662232    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls podName:4f0113ab-ed45-42fa-be67-ab6406ec6525 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:08.662216331 +0000 UTC m=+41.648038313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls") pod "dns-default-nv548" (UID: "4f0113ab-ed45-42fa-be67-ab6406ec6525") : secret "dns-default-metrics-tls" not found
May 29 17:33:06.690976 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:06.690944    2558 generic.go:358] "Generic (PLEG): container finished" podID="41263631-aeb1-4e4a-b74d-81ebab5a3046" containerID="b61157a3fe8b9dcdda9a11f8c1c4be3fb7dfe527b6e11de9687aa87a41885fac" exitCode=0
May 29 17:33:06.691379 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:06.691010    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerDied","Data":"b61157a3fe8b9dcdda9a11f8c1c4be3fb7dfe527b6e11de9687aa87a41885fac"}
May 29 17:33:07.695068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:07.695036    2558 generic.go:358] "Generic (PLEG): container finished" podID="41263631-aeb1-4e4a-b74d-81ebab5a3046" containerID="9767e060b7cf2efdc3de0e5d7f5f6f88f016f2cc58d37c265181d1179717e3e0" exitCode=0
May 29 17:33:07.695434 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:07.695099    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerDied","Data":"9767e060b7cf2efdc3de0e5d7f5f6f88f016f2cc58d37c265181d1179717e3e0"}
May 29 17:33:08.689045 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:08.688999    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:08.689045 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:08.689047    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:08.689256 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:08.689141    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 17:33:08.689256 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:08.689155    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 17:33:08.689256 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:08.689190    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert podName:c09e52f2-310d-4da7-abee-295e3689f5bf nodeName:}" failed. No retries permitted until 2026-05-29 17:33:16.689177185 +0000 UTC m=+49.674999152 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert") pod "ingress-canary-h9972" (UID: "c09e52f2-310d-4da7-abee-295e3689f5bf") : secret "canary-serving-cert" not found
May 29 17:33:08.689256 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:08.689212    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls podName:4f0113ab-ed45-42fa-be67-ab6406ec6525 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:16.689198928 +0000 UTC m=+49.675020895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls") pod "dns-default-nv548" (UID: "4f0113ab-ed45-42fa-be67-ab6406ec6525") : secret "dns-default-metrics-tls" not found
May 29 17:33:08.699494 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:08.699469    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" event={"ID":"41263631-aeb1-4e4a-b74d-81ebab5a3046","Type":"ContainerStarted","Data":"61b5878662862830b05525d13d77b8d6fd1608ea952032f28ae6c17baa229c2f"}
May 29 17:33:08.723715 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:08.723681    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6z2vs" podStartSLOduration=6.066576119 podStartE2EDuration="41.72367007s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:32:30.060395396 +0000 UTC m=+3.046217363" lastFinishedPulling="2026-05-29 17:33:05.717489343 +0000 UTC m=+38.703311314" observedRunningTime="2026-05-29 17:33:08.72248377 +0000 UTC m=+41.708305758" watchObservedRunningTime="2026-05-29 17:33:08.72367007 +0000 UTC m=+41.709492059"
May 29 17:33:16.335581 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.335546    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"]
May 29 17:33:16.371122 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.371094    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"]
May 29 17:33:16.371294 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.371267    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"
May 29 17:33:16.374056 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.374031    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 29 17:33:16.374186 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.374032    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 29 17:33:16.374186 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.374142    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w9kkv\""
May 29 17:33:16.388238 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.388168    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"]
May 29 17:33:16.388357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.388245    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"]
May 29 17:33:16.388357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.388353    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.390665 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.390628    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 29 17:33:16.390900 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.390711    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8t5tf\""
May 29 17:33:16.390900 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.390744    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 17:33:16.390900 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.390840    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 17:33:16.391940 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.391922    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 29 17:33:16.439716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.439690    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2rnqk"]
May 29 17:33:16.465195 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.465166    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"]
May 29 17:33:16.465373 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.465309    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.467931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.467911    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 29 17:33:16.467931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.467926    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 17:33:16.468088 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.467976    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tvzbw\""
May 29 17:33:16.468149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.468098    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 29 17:33:16.468240 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.468223    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 17:33:16.472288 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.472266    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 29 17:33:16.481065 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.481046    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"]
May 29 17:33:16.481206 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.481191    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.483602 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.483580    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 29 17:33:16.483602 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.483597    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 29 17:33:16.483768 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.483623    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 29 17:33:16.483768 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.483696    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 29 17:33:16.483929 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.483916    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j94b4\""
May 29 17:33:16.497061 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.497042    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"]
May 29 17:33:16.497207 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.497190    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:16.499504 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.499485    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 29 17:33:16.499504 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.499495    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 29 17:33:16.499643 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.499532    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j8h8n\""
May 29 17:33:16.499813 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.499794    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 29 17:33:16.517149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.517133    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65578c69-58dv2"]
May 29 17:33:16.517277 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.517262    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.523109 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.523092    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hpgnj\""
May 29 17:33:16.523189 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.523155    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 29 17:33:16.523354 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.523338    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 29 17:33:16.523397 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.523384    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 29 17:33:16.523432 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.523397    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 29 17:33:16.535909 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.535889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.536014 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.535925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wskw5\" (UniqueName: \"kubernetes.io/projected/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-kube-api-access-wskw5\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.536014 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.535977    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z6fc\" (UniqueName: \"kubernetes.io/projected/bca14924-8315-4246-9226-7e50009d9f64-kube-api-access-4z6fc\") pod \"volume-data-source-validator-7598fd5bd-9558b\" (UID: \"bca14924-8315-4246-9226-7e50009d9f64\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"
May 29 17:33:16.536099 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.536013    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.542242 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.542115    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2rnqk"]
May 29 17:33:16.542335 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.542247    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"]
May 29 17:33:16.542335 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.542259    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"]
May 29 17:33:16.542335 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.542274    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"]
May 29 17:33:16.542335 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.542284    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65578c69-58dv2"]
May 29 17:33:16.542335 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.542327    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.544615 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.544598    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 29 17:33:16.544692 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.544617    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 29 17:33:16.544692 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.544617    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 29 17:33:16.544795 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.544695    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55j58\""
May 29 17:33:16.549824 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.549804    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 29 17:33:16.636802 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.636701    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4z6fc\" (UniqueName: \"kubernetes.io/projected/bca14924-8315-4246-9226-7e50009d9f64-kube-api-access-4z6fc\") pod \"volume-data-source-validator-7598fd5bd-9558b\" (UID: \"bca14924-8315-4246-9226-7e50009d9f64\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"
May 29 17:33:16.636802 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.636745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwpbn\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-kube-api-access-pwpbn\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.636993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.636818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh4tm\" (UniqueName: \"kubernetes.io/projected/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-kube-api-access-nh4tm\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:16.636993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.636849    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-config\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.636993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.636880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-trusted-ca\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.636993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.636906    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.637166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:16.637166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637071    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-serving-cert\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.637166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637089    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-ca-trust-extracted\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.637166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637139    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wskw5\" (UniqueName: \"kubernetes.io/projected/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-kube-api-access-wskw5\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.637352 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637184    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0e29cd3-95aa-4984-b756-521622bc81be-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.637352 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637214    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2cb3617-4b6a-43f2-a7df-076041e3e852-serving-cert\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.637352 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n575\" (UniqueName: \"kubernetes.io/projected/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-kube-api-access-4n575\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.637352 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2cb3617-4b6a-43f2-a7df-076041e3e852-tmp\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637354    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-installation-pull-secrets\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f2cb3617-4b6a-43f2-a7df-076041e3e852-snapshots\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-certificates\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.637494    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 17:33:16.637517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0e29cd3-95aa-4984-b756-521622bc81be-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637529    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-bound-sa-token\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.637556    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls podName:e6643768-efe8-4adc-baeb-ee0dbf5c2d2d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:17.137539092 +0000 UTC m=+50.123361062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-qbgd9" (UID: "e6643768-efe8-4adc-baeb-ee0dbf5c2d2d") : secret "cluster-monitoring-operator-tls" not found
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637579    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwljf\" (UniqueName: \"kubernetes.io/projected/f2cb3617-4b6a-43f2-a7df-076041e3e852-kube-api-access-pwljf\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgrwh\" (UniqueName: \"kubernetes.io/projected/f0e29cd3-95aa-4984-b756-521622bc81be-kube-api-access-pgrwh\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cb3617-4b6a-43f2-a7df-076041e3e852-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637680    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cb3617-4b6a-43f2-a7df-076041e3e852-service-ca-bundle\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.637786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.637714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-image-registry-private-configuration\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.647858 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.647837    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z6fc\" (UniqueName: \"kubernetes.io/projected/bca14924-8315-4246-9226-7e50009d9f64-kube-api-access-4z6fc\") pod \"volume-data-source-validator-7598fd5bd-9558b\" (UID: \"bca14924-8315-4246-9226-7e50009d9f64\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"
May 29 17:33:16.648006 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.647983    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wskw5\" (UniqueName: \"kubernetes.io/projected/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-kube-api-access-wskw5\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:16.679630 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.679607    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"
May 29 17:33:16.738919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.738884    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-installation-pull-secrets\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.738919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.738923    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f2cb3617-4b6a-43f2-a7df-076041e3e852-snapshots\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.739126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.738941    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-certificates\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.739126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739033    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0e29cd3-95aa-4984-b756-521622bc81be-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.739126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739050    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-bound-sa-token\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.739126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739070    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwljf\" (UniqueName: \"kubernetes.io/projected/f2cb3617-4b6a-43f2-a7df-076041e3e852-kube-api-access-pwljf\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.739126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739087    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgrwh\" (UniqueName: \"kubernetes.io/projected/f0e29cd3-95aa-4984-b756-521622bc81be-kube-api-access-pgrwh\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739140    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cb3617-4b6a-43f2-a7df-076041e3e852-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739164    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cb3617-4b6a-43f2-a7df-076041e3e852-service-ca-bundle\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739189    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-image-registry-private-configuration\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739222    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwpbn\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-kube-api-access-pwpbn\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739249    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739274    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nh4tm\" (UniqueName: \"kubernetes.io/projected/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-kube-api-access-nh4tm\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739303    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-config\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739336    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-trusted-ca\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.739385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739389    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739424    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-serving-cert\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739449    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-ca-trust-extracted\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739487    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0e29cd3-95aa-4984-b756-521622bc81be-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739514    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2cb3617-4b6a-43f2-a7df-076041e3e852-serving-cert\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739553    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n575\" (UniqueName: \"kubernetes.io/projected/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-kube-api-access-4n575\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739592    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2cb3617-4b6a-43f2-a7df-076041e3e852-tmp\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.739692    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 17:33:16.739829 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.739798    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls podName:6808d8c8-3dda-4ebf-99d8-beb99706ecd2 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:17.239770971 +0000 UTC m=+50.225592938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d7hcz" (UID: "6808d8c8-3dda-4ebf-99d8-beb99706ecd2") : secret "samples-operator-tls" not found
May 29 17:33:16.740266 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739835    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-certificates\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.740266 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.739969    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2cb3617-4b6a-43f2-a7df-076041e3e852-tmp\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.740266 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740179    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 17:33:16.740266 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740237    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls podName:4f0113ab-ed45-42fa-be67-ab6406ec6525 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.740222322 +0000 UTC m=+65.726044297 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls") pod "dns-default-nv548" (UID: "4f0113ab-ed45-42fa-be67-ab6406ec6525") : secret "dns-default-metrics-tls" not found
May 29 17:33:16.740461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.740271    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:16.740461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.740321    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.740461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.740424    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-config\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.740461 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740430    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 17:33:16.740461 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740459    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65578c69-58dv2: secret "image-registry-tls" not found
May 29 17:33:16.740714 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740498    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls podName:1e603b99-9c11-4fcb-87f8-5c6ca44c2411 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:17.240483212 +0000 UTC m=+50.226305195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls") pod "image-registry-65578c69-58dv2" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411") : secret "image-registry-tls" not found
May 29 17:33:16.740714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.740426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f2cb3617-4b6a-43f2-a7df-076041e3e852-snapshots\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.740714 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740577    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 17:33:16.740714 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:16.740614    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert podName:c09e52f2-310d-4da7-abee-295e3689f5bf nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.740600398 +0000 UTC m=+65.726422379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert") pod "ingress-canary-h9972" (UID: "c09e52f2-310d-4da7-abee-295e3689f5bf") : secret "canary-serving-cert" not found
May 29 17:33:16.740941 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.740924    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cb3617-4b6a-43f2-a7df-076041e3e852-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.741021 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.740999    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0e29cd3-95aa-4984-b756-521622bc81be-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.741682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.741343    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-ca-trust-extracted\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.741682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.741627    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2cb3617-4b6a-43f2-a7df-076041e3e852-service-ca-bundle\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.741682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.741667    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-trusted-ca\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.741946 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.741798    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0e29cd3-95aa-4984-b756-521622bc81be-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.741946 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.741927    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-installation-pull-secrets\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.742685 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.742662    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-serving-cert\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.742942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.742921    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f2cb3617-4b6a-43f2-a7df-076041e3e852-serving-cert\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.743225 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.743209    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-image-registry-private-configuration\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.749406 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.749237    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-bound-sa-token\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.749406 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.749340    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh4tm\" (UniqueName: \"kubernetes.io/projected/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-kube-api-access-nh4tm\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:16.749596 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.749571    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgrwh\" (UniqueName: \"kubernetes.io/projected/f0e29cd3-95aa-4984-b756-521622bc81be-kube-api-access-pgrwh\") pod \"kube-storage-version-migrator-operator-96ddc787c-lldmh\" (UID: \"f0e29cd3-95aa-4984-b756-521622bc81be\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.749742 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.749707    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwljf\" (UniqueName: \"kubernetes.io/projected/f2cb3617-4b6a-43f2-a7df-076041e3e852-kube-api-access-pwljf\") pod \"insights-operator-788bf58df5-2rnqk\" (UID: \"f2cb3617-4b6a-43f2-a7df-076041e3e852\") " pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.751114 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.751095    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwpbn\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-kube-api-access-pwpbn\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:16.751506 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.751490    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n575\" (UniqueName: \"kubernetes.io/projected/c7ebb11b-8ee7-4313-9ae1-01629b5129cf-kube-api-access-4n575\") pod \"service-ca-operator-69877444c-mjxdl\" (UID: \"c7ebb11b-8ee7-4313-9ae1-01629b5129cf\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.775302 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.775275    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-2rnqk"
May 29 17:33:16.790090 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.790039    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"
May 29 17:33:16.824559 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.824519    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"
May 29 17:33:16.835059 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.835002    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b"]
May 29 17:33:16.841611 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:16.841584    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbca14924_8315_4246_9226_7e50009d9f64.slice/crio-41625523af81d0f305ad27b25fa54710b92c72dfacd54759974ce4bc189c7bae WatchSource:0}: Error finding container 41625523af81d0f305ad27b25fa54710b92c72dfacd54759974ce4bc189c7bae: Status 404 returned error can't find the container with id 41625523af81d0f305ad27b25fa54710b92c72dfacd54759974ce4bc189c7bae
May 29 17:33:16.919223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.918626    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2rnqk"]
May 29 17:33:16.928485 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:16.928439    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2cb3617_4b6a_43f2_a7df_076041e3e852.slice/crio-81f5518badd060899798869b53f1c9ceb56bbcf36b43c1d1a043154e55994330 WatchSource:0}: Error finding container 81f5518badd060899798869b53f1c9ceb56bbcf36b43c1d1a043154e55994330: Status 404 returned error can't find the container with id 81f5518badd060899798869b53f1c9ceb56bbcf36b43c1d1a043154e55994330
May 29 17:33:16.950018 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.949988    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh"]
May 29 17:33:16.954237 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:16.954211    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e29cd3_95aa_4984_b756_521622bc81be.slice/crio-035d5758371822334dec1c4cf0c6189e4b50726ec39f489a027952dafecac424 WatchSource:0}: Error finding container 035d5758371822334dec1c4cf0c6189e4b50726ec39f489a027952dafecac424: Status 404 returned error can't find the container with id 035d5758371822334dec1c4cf0c6189e4b50726ec39f489a027952dafecac424
May 29 17:33:16.988891 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:16.988869    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl"]
May 29 17:33:16.991244 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:16.991221    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ebb11b_8ee7_4313_9ae1_01629b5129cf.slice/crio-3a9079ea428c59e73ff73f154a6a0d7c8efc77a4cb40bd23eebffc20ae174af5 WatchSource:0}: Error finding container 3a9079ea428c59e73ff73f154a6a0d7c8efc77a4cb40bd23eebffc20ae174af5: Status 404 returned error can't find the container with id 3a9079ea428c59e73ff73f154a6a0d7c8efc77a4cb40bd23eebffc20ae174af5
May 29 17:33:17.143851 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.143821    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:17.144011 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.143980    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 17:33:17.144066 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.144055    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls podName:e6643768-efe8-4adc-baeb-ee0dbf5c2d2d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:18.144040159 +0000 UTC m=+51.129862127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-qbgd9" (UID: "e6643768-efe8-4adc-baeb-ee0dbf5c2d2d") : secret "cluster-monitoring-operator-tls" not found
May 29 17:33:17.245223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.245189    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:17.245365 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.245280    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:17.245365 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.245344    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 17:33:17.245365 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.245362    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65578c69-58dv2: secret "image-registry-tls" not found
May 29 17:33:17.245462 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.245408    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 17:33:17.245462 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.245414    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls podName:1e603b99-9c11-4fcb-87f8-5c6ca44c2411 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:18.245398677 +0000 UTC m=+51.231220644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls") pod "image-registry-65578c69-58dv2" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411") : secret "image-registry-tls" not found
May 29 17:33:17.245462 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:17.245449    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls podName:6808d8c8-3dda-4ebf-99d8-beb99706ecd2 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:18.245436245 +0000 UTC m=+51.231258212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d7hcz" (UID: "6808d8c8-3dda-4ebf-99d8-beb99706ecd2") : secret "samples-operator-tls" not found
May 29 17:33:17.716243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.716201    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh" event={"ID":"f0e29cd3-95aa-4984-b756-521622bc81be","Type":"ContainerStarted","Data":"035d5758371822334dec1c4cf0c6189e4b50726ec39f489a027952dafecac424"}
May 29 17:33:17.717383 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.717348    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b" event={"ID":"bca14924-8315-4246-9226-7e50009d9f64","Type":"ContainerStarted","Data":"41625523af81d0f305ad27b25fa54710b92c72dfacd54759974ce4bc189c7bae"}
May 29 17:33:17.718717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.718674    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl" event={"ID":"c7ebb11b-8ee7-4313-9ae1-01629b5129cf","Type":"ContainerStarted","Data":"3a9079ea428c59e73ff73f154a6a0d7c8efc77a4cb40bd23eebffc20ae174af5"}
May 29 17:33:17.719907 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:17.719879    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2rnqk" event={"ID":"f2cb3617-4b6a-43f2-a7df-076041e3e852","Type":"ContainerStarted","Data":"81f5518badd060899798869b53f1c9ceb56bbcf36b43c1d1a043154e55994330"}
May 29 17:33:18.153522 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:18.153435    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:18.153686 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.153628    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 17:33:18.153773 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.153710    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls podName:e6643768-efe8-4adc-baeb-ee0dbf5c2d2d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:20.153689707 +0000 UTC m=+53.139511674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-qbgd9" (UID: "e6643768-efe8-4adc-baeb-ee0dbf5c2d2d") : secret "cluster-monitoring-operator-tls" not found
May 29 17:33:18.254333 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:18.254300    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:18.254516 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:18.254398    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:18.254603 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.254521    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 17:33:18.254603 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.254575    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls podName:6808d8c8-3dda-4ebf-99d8-beb99706ecd2 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:20.254560935 +0000 UTC m=+53.240382903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d7hcz" (UID: "6808d8c8-3dda-4ebf-99d8-beb99706ecd2") : secret "samples-operator-tls" not found
May 29 17:33:18.254879 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.254849    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 17:33:18.254879 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.254875    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65578c69-58dv2: secret "image-registry-tls" not found
May 29 17:33:18.255027 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:18.254937    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls podName:1e603b99-9c11-4fcb-87f8-5c6ca44c2411 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:20.254920147 +0000 UTC m=+53.240742126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls") pod "image-registry-65578c69-58dv2" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411") : secret "image-registry-tls" not found
May 29 17:33:20.172808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.172722    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:20.173278 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.172890    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 17:33:20.173278 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.172971    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls podName:e6643768-efe8-4adc-baeb-ee0dbf5c2d2d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:24.172949922 +0000 UTC m=+57.158771898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-qbgd9" (UID: "e6643768-efe8-4adc-baeb-ee0dbf5c2d2d") : secret "cluster-monitoring-operator-tls" not found
May 29 17:33:20.273791 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.273743    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:20.273923 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.273815    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:20.273923 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.273897    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 17:33:20.273923 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.273906    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65578c69-58dv2: secret "image-registry-tls" not found
May 29 17:33:20.273923 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.273906    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 17:33:20.274050 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.273950    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls podName:1e603b99-9c11-4fcb-87f8-5c6ca44c2411 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:24.273935705 +0000 UTC m=+57.259757673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls") pod "image-registry-65578c69-58dv2" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411") : secret "image-registry-tls" not found
May 29 17:33:20.274050 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:20.273963    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls podName:6808d8c8-3dda-4ebf-99d8-beb99706ecd2 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:24.273956217 +0000 UTC m=+57.259778184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d7hcz" (UID: "6808d8c8-3dda-4ebf-99d8-beb99706ecd2") : secret "samples-operator-tls" not found
May 29 17:33:20.730826 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.730777    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl" event={"ID":"c7ebb11b-8ee7-4313-9ae1-01629b5129cf","Type":"ContainerStarted","Data":"677e7a43743a11585a17a95d8431061455d8a1273eebdd048fe784212bb300e3"}
May 29 17:33:20.733491 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.733435    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2rnqk" event={"ID":"f2cb3617-4b6a-43f2-a7df-076041e3e852","Type":"ContainerStarted","Data":"f20f551eb7553eb3536633c0d977f333917be93e38b0eddb8c5eb4ec047d3b75"}
May 29 17:33:20.748269 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.747284    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl" podStartSLOduration=1.8853531399999999 podStartE2EDuration="4.747265108s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:16.992901777 +0000 UTC m=+49.978723748" lastFinishedPulling="2026-05-29 17:33:19.854813746 +0000 UTC m=+52.840635716" observedRunningTime="2026-05-29 17:33:20.746340408 +0000 UTC m=+53.732162398" watchObservedRunningTime="2026-05-29 17:33:20.747265108 +0000 UTC m=+53.733087099"
May 29 17:33:20.765797 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:20.765732    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-2rnqk" podStartSLOduration=1.847956565 podStartE2EDuration="4.765714229s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:16.93168804 +0000 UTC m=+49.917510009" lastFinishedPulling="2026-05-29 17:33:19.849445701 +0000 UTC m=+52.835267673" observedRunningTime="2026-05-29 17:33:20.76482822 +0000 UTC m=+53.750650211" watchObservedRunningTime="2026-05-29 17:33:20.765714229 +0000 UTC m=+53.751536219"
May 29 17:33:22.738120 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:22.738080    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b" event={"ID":"bca14924-8315-4246-9226-7e50009d9f64","Type":"ContainerStarted","Data":"85ed00b72e20bb180b3aa4b46091cb3182f810d0c124b528b63ee44e72af572c"}
May 29 17:33:22.754024 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:22.753978    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-9558b" podStartSLOduration=1.502965484 podStartE2EDuration="6.753965794s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:16.843903589 +0000 UTC m=+49.829725556" lastFinishedPulling="2026-05-29 17:33:22.094903892 +0000 UTC m=+55.080725866" observedRunningTime="2026-05-29 17:33:22.752696415 +0000 UTC m=+55.738518405" watchObservedRunningTime="2026-05-29 17:33:22.753965794 +0000 UTC m=+55.739787783"
May 29 17:33:22.843309 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:22.843279    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nq698_ee4c0957-aa37-4727-b9b1-de41023a6e13/dns-node-resolver/0.log"
May 29 17:33:23.639886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:23.639860    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8224g_c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8/node-ca/0.log"
May 29 17:33:24.205512 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.205481    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:24.205904 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.205592    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 17:33:24.205904 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.205649    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls podName:e6643768-efe8-4adc-baeb-ee0dbf5c2d2d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.20563357 +0000 UTC m=+65.191455537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-qbgd9" (UID: "e6643768-efe8-4adc-baeb-ee0dbf5c2d2d") : secret "cluster-monitoring-operator-tls" not found
May 29 17:33:24.306500 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.306464    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:24.306664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.306526    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:24.306664 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.306617    2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 29 17:33:24.306664 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.306644    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 17:33:24.306664 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.306654    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65578c69-58dv2: secret "image-registry-tls" not found
May 29 17:33:24.306853 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.306684    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls podName:6808d8c8-3dda-4ebf-99d8-beb99706ecd2 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.306665963 +0000 UTC m=+65.292487930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d7hcz" (UID: "6808d8c8-3dda-4ebf-99d8-beb99706ecd2") : secret "samples-operator-tls" not found
May 29 17:33:24.306853 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:24.306698    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls podName:1e603b99-9c11-4fcb-87f8-5c6ca44c2411 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:32.306692391 +0000 UTC m=+65.292514358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls") pod "image-registry-65578c69-58dv2" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411") : secret "image-registry-tls" not found
May 29 17:33:24.506674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.506592    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-cfnld"]
May 29 17:33:24.522204 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.522175    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-cfnld"]
May 29 17:33:24.522360 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.522219    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.524563 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.524535    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 29 17:33:24.525584 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.525562    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 29 17:33:24.525700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.525591    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5qqm8\""
May 29 17:33:24.525700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.525623    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 29 17:33:24.525974 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.525960    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 29 17:33:24.609050 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.609009    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94272f70-fd9e-4cfa-ab3d-5813ec155619-signing-cabundle\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.609231 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.609128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbrgv\" (UniqueName: \"kubernetes.io/projected/94272f70-fd9e-4cfa-ab3d-5813ec155619-kube-api-access-mbrgv\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.609231 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.609191    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94272f70-fd9e-4cfa-ab3d-5813ec155619-signing-key\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.709869 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.709829    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94272f70-fd9e-4cfa-ab3d-5813ec155619-signing-cabundle\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.710046 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.709903    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbrgv\" (UniqueName: \"kubernetes.io/projected/94272f70-fd9e-4cfa-ab3d-5813ec155619-kube-api-access-mbrgv\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.710046 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.709946    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94272f70-fd9e-4cfa-ab3d-5813ec155619-signing-key\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.710612 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.710586    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/94272f70-fd9e-4cfa-ab3d-5813ec155619-signing-cabundle\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.712627 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.712593    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/94272f70-fd9e-4cfa-ab3d-5813ec155619-signing-key\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.718743 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.718718    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbrgv\" (UniqueName: \"kubernetes.io/projected/94272f70-fd9e-4cfa-ab3d-5813ec155619-kube-api-access-mbrgv\") pod \"service-ca-685df94d57-cfnld\" (UID: \"94272f70-fd9e-4cfa-ab3d-5813ec155619\") " pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:24.832165 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:24.832089    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-cfnld"
May 29 17:33:25.169091 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:25.169060    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-cfnld"]
May 29 17:33:25.171869 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:25.171839    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94272f70_fd9e_4cfa_ab3d_5813ec155619.slice/crio-5896b7c82e88715249c4ee62b4c1fae364867802002f9e69804699218cd0fd08 WatchSource:0}: Error finding container 5896b7c82e88715249c4ee62b4c1fae364867802002f9e69804699218cd0fd08: Status 404 returned error can't find the container with id 5896b7c82e88715249c4ee62b4c1fae364867802002f9e69804699218cd0fd08
May 29 17:33:25.746220 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:25.746126    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-cfnld" event={"ID":"94272f70-fd9e-4cfa-ab3d-5813ec155619","Type":"ContainerStarted","Data":"59d7e1a69e3c473d8f2b2dd56890e91b38fc806f7de90fe9347645b69c09dd65"}
May 29 17:33:25.746220 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:25.746163    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-cfnld" event={"ID":"94272f70-fd9e-4cfa-ab3d-5813ec155619","Type":"ContainerStarted","Data":"5896b7c82e88715249c4ee62b4c1fae364867802002f9e69804699218cd0fd08"}
May 29 17:33:25.747557 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:25.747529    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh" event={"ID":"f0e29cd3-95aa-4984-b756-521622bc81be","Type":"ContainerStarted","Data":"c9e045dc73d1fa77c3a0a03213eca0b70e22f92b6aa7140febb10d382a7abf0b"}
May 29 17:33:25.767840 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:25.766935    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-cfnld" podStartSLOduration=1.76691705 podStartE2EDuration="1.76691705s" podCreationTimestamp="2026-05-29 17:33:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:33:25.765324656 +0000 UTC m=+58.751146646" watchObservedRunningTime="2026-05-29 17:33:25.76691705 +0000 UTC m=+58.752739040"
May 29 17:33:25.785642 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:25.785584    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh" podStartSLOduration=1.28734277 podStartE2EDuration="9.785568683s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:16.955933847 +0000 UTC m=+49.941755814" lastFinishedPulling="2026-05-29 17:33:25.454159748 +0000 UTC m=+58.439981727" observedRunningTime="2026-05-29 17:33:25.785418421 +0000 UTC m=+58.771240410" watchObservedRunningTime="2026-05-29 17:33:25.785568683 +0000 UTC m=+58.771390673"
May 29 17:33:27.683908 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:27.683884    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xc8s7"
May 29 17:33:32.270617 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.270579    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:32.271080 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:32.270698    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 17:33:32.271080 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:32.270778    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls podName:e6643768-efe8-4adc-baeb-ee0dbf5c2d2d nodeName:}" failed. No retries permitted until 2026-05-29 17:33:48.270745407 +0000 UTC m=+81.256567374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-qbgd9" (UID: "e6643768-efe8-4adc-baeb-ee0dbf5c2d2d") : secret "cluster-monitoring-operator-tls" not found
May 29 17:33:32.371419 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.371378    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:32.371584 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.371502    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:32.373870 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.373837    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"image-registry-65578c69-58dv2\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") " pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:32.373970 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.373841    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6808d8c8-3dda-4ebf-99d8-beb99706ecd2-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d7hcz\" (UID: \"6808d8c8-3dda-4ebf-99d8-beb99706ecd2\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:32.406943 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.406916    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-j8h8n\""
May 29 17:33:32.414912 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.414892    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"
May 29 17:33:32.453642 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.453614    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-55j58\""
May 29 17:33:32.462212 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.461840    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:32.541619 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.541571    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz"]
May 29 17:33:32.591940 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.590320    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65578c69-58dv2"]
May 29 17:33:32.592686 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:32.592647    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e603b99_9c11_4fcb_87f8_5c6ca44c2411.slice/crio-59e91c3fb23e3d8194fa16d51d6940894e6f18c1dd8f96d1332fc74638debe97 WatchSource:0}: Error finding container 59e91c3fb23e3d8194fa16d51d6940894e6f18c1dd8f96d1332fc74638debe97: Status 404 returned error can't find the container with id 59e91c3fb23e3d8194fa16d51d6940894e6f18c1dd8f96d1332fc74638debe97
May 29 17:33:32.767036 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.766998    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65578c69-58dv2" event={"ID":"1e603b99-9c11-4fcb-87f8-5c6ca44c2411","Type":"ContainerStarted","Data":"90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19"}
May 29 17:33:32.767036 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.767038    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65578c69-58dv2" event={"ID":"1e603b99-9c11-4fcb-87f8-5c6ca44c2411","Type":"ContainerStarted","Data":"59e91c3fb23e3d8194fa16d51d6940894e6f18c1dd8f96d1332fc74638debe97"}
May 29 17:33:32.767273 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.767110    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:32.768094 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.768066    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz" event={"ID":"6808d8c8-3dda-4ebf-99d8-beb99706ecd2","Type":"ContainerStarted","Data":"3bb456cc249cb2b9591a1e799463fff1f444ddb6c047d12b1c7d85aae3c0904b"}
May 29 17:33:32.774624 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.774599    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:32.774730 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.774659    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:32.776850 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.776829    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f0113ab-ed45-42fa-be67-ab6406ec6525-metrics-tls\") pod \"dns-default-nv548\" (UID: \"4f0113ab-ed45-42fa-be67-ab6406ec6525\") " pod="openshift-dns/dns-default-nv548"
May 29 17:33:32.776950 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.776887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c09e52f2-310d-4da7-abee-295e3689f5bf-cert\") pod \"ingress-canary-h9972\" (UID: \"c09e52f2-310d-4da7-abee-295e3689f5bf\") " pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:32.785623 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:32.785552    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65578c69-58dv2" podStartSLOduration=16.78553965 podStartE2EDuration="16.78553965s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:33:32.784235848 +0000 UTC m=+65.770057838" watchObservedRunningTime="2026-05-29 17:33:32.78553965 +0000 UTC m=+65.771361663"
May 29 17:33:33.038586 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.038555    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7x9xz\""
May 29 17:33:33.046480 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.046455    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nv548"
May 29 17:33:33.049621 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.049598    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sf6m9\""
May 29 17:33:33.058842 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.058786    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h9972"
May 29 17:33:33.178626 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.178530    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:33:33.181092 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.181070    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 17:33:33.184702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.184257    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nv548"]
May 29 17:33:33.188225 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:33.188191    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f0113ab_ed45_42fa_be67_ab6406ec6525.slice/crio-efabf6b9aa9318582ebe7a536a3b58847e672a939e72009d547c8fa723467770 WatchSource:0}: Error finding container efabf6b9aa9318582ebe7a536a3b58847e672a939e72009d547c8fa723467770: Status 404 returned error can't find the container with id efabf6b9aa9318582ebe7a536a3b58847e672a939e72009d547c8fa723467770
May 29 17:33:33.189134 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:33.189038    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 17:33:33.189134 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:33.189103    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs podName:6ecfb99b-8aa4-472e-a985-06c40f2b3089 nodeName:}" failed. No retries permitted until 2026-05-29 17:34:37.189082428 +0000 UTC m=+130.174904397 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs") pod "network-metrics-daemon-x8rpq" (UID: "6ecfb99b-8aa4-472e-a985-06c40f2b3089") : secret "metrics-daemon-secret" not found
May 29 17:33:33.202292 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.202257    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h9972"]
May 29 17:33:33.205163 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:33.205137    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09e52f2_310d_4da7_abee_295e3689f5bf.slice/crio-91d9bf26f20a73c17a2e186ffba6c88cee1ae34291fc2a508e156ab705f584d3 WatchSource:0}: Error finding container 91d9bf26f20a73c17a2e186ffba6c88cee1ae34291fc2a508e156ab705f584d3: Status 404 returned error can't find the container with id 91d9bf26f20a73c17a2e186ffba6c88cee1ae34291fc2a508e156ab705f584d3
May 29 17:33:33.279219 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.279195    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:33:33.281736 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.281710    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 17:33:33.292451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.292384    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 17:33:33.303060 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.303038    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw228\" (UniqueName: \"kubernetes.io/projected/49f341be-bb0c-40ba-8c5d-74c694497c9d-kube-api-access-sw228\") pod \"network-check-target-cqgl2\" (UID: \"49f341be-bb0c-40ba-8c5d-74c694497c9d\") " pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:33:33.324295 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.324267    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6stw\""
May 29 17:33:33.332235 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.332209    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:33:33.471433 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.471405    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cqgl2"]
May 29 17:33:33.474777 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:33.474732    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f341be_bb0c_40ba_8c5d_74c694497c9d.slice/crio-5584c6710e2d5fb60487d9e7a308be3c7808c5154a5c6c3a9975e64455d4dbe8 WatchSource:0}: Error finding container 5584c6710e2d5fb60487d9e7a308be3c7808c5154a5c6c3a9975e64455d4dbe8: Status 404 returned error can't find the container with id 5584c6710e2d5fb60487d9e7a308be3c7808c5154a5c6c3a9975e64455d4dbe8
May 29 17:33:33.772991 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.772947    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cqgl2" event={"ID":"49f341be-bb0c-40ba-8c5d-74c694497c9d","Type":"ContainerStarted","Data":"5584c6710e2d5fb60487d9e7a308be3c7808c5154a5c6c3a9975e64455d4dbe8"}
May 29 17:33:33.774100 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.774070    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nv548" event={"ID":"4f0113ab-ed45-42fa-be67-ab6406ec6525","Type":"ContainerStarted","Data":"efabf6b9aa9318582ebe7a536a3b58847e672a939e72009d547c8fa723467770"}
May 29 17:33:33.775066 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:33.775040    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h9972" event={"ID":"c09e52f2-310d-4da7-abee-295e3689f5bf","Type":"ContainerStarted","Data":"91d9bf26f20a73c17a2e186ffba6c88cee1ae34291fc2a508e156ab705f584d3"}
May 29 17:33:34.781382 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:34.781322    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz" event={"ID":"6808d8c8-3dda-4ebf-99d8-beb99706ecd2","Type":"ContainerStarted","Data":"4874ed9132052dee33e0c8b9550d224c9e8dd9e7216d809f7ecf3de05ad2a03c"}
May 29 17:33:37.791697 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.791655    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz" event={"ID":"6808d8c8-3dda-4ebf-99d8-beb99706ecd2","Type":"ContainerStarted","Data":"18446d0c6e1a4568aaf0b70ae776f6e3396351b771217703a2b3de231d125e99"}
May 29 17:33:37.793008 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.792984    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h9972" event={"ID":"c09e52f2-310d-4da7-abee-295e3689f5bf","Type":"ContainerStarted","Data":"ae5daa6d5aeee43dd72aaae12969650669585d1135c2c8161145fa78b6d6d74c"}
May 29 17:33:37.794159 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.794137    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cqgl2" event={"ID":"49f341be-bb0c-40ba-8c5d-74c694497c9d","Type":"ContainerStarted","Data":"a96354087df316b5f28462a3a4c47b19b6ae9c6613d3b041decb6190a4fc70d8"}
May 29 17:33:37.794286 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.794269    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:33:37.795666 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.795648    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nv548" event={"ID":"4f0113ab-ed45-42fa-be67-ab6406ec6525","Type":"ContainerStarted","Data":"e7ee38d079113a054187adc3b658bbdf365eaa2aad44f78fa85a5df5ecafdea6"}
May 29 17:33:37.795740 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.795692    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nv548" event={"ID":"4f0113ab-ed45-42fa-be67-ab6406ec6525","Type":"ContainerStarted","Data":"22976ba4447ba656fb0acc0317a62fc0675baad77eda34a9c278ec73e090db58"}
May 29 17:33:37.795811 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.795782    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nv548"
May 29 17:33:37.809146 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.809110    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d7hcz" podStartSLOduration=19.779632157 podStartE2EDuration="21.809098766s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:32.600921243 +0000 UTC m=+65.586743210" lastFinishedPulling="2026-05-29 17:33:34.630387849 +0000 UTC m=+67.616209819" observedRunningTime="2026-05-29 17:33:37.808234309 +0000 UTC m=+70.794056309" watchObservedRunningTime="2026-05-29 17:33:37.809098766 +0000 UTC m=+70.794920754"
May 29 17:33:37.822336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.822295    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cqgl2" podStartSLOduration=67.513925792 podStartE2EDuration="1m10.822284405s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:33:33.477157166 +0000 UTC m=+66.462979138" lastFinishedPulling="2026-05-29 17:33:36.785515781 +0000 UTC m=+69.771337751" observedRunningTime="2026-05-29 17:33:37.821597048 +0000 UTC m=+70.807419038" watchObservedRunningTime="2026-05-29 17:33:37.822284405 +0000 UTC m=+70.808106372"
May 29 17:33:37.837670 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.837630    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-nv548" podStartSLOduration=34.254124368 podStartE2EDuration="37.83761854s" podCreationTimestamp="2026-05-29 17:33:00 +0000 UTC" firstStartedPulling="2026-05-29 17:33:33.19060871 +0000 UTC m=+66.176430683" lastFinishedPulling="2026-05-29 17:33:36.774102872 +0000 UTC m=+69.759924855" observedRunningTime="2026-05-29 17:33:37.836861823 +0000 UTC m=+70.822683814" watchObservedRunningTime="2026-05-29 17:33:37.83761854 +0000 UTC m=+70.823440528"
May 29 17:33:37.863096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:37.863059    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h9972" podStartSLOduration=34.292796276 podStartE2EDuration="37.86304461s" podCreationTimestamp="2026-05-29 17:33:00 +0000 UTC" firstStartedPulling="2026-05-29 17:33:33.207334429 +0000 UTC m=+66.193156395" lastFinishedPulling="2026-05-29 17:33:36.777582748 +0000 UTC m=+69.763404729" observedRunningTime="2026-05-29 17:33:37.862188119 +0000 UTC m=+70.848010107" watchObservedRunningTime="2026-05-29 17:33:37.86304461 +0000 UTC m=+70.848866602"
May 29 17:33:46.550172 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.550057    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fqsgj"]
May 29 17:33:46.554964 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.554945    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.558535 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.558514    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 17:33:46.558642 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.558513    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 17:33:46.558642 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.558513    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f8qql\""
May 29 17:33:46.569907 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.569885    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqsgj"]
May 29 17:33:46.588403 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.588379    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65578c69-58dv2"]
May 29 17:33:46.630417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.630386    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"]
May 29 17:33:46.633412 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.633397    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.637019 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.636997    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d269p\""
May 29 17:33:46.638553 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.638532    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 29 17:33:46.639089 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.639070    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 29 17:33:46.644260 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.644241    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"]
May 29 17:33:46.647246 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.647232    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"
May 29 17:33:46.653137 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.653117    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 29 17:33:46.653218 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.653127    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 29 17:33:46.656665 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.656644    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"]
May 29 17:33:46.658660 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.658640    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tr6n4\""
May 29 17:33:46.676366 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.676344    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"]
May 29 17:33:46.685962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.685941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/769590da-bfc7-4a2b-bbd7-6172a5417c10-data-volume\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.686073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.685969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5x4\" (UniqueName: \"kubernetes.io/projected/769590da-bfc7-4a2b-bbd7-6172a5417c10-kube-api-access-pt5x4\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.686073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.685999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/769590da-bfc7-4a2b-bbd7-6172a5417c10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.686073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.686046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/769590da-bfc7-4a2b-bbd7-6172a5417c10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.686188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.686087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/769590da-bfc7-4a2b-bbd7-6172a5417c10-crio-socket\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.787497 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787466    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/769590da-bfc7-4a2b-bbd7-6172a5417c10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.787681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787509    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/769590da-bfc7-4a2b-bbd7-6172a5417c10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.787743 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787705    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94b7d036-5411-4c5b-a003-f446dd2a2ced-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sjfdn\" (UID: \"94b7d036-5411-4c5b-a003-f446dd2a2ced\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.787829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5hcd\" (UniqueName: \"kubernetes.io/projected/ceb8c94a-f325-40b8-a1ad-74315284ed55-kube-api-access-l5hcd\") pod \"migrator-96c6f749-59lw4\" (UID: \"ceb8c94a-f325-40b8-a1ad-74315284ed55\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"
May 29 17:33:46.787883 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787841    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/769590da-bfc7-4a2b-bbd7-6172a5417c10-crio-socket\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.787940 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94b7d036-5411-4c5b-a003-f446dd2a2ced-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sjfdn\" (UID: \"94b7d036-5411-4c5b-a003-f446dd2a2ced\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.787940 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787892    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/769590da-bfc7-4a2b-bbd7-6172a5417c10-crio-socket\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.788037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787952    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/769590da-bfc7-4a2b-bbd7-6172a5417c10-data-volume\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.788037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.787970    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5x4\" (UniqueName: \"kubernetes.io/projected/769590da-bfc7-4a2b-bbd7-6172a5417c10-kube-api-access-pt5x4\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.788169 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.788150    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/769590da-bfc7-4a2b-bbd7-6172a5417c10-data-volume\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.788228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.788200    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/769590da-bfc7-4a2b-bbd7-6172a5417c10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.789920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.789899    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/769590da-bfc7-4a2b-bbd7-6172a5417c10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.799490 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.799464    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5x4\" (UniqueName: \"kubernetes.io/projected/769590da-bfc7-4a2b-bbd7-6172a5417c10-kube-api-access-pt5x4\") pod \"insights-runtime-extractor-fqsgj\" (UID: \"769590da-bfc7-4a2b-bbd7-6172a5417c10\") " pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.864002 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.863915    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fqsgj"
May 29 17:33:46.888812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.888776    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94b7d036-5411-4c5b-a003-f446dd2a2ced-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sjfdn\" (UID: \"94b7d036-5411-4c5b-a003-f446dd2a2ced\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.888988 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.888821    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hcd\" (UniqueName: \"kubernetes.io/projected/ceb8c94a-f325-40b8-a1ad-74315284ed55-kube-api-access-l5hcd\") pod \"migrator-96c6f749-59lw4\" (UID: \"ceb8c94a-f325-40b8-a1ad-74315284ed55\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"
May 29 17:33:46.888988 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.888854    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94b7d036-5411-4c5b-a003-f446dd2a2ced-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sjfdn\" (UID: \"94b7d036-5411-4c5b-a003-f446dd2a2ced\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.889538 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.889513    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/94b7d036-5411-4c5b-a003-f446dd2a2ced-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-sjfdn\" (UID: \"94b7d036-5411-4c5b-a003-f446dd2a2ced\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.891075 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.891052    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/94b7d036-5411-4c5b-a003-f446dd2a2ced-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-sjfdn\" (UID: \"94b7d036-5411-4c5b-a003-f446dd2a2ced\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.895215 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:46.895193    2558 projected.go:289] Couldn't get configMap openshift-kube-storage-version-migrator/openshift-service-ca.crt: configmap "openshift-service-ca.crt" not found
May 29 17:33:46.895215 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:46.895217    2558 projected.go:194] Error preparing data for projected volume kube-api-access-l5hcd for pod openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4: configmap "openshift-service-ca.crt" not found
May 29 17:33:46.895386 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:33:46.895280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ceb8c94a-f325-40b8-a1ad-74315284ed55-kube-api-access-l5hcd podName:ceb8c94a-f325-40b8-a1ad-74315284ed55 nodeName:}" failed. No retries permitted until 2026-05-29 17:33:47.395259633 +0000 UTC m=+80.381081614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l5hcd" (UniqueName: "kubernetes.io/projected/ceb8c94a-f325-40b8-a1ad-74315284ed55-kube-api-access-l5hcd") pod "migrator-96c6f749-59lw4" (UID: "ceb8c94a-f325-40b8-a1ad-74315284ed55") : configmap "openshift-service-ca.crt" not found
May 29 17:33:46.941971 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.941943    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"
May 29 17:33:46.998305 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:46.998261    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fqsgj"]
May 29 17:33:47.002803 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:47.002776    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769590da_bfc7_4a2b_bbd7_6172a5417c10.slice/crio-6bbfea66cdb153d4023eb72155878ad3db7b6a005df680feeaa3a1dd235cb785 WatchSource:0}: Error finding container 6bbfea66cdb153d4023eb72155878ad3db7b6a005df680feeaa3a1dd235cb785: Status 404 returned error can't find the container with id 6bbfea66cdb153d4023eb72155878ad3db7b6a005df680feeaa3a1dd235cb785
May 29 17:33:47.068603 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.068575    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn"]
May 29 17:33:47.072287 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:47.072260    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b7d036_5411_4c5b_a003_f446dd2a2ced.slice/crio-4cee1dd31d0be3037d20df5a2a65831da6ec03e1e53dd8d253d8c0dc8ac8ce46 WatchSource:0}: Error finding container 4cee1dd31d0be3037d20df5a2a65831da6ec03e1e53dd8d253d8c0dc8ac8ce46: Status 404 returned error can't find the container with id 4cee1dd31d0be3037d20df5a2a65831da6ec03e1e53dd8d253d8c0dc8ac8ce46
May 29 17:33:47.492994 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.492951    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5hcd\" (UniqueName: \"kubernetes.io/projected/ceb8c94a-f325-40b8-a1ad-74315284ed55-kube-api-access-l5hcd\") pod \"migrator-96c6f749-59lw4\" (UID: \"ceb8c94a-f325-40b8-a1ad-74315284ed55\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"
May 29 17:33:47.495324 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.495296    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5hcd\" (UniqueName: \"kubernetes.io/projected/ceb8c94a-f325-40b8-a1ad-74315284ed55-kube-api-access-l5hcd\") pod \"migrator-96c6f749-59lw4\" (UID: \"ceb8c94a-f325-40b8-a1ad-74315284ed55\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"
May 29 17:33:47.555788 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.555741    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"
May 29 17:33:47.704008 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.703953    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4"]
May 29 17:33:47.769947 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:47.769869    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceb8c94a_f325_40b8_a1ad_74315284ed55.slice/crio-4893bcacc5117f31721a2b81f272605f3c5b452dd7788aa6b0cb961b2b3300b8 WatchSource:0}: Error finding container 4893bcacc5117f31721a2b81f272605f3c5b452dd7788aa6b0cb961b2b3300b8: Status 404 returned error can't find the container with id 4893bcacc5117f31721a2b81f272605f3c5b452dd7788aa6b0cb961b2b3300b8
May 29 17:33:47.800963 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.800941    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nv548"
May 29 17:33:47.822424 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.822375    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn" event={"ID":"94b7d036-5411-4c5b-a003-f446dd2a2ced","Type":"ContainerStarted","Data":"4cee1dd31d0be3037d20df5a2a65831da6ec03e1e53dd8d253d8c0dc8ac8ce46"}
May 29 17:33:47.823951 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.823925    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqsgj" event={"ID":"769590da-bfc7-4a2b-bbd7-6172a5417c10","Type":"ContainerStarted","Data":"40c709ec8846f0fdf61f03db7bd35e7f332adc80de40d2358506d1ffc4c047b0"}
May 29 17:33:47.824044 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.823961    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqsgj" event={"ID":"769590da-bfc7-4a2b-bbd7-6172a5417c10","Type":"ContainerStarted","Data":"6bbfea66cdb153d4023eb72155878ad3db7b6a005df680feeaa3a1dd235cb785"}
May 29 17:33:47.825026 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:47.825006    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4" event={"ID":"ceb8c94a-f325-40b8-a1ad-74315284ed55","Type":"ContainerStarted","Data":"4893bcacc5117f31721a2b81f272605f3c5b452dd7788aa6b0cb961b2b3300b8"}
May 29 17:33:48.299685 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.299648    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:48.302140 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.302112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e6643768-efe8-4adc-baeb-ee0dbf5c2d2d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-qbgd9\" (UID: \"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:48.498507 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.498470    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8t5tf\""
May 29 17:33:48.506399 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.506373    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"
May 29 17:33:48.671171 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.671138    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9"]
May 29 17:33:48.676090 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:48.676054    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6643768_efe8_4adc_baeb_ee0dbf5c2d2d.slice/crio-46c525ea4b5b347cf4150a83c20d6c384b5011ad9c9acc4f35affc4c33127c1d WatchSource:0}: Error finding container 46c525ea4b5b347cf4150a83c20d6c384b5011ad9c9acc4f35affc4c33127c1d: Status 404 returned error can't find the container with id 46c525ea4b5b347cf4150a83c20d6c384b5011ad9c9acc4f35affc4c33127c1d
May 29 17:33:48.830205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.830128    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn" event={"ID":"94b7d036-5411-4c5b-a003-f446dd2a2ced","Type":"ContainerStarted","Data":"e7b0990b8ea1353dcbedd527054ba5755c701bb2b5e394f328a924db1f2c196e"}
May 29 17:33:48.831987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.831948    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqsgj" event={"ID":"769590da-bfc7-4a2b-bbd7-6172a5417c10","Type":"ContainerStarted","Data":"8f371b688f3304c1e8a2f04ec547b32767e238d0b1e18818fc541ecbafe81f1c"}
May 29 17:33:48.833101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.833060    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9" event={"ID":"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d","Type":"ContainerStarted","Data":"46c525ea4b5b347cf4150a83c20d6c384b5011ad9c9acc4f35affc4c33127c1d"}
May 29 17:33:48.845386 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:48.845330    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-sjfdn" podStartSLOduration=1.559363615 podStartE2EDuration="2.845314484s" podCreationTimestamp="2026-05-29 17:33:46 +0000 UTC" firstStartedPulling="2026-05-29 17:33:47.074070349 +0000 UTC m=+80.059892316" lastFinishedPulling="2026-05-29 17:33:48.360021215 +0000 UTC m=+81.345843185" observedRunningTime="2026-05-29 17:33:48.845151962 +0000 UTC m=+81.830973951" watchObservedRunningTime="2026-05-29 17:33:48.845314484 +0000 UTC m=+81.831136472"
May 29 17:33:50.840255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:50.840216    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fqsgj" event={"ID":"769590da-bfc7-4a2b-bbd7-6172a5417c10","Type":"ContainerStarted","Data":"a3b7f53d9d6b00eea9905f2c1059aa780622c8004f1319bde2bc2784f45e2488"}
May 29 17:33:50.841924 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:50.841897    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4" event={"ID":"ceb8c94a-f325-40b8-a1ad-74315284ed55","Type":"ContainerStarted","Data":"be5c69b6e9e6df02760a47e9bb646f196ce4aa71f1d9ae6d99d8c4c73b63ae71"}
May 29 17:33:50.842047 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:50.841929    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4" event={"ID":"ceb8c94a-f325-40b8-a1ad-74315284ed55","Type":"ContainerStarted","Data":"20ed7a11d445750b8f0eeb8d6da234ac9b13803529fe5545b7bdd46c6c3a35ca"}
May 29 17:33:50.906674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:50.906607    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fqsgj" podStartSLOduration=2.011069865 podStartE2EDuration="4.906589428s" podCreationTimestamp="2026-05-29 17:33:46 +0000 UTC" firstStartedPulling="2026-05-29 17:33:47.081801946 +0000 UTC m=+80.067623918" lastFinishedPulling="2026-05-29 17:33:49.977321507 +0000 UTC m=+82.963143481" observedRunningTime="2026-05-29 17:33:50.904278342 +0000 UTC m=+83.890100333" watchObservedRunningTime="2026-05-29 17:33:50.906589428 +0000 UTC m=+83.892411420"
May 29 17:33:50.919409 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:50.919161    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-59lw4" podStartSLOduration=2.712053471 podStartE2EDuration="4.919146343s" podCreationTimestamp="2026-05-29 17:33:46 +0000 UTC" firstStartedPulling="2026-05-29 17:33:47.771895918 +0000 UTC m=+80.757717885" lastFinishedPulling="2026-05-29 17:33:49.978988783 +0000 UTC m=+82.964810757" observedRunningTime="2026-05-29 17:33:50.918877138 +0000 UTC m=+83.904699129" watchObservedRunningTime="2026-05-29 17:33:50.919146343 +0000 UTC m=+83.904968336"
May 29 17:33:51.581365 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.581328    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"]
May 29 17:33:51.584762 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.584737    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:51.587287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.587266    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 29 17:33:51.587407 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.587271    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-m9ddv\""
May 29 17:33:51.594093 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.594073    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"]
May 29 17:33:51.728028 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.727996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/972c503a-5834-4955-97fa-2a2db6af096d-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9hfgg\" (UID: \"972c503a-5834-4955-97fa-2a2db6af096d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:51.828544 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.828514    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/972c503a-5834-4955-97fa-2a2db6af096d-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9hfgg\" (UID: \"972c503a-5834-4955-97fa-2a2db6af096d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:51.830877 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.830855    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/972c503a-5834-4955-97fa-2a2db6af096d-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-9hfgg\" (UID: \"972c503a-5834-4955-97fa-2a2db6af096d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:51.848269 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.848205    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9" event={"ID":"e6643768-efe8-4adc-baeb-ee0dbf5c2d2d","Type":"ContainerStarted","Data":"82e291d4483bef736ca14e6682de8f5c80dd3a91dbfd95661545adcd9935aaee"}
May 29 17:33:51.863948 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.863911    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-qbgd9" podStartSLOduration=33.442916449 podStartE2EDuration="35.863898827s" podCreationTimestamp="2026-05-29 17:33:16 +0000 UTC" firstStartedPulling="2026-05-29 17:33:48.678468665 +0000 UTC m=+81.664290632" lastFinishedPulling="2026-05-29 17:33:51.099451042 +0000 UTC m=+84.085273010" observedRunningTime="2026-05-29 17:33:51.863013644 +0000 UTC m=+84.848835645" watchObservedRunningTime="2026-05-29 17:33:51.863898827 +0000 UTC m=+84.849720861"
May 29 17:33:51.893163 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:51.893142    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:52.013369 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:52.013335    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"]
May 29 17:33:52.015981 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:52.015953    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972c503a_5834_4955_97fa_2a2db6af096d.slice/crio-67aa266d54a32a99a60a97272da32edbbe1a3f9becf1a9e02ab52bed9d8aeeab WatchSource:0}: Error finding container 67aa266d54a32a99a60a97272da32edbbe1a3f9becf1a9e02ab52bed9d8aeeab: Status 404 returned error can't find the container with id 67aa266d54a32a99a60a97272da32edbbe1a3f9becf1a9e02ab52bed9d8aeeab
May 29 17:33:52.852232 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:52.852200    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg" event={"ID":"972c503a-5834-4955-97fa-2a2db6af096d","Type":"ContainerStarted","Data":"67aa266d54a32a99a60a97272da32edbbe1a3f9becf1a9e02ab52bed9d8aeeab"}
May 29 17:33:53.293709 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.293676    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f7f85c465-fwqw6"]
May 29 17:33:53.296654 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.296640    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.299034 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.299015    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 17:33:53.299195 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.299180    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 17:33:53.299257 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.299191    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 17:33:53.299257 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.299206    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 17:33:53.299927 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.299909    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 17:33:53.300100 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.300084    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 17:33:53.300168 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.300092    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5tzdn\""
May 29 17:33:53.300168 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.300142    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 17:33:53.304066 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.304044    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7f85c465-fwqw6"]
May 29 17:33:53.443785 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.443676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-oauth-serving-cert\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.443785 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.443714    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-service-ca\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.443785 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.443741    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-config\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.444032 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.443814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-oauth-config\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.444032 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.443870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7vz\" (UniqueName: \"kubernetes.io/projected/64e08fab-ceb6-440c-98b3-d286ffbab85b-kube-api-access-6x7vz\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.444032 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.443912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-serving-cert\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.544639 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.544602    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7vz\" (UniqueName: \"kubernetes.io/projected/64e08fab-ceb6-440c-98b3-d286ffbab85b-kube-api-access-6x7vz\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.544639 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.544644    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-serving-cert\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.544920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.544689    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-oauth-serving-cert\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.544920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.544708    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-service-ca\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.544920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.544728    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-config\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.544920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.544744    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-oauth-config\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.545497 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.545469    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-oauth-serving-cert\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.545599 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.545469    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-service-ca\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.545599 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.545503    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-config\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.547245 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.547217    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-oauth-config\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.547560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.547544    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-serving-cert\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.554140 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.554121    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7vz\" (UniqueName: \"kubernetes.io/projected/64e08fab-ceb6-440c-98b3-d286ffbab85b-kube-api-access-6x7vz\") pod \"console-7f7f85c465-fwqw6\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") " pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.605816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.605790    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:33:53.722381 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.722310    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f7f85c465-fwqw6"]
May 29 17:33:53.725311 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:33:53.725287    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e08fab_ceb6_440c_98b3_d286ffbab85b.slice/crio-64c24b933fbbdc886f2b45025fe32e4dd1fd0a43541ae9f375e6a2e8fe3fbc79 WatchSource:0}: Error finding container 64c24b933fbbdc886f2b45025fe32e4dd1fd0a43541ae9f375e6a2e8fe3fbc79: Status 404 returned error can't find the container with id 64c24b933fbbdc886f2b45025fe32e4dd1fd0a43541ae9f375e6a2e8fe3fbc79
May 29 17:33:53.855631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.855601    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg" event={"ID":"972c503a-5834-4955-97fa-2a2db6af096d","Type":"ContainerStarted","Data":"f4ebbbe3ec48b6b9fce9a1e81f94a591991482150bd56501476ea4c07425755e"}
May 29 17:33:53.856031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.855797    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:53.856664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.856644    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7f85c465-fwqw6" event={"ID":"64e08fab-ceb6-440c-98b3-d286ffbab85b","Type":"ContainerStarted","Data":"64c24b933fbbdc886f2b45025fe32e4dd1fd0a43541ae9f375e6a2e8fe3fbc79"}
May 29 17:33:53.860255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.860237    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg"
May 29 17:33:53.871012 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:53.870974    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-9hfgg" podStartSLOduration=1.706938981 podStartE2EDuration="2.870961326s" podCreationTimestamp="2026-05-29 17:33:51 +0000 UTC" firstStartedPulling="2026-05-29 17:33:52.017884398 +0000 UTC m=+85.003706365" lastFinishedPulling="2026-05-29 17:33:53.181906729 +0000 UTC m=+86.167728710" observedRunningTime="2026-05-29 17:33:53.870119954 +0000 UTC m=+86.855941943" watchObservedRunningTime="2026-05-29 17:33:53.870961326 +0000 UTC m=+86.856783295"
May 29 17:33:56.593776 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:56.593730    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:33:57.869702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:57.869670    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7f85c465-fwqw6" event={"ID":"64e08fab-ceb6-440c-98b3-d286ffbab85b","Type":"ContainerStarted","Data":"b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba"}
May 29 17:33:57.894792 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:57.891913    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7f7f85c465-fwqw6" podStartSLOduration=1.479102513 podStartE2EDuration="4.891895156s" podCreationTimestamp="2026-05-29 17:33:53 +0000 UTC" firstStartedPulling="2026-05-29 17:33:53.728083279 +0000 UTC m=+86.713905260" lastFinishedPulling="2026-05-29 17:33:57.140875932 +0000 UTC m=+90.126697903" observedRunningTime="2026-05-29 17:33:57.890053686 +0000 UTC m=+90.875875680" watchObservedRunningTime="2026-05-29 17:33:57.891895156 +0000 UTC m=+90.877717146"
May 29 17:33:59.978988 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.978957    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lpscf"]
May 29 17:33:59.983549 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.983528    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:33:59.985933 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.985912    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 17:33:59.986037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.985918    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 17:33:59.986288 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.986269    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 17:33:59.986387 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.986368    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qrw66\""
May 29 17:33:59.986698 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:33:59.986684    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 17:34:00.098835 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.098793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099010 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.098856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-tls\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099010 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.098890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-textfile\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099010 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.098921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099010 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.098974    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-426rd\" (UniqueName: \"kubernetes.io/projected/231cda52-5939-4f2e-a4b0-c520fd65621e-kube-api-access-426rd\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.099035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-wtmp\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.099064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-sys\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.099085    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-root\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.099260 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.099141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/231cda52-5939-4f2e-a4b0-c520fd65621e-metrics-client-ca\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200095 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200058    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200101    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-426rd\" (UniqueName: \"kubernetes.io/projected/231cda52-5939-4f2e-a4b0-c520fd65621e-kube-api-access-426rd\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200162    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-wtmp\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200186    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-sys\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200208    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-root\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200238    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/231cda52-5939-4f2e-a4b0-c520fd65621e-metrics-client-ca\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200338 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200272    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200283    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-sys\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200310    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-tls\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200471    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-textfile\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200345    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-wtmp\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.200638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200382    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/231cda52-5939-4f2e-a4b0-c520fd65621e-root\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.201023 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.200995    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.201093 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.201045    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-textfile\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.201441 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.201411    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/231cda52-5939-4f2e-a4b0-c520fd65621e-metrics-client-ca\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.202642 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.202614    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.202734 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.202715    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/231cda52-5939-4f2e-a4b0-c520fd65621e-node-exporter-tls\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.209937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.209913    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-426rd\" (UniqueName: \"kubernetes.io/projected/231cda52-5939-4f2e-a4b0-c520fd65621e-kube-api-access-426rd\") pod \"node-exporter-lpscf\" (UID: \"231cda52-5939-4f2e-a4b0-c520fd65621e\") " pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.295973 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.295897    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpscf"
May 29 17:34:00.306954 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:34:00.306927    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod231cda52_5939_4f2e_a4b0_c520fd65621e.slice/crio-11f5d9dfbc4050566864723c080e2076764bf6145cff46097a6e3195b4bb617d WatchSource:0}: Error finding container 11f5d9dfbc4050566864723c080e2076764bf6145cff46097a6e3195b4bb617d: Status 404 returned error can't find the container with id 11f5d9dfbc4050566864723c080e2076764bf6145cff46097a6e3195b4bb617d
May 29 17:34:00.484530 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.484500    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5544c7bccf-rx6pg"]
May 29 17:34:00.489076 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.489057    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.496090 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.495946    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5544c7bccf-rx6pg"]
May 29 17:34:00.496893 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.496778    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 29 17:34:00.603473 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603400    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-oauth-serving-cert\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.603473 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-service-ca\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.603473 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmh8n\" (UniqueName: \"kubernetes.io/projected/44e54baf-4490-4121-8689-0cf61ecde613-kube-api-access-mmh8n\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.603718 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-serving-cert\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.603718 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-trusted-ca-bundle\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.603718 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603702    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-console-config\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.603886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.603732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-oauth-config\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705098 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705070    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-oauth-serving-cert\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705098 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705105    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-service-ca\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705132    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmh8n\" (UniqueName: \"kubernetes.io/projected/44e54baf-4490-4121-8689-0cf61ecde613-kube-api-access-mmh8n\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705160    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-serving-cert\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705175    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-trusted-ca-bundle\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705198    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-console-config\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705216    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-oauth-config\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.705962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705939    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-console-config\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.706081 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705939    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-service-ca\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.706081 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.705978    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-oauth-serving-cert\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.706450 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.706425    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-trusted-ca-bundle\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.707742 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.707717    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-oauth-config\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.707993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.707975    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-serving-cert\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.712687 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.712659    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmh8n\" (UniqueName: \"kubernetes.io/projected/44e54baf-4490-4121-8689-0cf61ecde613-kube-api-access-mmh8n\") pod \"console-5544c7bccf-rx6pg\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") " pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.800194 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.800165    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:00.881303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.881225    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpscf" event={"ID":"231cda52-5939-4f2e-a4b0-c520fd65621e","Type":"ContainerStarted","Data":"11f5d9dfbc4050566864723c080e2076764bf6145cff46097a6e3195b4bb617d"}
May 29 17:34:00.943822 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:00.943777    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5544c7bccf-rx6pg"]
May 29 17:34:00.947721 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:34:00.947688    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e54baf_4490_4121_8689_0cf61ecde613.slice/crio-cbd7b53d32b9e5f61023c443c76bd55dbfcfbe6c2e89eb357427858009695923 WatchSource:0}: Error finding container cbd7b53d32b9e5f61023c443c76bd55dbfcfbe6c2e89eb357427858009695923: Status 404 returned error can't find the container with id cbd7b53d32b9e5f61023c443c76bd55dbfcfbe6c2e89eb357427858009695923
May 29 17:34:01.061615 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.061374    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:34:01.065647 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.065623    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.068343 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.068268    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 17:34:01.068812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.068791    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 17:34:01.069289 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.069270    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 17:34:01.069371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.069312    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 17:34:01.069491 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.069478    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 17:34:01.069733 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.069718    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 17:34:01.069912 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.069895    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 17:34:01.069985 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.069941    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 17:34:01.070188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.070160    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 17:34:01.070249 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.070163    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-whzb5\""
May 29 17:34:01.083454 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.083419    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:34:01.210773 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.210961 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.210961 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210851    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-config-out\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.210961 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210891    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.210961 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkhv\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-kube-api-access-zgkhv\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.210961 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.210982    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.211001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-web-config\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.211040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.211077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.211116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.211167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.211223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.211204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312042    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312084    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312127    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312155    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312181    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312208    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312240    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-config-out\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312269    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312294    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkhv\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-kube-api-access-zgkhv\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312324    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312354    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312382    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-web-config\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312418    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.312995 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.312966    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.314206 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.314038    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.315211 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.315151    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.315211 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.315175    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.315211 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.315200    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.315426 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.315376    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.316530 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.316120    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.316530 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.316447    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.316697 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.316537    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-config-volume\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.317012 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.316992    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.317615 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.317593    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-web-config\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.317959 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.317940    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-config-out\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.328651 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.328629    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkhv\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-kube-api-access-zgkhv\") pod \"alertmanager-main-0\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.380696 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.380668    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:34:01.531623 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.531587    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:34:01.567703 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:34:01.567671    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4286070_e9e9_4334_8135_59385c71ae93.slice/crio-90ef77c74949f111b8a8323b98a834e99416645315a48b85a6366831c3cc34fa WatchSource:0}: Error finding container 90ef77c74949f111b8a8323b98a834e99416645315a48b85a6366831c3cc34fa: Status 404 returned error can't find the container with id 90ef77c74949f111b8a8323b98a834e99416645315a48b85a6366831c3cc34fa
May 29 17:34:01.886069 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.885983    2558 generic.go:358] "Generic (PLEG): container finished" podID="231cda52-5939-4f2e-a4b0-c520fd65621e" containerID="1c6210d2e452ae8c68f950e92f88dcbb88129441117c3f7279ebaa43273badd3" exitCode=0
May 29 17:34:01.886234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.886062    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpscf" event={"ID":"231cda52-5939-4f2e-a4b0-c520fd65621e","Type":"ContainerDied","Data":"1c6210d2e452ae8c68f950e92f88dcbb88129441117c3f7279ebaa43273badd3"}
May 29 17:34:01.887502 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.887469    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"90ef77c74949f111b8a8323b98a834e99416645315a48b85a6366831c3cc34fa"}
May 29 17:34:01.888866 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.888840    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5544c7bccf-rx6pg" event={"ID":"44e54baf-4490-4121-8689-0cf61ecde613","Type":"ContainerStarted","Data":"c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80"}
May 29 17:34:01.888975 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.888870    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5544c7bccf-rx6pg" event={"ID":"44e54baf-4490-4121-8689-0cf61ecde613","Type":"ContainerStarted","Data":"cbd7b53d32b9e5f61023c443c76bd55dbfcfbe6c2e89eb357427858009695923"}
May 29 17:34:01.938899 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:01.938848    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5544c7bccf-rx6pg" podStartSLOduration=1.938831127 podStartE2EDuration="1.938831127s" podCreationTimestamp="2026-05-29 17:34:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:34:01.937152775 +0000 UTC m=+94.922974764" watchObservedRunningTime="2026-05-29 17:34:01.938831127 +0000 UTC m=+94.924653115"
May 29 17:34:02.894487 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:02.894391    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5" exitCode=0
May 29 17:34:02.894955 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:02.894484    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"}
May 29 17:34:02.896816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:02.896789    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpscf" event={"ID":"231cda52-5939-4f2e-a4b0-c520fd65621e","Type":"ContainerStarted","Data":"07b1325de4b14d1c7d933c593103491f3bc508f3c0b593fc78ab6eeff46b7ce4"}
May 29 17:34:02.896937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:02.896825    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpscf" event={"ID":"231cda52-5939-4f2e-a4b0-c520fd65621e","Type":"ContainerStarted","Data":"227c708cf68755483499a9dabc3203f0f2f698f4c27fea8bfc27c8b19c11de08"}
May 29 17:34:02.956615 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:02.956562    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lpscf" podStartSLOduration=2.9119624870000003 podStartE2EDuration="3.956547446s" podCreationTimestamp="2026-05-29 17:33:59 +0000 UTC" firstStartedPulling="2026-05-29 17:34:00.308722937 +0000 UTC m=+93.294544908" lastFinishedPulling="2026-05-29 17:34:01.353307893 +0000 UTC m=+94.339129867" observedRunningTime="2026-05-29 17:34:02.95599762 +0000 UTC m=+95.941819610" watchObservedRunningTime="2026-05-29 17:34:02.956547446 +0000 UTC m=+95.942369434"
May 29 17:34:03.008605 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.008567    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86c6c6696b-spzkw"]
May 29 17:34:03.015646 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.015618    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.018098 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018049    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 29 17:34:03.018098 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018066    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-854f9\""
May 29 17:34:03.018098 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018090    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a3fiod3t5q8k\""
May 29 17:34:03.018351 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018059    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 29 17:34:03.018351 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018057    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 29 17:34:03.018351 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018230    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 29 17:34:03.018351 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.018174    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 29 17:34:03.024765 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.024729    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86c6c6696b-spzkw"]
May 29 17:34:03.131091 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-tls\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131091 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131091    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-metrics-client-ca\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131162    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-grpc-tls\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.131523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.131376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c7j6\" (UniqueName: \"kubernetes.io/projected/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-kube-api-access-4c7j6\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232058 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232029    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232067    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-grpc-tls\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232110    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232140    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4c7j6\" (UniqueName: \"kubernetes.io/projected/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-kube-api-access-4c7j6\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232209    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-tls\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232234    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-metrics-client-ca\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.232541 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.232293    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235145    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-tls\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235297 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235152    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235297 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235193    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-metrics-client-ca\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235404 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235387    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235493 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235472    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-grpc-tls\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235566 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235548    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.235978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.235962    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.239155 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.239127    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c7j6\" (UniqueName: \"kubernetes.io/projected/6dca3759-1d8b-4e20-93f7-2636fe4e30eb-kube-api-access-4c7j6\") pod \"thanos-querier-86c6c6696b-spzkw\" (UID: \"6dca3759-1d8b-4e20-93f7-2636fe4e30eb\") " pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.327168 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.327139    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:03.456844 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.456818    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86c6c6696b-spzkw"]
May 29 17:34:03.458695 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:34:03.458669    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dca3759_1d8b_4e20_93f7_2636fe4e30eb.slice/crio-0b0f2259859303fd0daebd99e9081f438273ee3d7ffc769d8c9ae299cbee31ed WatchSource:0}: Error finding container 0b0f2259859303fd0daebd99e9081f438273ee3d7ffc769d8c9ae299cbee31ed: Status 404 returned error can't find the container with id 0b0f2259859303fd0daebd99e9081f438273ee3d7ffc769d8c9ae299cbee31ed
May 29 17:34:03.606572 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.606467    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:34:03.606572 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.606535    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:34:03.612080 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.612002    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:34:03.901033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.900955    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"0b0f2259859303fd0daebd99e9081f438273ee3d7ffc769d8c9ae299cbee31ed"}
May 29 17:34:03.904697 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:03.904674    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:34:04.761949 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.760939    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"]
May 29 17:34:04.764366 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.764340    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:04.767205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.766827    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 29 17:34:04.767205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.767080    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-tbc5n\""
May 29 17:34:04.777996 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.777940    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"]
May 29 17:34:04.906388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.906354    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"}
May 29 17:34:04.906881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.906399    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"}
May 29 17:34:04.948193 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:04.948156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51f71c8d-a41a-4c45-8ce6-1750e6370503-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-kl5db\" (UID: \"51f71c8d-a41a-4c45-8ce6-1750e6370503\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:05.049707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.049599    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51f71c8d-a41a-4c45-8ce6-1750e6370503-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-kl5db\" (UID: \"51f71c8d-a41a-4c45-8ce6-1750e6370503\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:05.052798 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.052768    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/51f71c8d-a41a-4c45-8ce6-1750e6370503-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-kl5db\" (UID: \"51f71c8d-a41a-4c45-8ce6-1750e6370503\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:05.086768 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.086721    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:05.504610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.504573    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"]
May 29 17:34:05.519993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.519970    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5544c7bccf-rx6pg"]
May 29 17:34:05.536128 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.536094    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-789dd47cc7-n8bsn"]
May 29 17:34:05.541012 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.540985    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.550525 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.550484    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789dd47cc7-n8bsn"]
May 29 17:34:05.655513 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655461    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-trusted-ca-bundle\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.655688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-serving-cert\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.655688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655616    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-oauth-config\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.655688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655644    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmjfs\" (UniqueName: \"kubernetes.io/projected/5ec01832-3f1c-46ed-a54d-25ca8840708a-kube-api-access-nmjfs\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.655688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-oauth-serving-cert\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.655922 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-service-ca\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.655922 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.655834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-config\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756511 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756467    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-config\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756526    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-trusted-ca-bundle\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756556    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-serving-cert\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756599    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-oauth-config\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756763    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nmjfs\" (UniqueName: \"kubernetes.io/projected/5ec01832-3f1c-46ed-a54d-25ca8840708a-kube-api-access-nmjfs\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756854 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756820    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-oauth-serving-cert\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.756895 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.756849    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-service-ca\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.757375 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.757345    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-config\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.757485 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.757470    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-trusted-ca-bundle\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.757550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.757497    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-service-ca\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.757600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.757538    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-oauth-serving-cert\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.759147 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.759128    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-serving-cert\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.759246 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.759230    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-oauth-config\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.764765 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.764722    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmjfs\" (UniqueName: \"kubernetes.io/projected/5ec01832-3f1c-46ed-a54d-25ca8840708a-kube-api-access-nmjfs\") pod \"console-789dd47cc7-n8bsn\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") " pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.864669 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.864630    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:05.910362 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.910325    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db" event={"ID":"51f71c8d-a41a-4c45-8ce6-1750e6370503","Type":"ContainerStarted","Data":"20219dfd6f08ecdcf24eca69d42bb3c785a55d652c2bb992798595acdbd2bfc2"}
May 29 17:34:05.912609 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.912513    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"d4b8341ebbb840e07434ccaa7ca734e7f0a971067adc9e6de342c306b40ad870"}
May 29 17:34:05.912609 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.912561    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"76caac18efe1fb01e88d98750bb9c5850998632384ab32e6a0560a576042e4a8"}
May 29 17:34:05.912609 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.912575    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"d8a1c86d155308850badfde104917542af6bcc3ba5798f61ad285e299f8c4b02"}
May 29 17:34:05.916633 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.916604    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"}
May 29 17:34:05.916720 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.916645    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"}
May 29 17:34:05.916720 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:05.916660    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"}
May 29 17:34:06.001241 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:06.001211    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-789dd47cc7-n8bsn"]
May 29 17:34:06.005463 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:34:06.005434    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ec01832_3f1c_46ed_a54d_25ca8840708a.slice/crio-3a8365c7228557ddb1a2dbd138a92b27fbcde742bf48332b01d8755897c570d7 WatchSource:0}: Error finding container 3a8365c7228557ddb1a2dbd138a92b27fbcde742bf48332b01d8755897c570d7: Status 404 returned error can't find the container with id 3a8365c7228557ddb1a2dbd138a92b27fbcde742bf48332b01d8755897c570d7
May 29 17:34:06.922845 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:06.921640    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dd47cc7-n8bsn" event={"ID":"5ec01832-3f1c-46ed-a54d-25ca8840708a","Type":"ContainerStarted","Data":"217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295"}
May 29 17:34:06.922845 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:06.921687    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dd47cc7-n8bsn" event={"ID":"5ec01832-3f1c-46ed-a54d-25ca8840708a","Type":"ContainerStarted","Data":"3a8365c7228557ddb1a2dbd138a92b27fbcde742bf48332b01d8755897c570d7"}
May 29 17:34:06.940056 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:06.939878    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-789dd47cc7-n8bsn" podStartSLOduration=1.9398587040000002 podStartE2EDuration="1.939858704s" podCreationTimestamp="2026-05-29 17:34:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:34:06.939782987 +0000 UTC m=+99.925604976" watchObservedRunningTime="2026-05-29 17:34:06.939858704 +0000 UTC m=+99.925680695"
May 29 17:34:07.926022 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.925981    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db" event={"ID":"51f71c8d-a41a-4c45-8ce6-1750e6370503","Type":"ContainerStarted","Data":"dfe46541015fb4761c95d6244d1523c4a6165e0e77afdbaf7944c6ffff7cf565"}
May 29 17:34:07.926492 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.926171    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:07.929101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.929068    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"674456aea94238adf4fa0f6df3280f186290577c3ccd37c65e37c69a3e2e5986"}
May 29 17:34:07.929101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.929102    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"d1484d233b79854e98d69d7cd1ae43c9bb4031abf6f6007932388d15af38c011"}
May 29 17:34:07.929327 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.929112    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" event={"ID":"6dca3759-1d8b-4e20-93f7-2636fe4e30eb","Type":"ContainerStarted","Data":"f20fb4acbebc738bb3ae59e9a6405febc29fa26164ea6379d7ce27b9743eb48e"}
May 29 17:34:07.929327 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.929231    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:07.932124 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.932102    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db"
May 29 17:34:07.932799 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.932777    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerStarted","Data":"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"}
May 29 17:34:07.943161 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.943105    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-kl5db" podStartSLOduration=1.864064594 podStartE2EDuration="3.943091237s" podCreationTimestamp="2026-05-29 17:34:04 +0000 UTC" firstStartedPulling="2026-05-29 17:34:05.517887558 +0000 UTC m=+98.503709538" lastFinishedPulling="2026-05-29 17:34:07.596914215 +0000 UTC m=+100.582736181" observedRunningTime="2026-05-29 17:34:07.941715426 +0000 UTC m=+100.927537415" watchObservedRunningTime="2026-05-29 17:34:07.943091237 +0000 UTC m=+100.928913225"
May 29 17:34:07.979678 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:07.979621    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.188925216 podStartE2EDuration="6.979603473s" podCreationTimestamp="2026-05-29 17:34:01 +0000 UTC" firstStartedPulling="2026-05-29 17:34:01.56991524 +0000 UTC m=+94.555737206" lastFinishedPulling="2026-05-29 17:34:07.36059349 +0000 UTC m=+100.346415463" observedRunningTime="2026-05-29 17:34:07.97765756 +0000 UTC m=+100.963479550" watchObservedRunningTime="2026-05-29 17:34:07.979603473 +0000 UTC m=+100.965425461"
May 29 17:34:08.003031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:08.002953    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw" podStartSLOduration=2.102882314 podStartE2EDuration="6.002928635s" podCreationTimestamp="2026-05-29 17:34:02 +0000 UTC" firstStartedPulling="2026-05-29 17:34:03.460548142 +0000 UTC m=+96.446370110" lastFinishedPulling="2026-05-29 17:34:07.36059446 +0000 UTC m=+100.346416431" observedRunningTime="2026-05-29 17:34:08.000510815 +0000 UTC m=+100.986332841" watchObservedRunningTime="2026-05-29 17:34:08.002928635 +0000 UTC m=+100.988750625"
May 29 17:34:08.801233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:08.801200    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cqgl2"
May 29 17:34:10.801068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:10.801013    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:11.608288 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.608233    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65578c69-58dv2" podUID="1e603b99-9c11-4fcb-87f8-5c6ca44c2411" containerName="registry" containerID="cri-o://90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19" gracePeriod=30
May 29 17:34:11.856127 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.856102    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:34:11.916902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.916803    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-ca-trust-extracted\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.916902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.916844    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-bound-sa-token\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.916902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.916869    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.916902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.916888    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-certificates\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.917233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.916910    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwpbn\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-kube-api-access-pwpbn\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.917233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.916983    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-image-registry-private-configuration\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.917233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.917032    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-installation-pull-secrets\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.917233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.917084    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-trusted-ca\") pod \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\" (UID: \"1e603b99-9c11-4fcb-87f8-5c6ca44c2411\") "
May 29 17:34:11.917427 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.917335    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:11.917791 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.917744    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:11.919800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.919743    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:34:11.919800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.919793    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:34:11.919948 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.919775    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:34:11.919948 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.919827    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:34:11.919948 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.919877    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-kube-api-access-pwpbn" (OuterVolumeSpecName: "kube-api-access-pwpbn") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "kube-api-access-pwpbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:34:11.925691 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.925660    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1e603b99-9c11-4fcb-87f8-5c6ca44c2411" (UID: "1e603b99-9c11-4fcb-87f8-5c6ca44c2411"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:34:11.946007 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.945969    2558 generic.go:358] "Generic (PLEG): container finished" podID="1e603b99-9c11-4fcb-87f8-5c6ca44c2411" containerID="90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19" exitCode=0
May 29 17:34:11.946174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.946033    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65578c69-58dv2" event={"ID":"1e603b99-9c11-4fcb-87f8-5c6ca44c2411","Type":"ContainerDied","Data":"90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19"}
May 29 17:34:11.946174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.946040    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65578c69-58dv2"
May 29 17:34:11.946174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.946060    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65578c69-58dv2" event={"ID":"1e603b99-9c11-4fcb-87f8-5c6ca44c2411","Type":"ContainerDied","Data":"59e91c3fb23e3d8194fa16d51d6940894e6f18c1dd8f96d1332fc74638debe97"}
May 29 17:34:11.946174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.946076    2558 scope.go:117] "RemoveContainer" containerID="90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19"
May 29 17:34:11.957091 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.957062    2558 scope.go:117] "RemoveContainer" containerID="90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19"
May 29 17:34:11.957434 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:34:11.957413    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19\": container with ID starting with 90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19 not found: ID does not exist" containerID="90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19"
May 29 17:34:11.957514 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.957444    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19"} err="failed to get container status \"90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19\": rpc error: code = NotFound desc = could not find container \"90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19\": container with ID starting with 90eba40326c48dedb6906dfb51211e54c683c1e5e4a4283cfc186f0254c4af19 not found: ID does not exist"
May 29 17:34:11.968466 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.968431    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65578c69-58dv2"]
May 29 17:34:11.972621 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:11.972593    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65578c69-58dv2"]
May 29 17:34:12.018660 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018622    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018660 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018651    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-registry-certificates\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018660 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018662    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwpbn\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-kube-api-access-pwpbn\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018673    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-image-registry-private-configuration\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018683    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-installation-pull-secrets\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018692    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-trusted-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018702    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-ca-trust-extracted\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:12.018931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:12.018712    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1e603b99-9c11-4fcb-87f8-5c6ca44c2411-bound-sa-token\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:13.510744 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:13.510705    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e603b99-9c11-4fcb-87f8-5c6ca44c2411" path="/var/lib/kubelet/pods/1e603b99-9c11-4fcb-87f8-5c6ca44c2411/volumes"
May 29 17:34:13.943873 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:13.943849    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86c6c6696b-spzkw"
May 29 17:34:15.865141 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:15.865101    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:15.865141 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:15.865147    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:15.869983 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:15.869962    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:15.962011 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:15.961988    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:34:16.009546 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:16.009518    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7f85c465-fwqw6"]
May 29 17:34:30.546954 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.546887    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5544c7bccf-rx6pg" podUID="44e54baf-4490-4121-8689-0cf61ecde613" containerName="console" containerID="cri-o://c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80" gracePeriod=15
May 29 17:34:30.794941 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.794918    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5544c7bccf-rx6pg_44e54baf-4490-4121-8689-0cf61ecde613/console/0.log"
May 29 17:34:30.795075 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.794991    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:30.890565 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890474    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-serving-cert\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.890565 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890532    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmh8n\" (UniqueName: \"kubernetes.io/projected/44e54baf-4490-4121-8689-0cf61ecde613-kube-api-access-mmh8n\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.890840 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890563    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-service-ca\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.890840 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890602    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-console-config\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.890840 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890625    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-oauth-config\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.890840 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890655    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-trusted-ca-bundle\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.890840 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.890711    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-oauth-serving-cert\") pod \"44e54baf-4490-4121-8689-0cf61ecde613\" (UID: \"44e54baf-4490-4121-8689-0cf61ecde613\") "
May 29 17:34:30.891135 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.891109    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-service-ca" (OuterVolumeSpecName: "service-ca") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:30.891190 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.891109    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-console-config" (OuterVolumeSpecName: "console-config") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:30.891240 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.891215    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:30.891304 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.891279    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:30.892819 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.892794    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:34:30.892922 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.892898    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:34:30.892922 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.892911    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e54baf-4490-4121-8689-0cf61ecde613-kube-api-access-mmh8n" (OuterVolumeSpecName: "kube-api-access-mmh8n") pod "44e54baf-4490-4121-8689-0cf61ecde613" (UID: "44e54baf-4490-4121-8689-0cf61ecde613"). InnerVolumeSpecName "kube-api-access-mmh8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:34:30.991533 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991494    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:30.991533 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991526    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmh8n\" (UniqueName: \"kubernetes.io/projected/44e54baf-4490-4121-8689-0cf61ecde613-kube-api-access-mmh8n\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:30.991533 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991536    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-service-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:30.991533 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991545    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-console-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:30.991830 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991554    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44e54baf-4490-4121-8689-0cf61ecde613-console-oauth-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:30.991830 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991563    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-trusted-ca-bundle\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:30.991830 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:30.991573    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44e54baf-4490-4121-8689-0cf61ecde613-oauth-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:31.004921 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.004892    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5544c7bccf-rx6pg_44e54baf-4490-4121-8689-0cf61ecde613/console/0.log"
May 29 17:34:31.005089 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.004931    2558 generic.go:358] "Generic (PLEG): container finished" podID="44e54baf-4490-4121-8689-0cf61ecde613" containerID="c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80" exitCode=2
May 29 17:34:31.005089 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.004999    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5544c7bccf-rx6pg"
May 29 17:34:31.005089 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.005024    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5544c7bccf-rx6pg" event={"ID":"44e54baf-4490-4121-8689-0cf61ecde613","Type":"ContainerDied","Data":"c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80"}
May 29 17:34:31.005089 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.005063    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5544c7bccf-rx6pg" event={"ID":"44e54baf-4490-4121-8689-0cf61ecde613","Type":"ContainerDied","Data":"cbd7b53d32b9e5f61023c443c76bd55dbfcfbe6c2e89eb357427858009695923"}
May 29 17:34:31.005089 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.005079    2558 scope.go:117] "RemoveContainer" containerID="c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80"
May 29 17:34:31.013848 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.013828    2558 scope.go:117] "RemoveContainer" containerID="c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80"
May 29 17:34:31.014150 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:34:31.014131    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80\": container with ID starting with c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80 not found: ID does not exist" containerID="c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80"
May 29 17:34:31.014197 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.014161    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80"} err="failed to get container status \"c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80\": rpc error: code = NotFound desc = could not find container \"c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80\": container with ID starting with c191d025aad287ce83122b4cf754c21c4ffb706f21704424ecbb66b094583b80 not found: ID does not exist"
May 29 17:34:31.026044 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.026005    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5544c7bccf-rx6pg"]
May 29 17:34:31.029368 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.029338    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5544c7bccf-rx6pg"]
May 29 17:34:31.510991 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:31.510958    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44e54baf-4490-4121-8689-0cf61ecde613" path="/var/lib/kubelet/pods/44e54baf-4490-4121-8689-0cf61ecde613/volumes"
May 29 17:34:36.021973 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:36.021936    2558 generic.go:358] "Generic (PLEG): container finished" podID="c7ebb11b-8ee7-4313-9ae1-01629b5129cf" containerID="677e7a43743a11585a17a95d8431061455d8a1273eebdd048fe784212bb300e3" exitCode=0
May 29 17:34:36.022357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:36.022016    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl" event={"ID":"c7ebb11b-8ee7-4313-9ae1-01629b5129cf","Type":"ContainerDied","Data":"677e7a43743a11585a17a95d8431061455d8a1273eebdd048fe784212bb300e3"}
May 29 17:34:36.022357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:36.022337    2558 scope.go:117] "RemoveContainer" containerID="677e7a43743a11585a17a95d8431061455d8a1273eebdd048fe784212bb300e3"
May 29 17:34:37.026618 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.026523    2558 generic.go:358] "Generic (PLEG): container finished" podID="f0e29cd3-95aa-4984-b756-521622bc81be" containerID="c9e045dc73d1fa77c3a0a03213eca0b70e22f92b6aa7140febb10d382a7abf0b" exitCode=0
May 29 17:34:37.027033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.026607    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh" event={"ID":"f0e29cd3-95aa-4984-b756-521622bc81be","Type":"ContainerDied","Data":"c9e045dc73d1fa77c3a0a03213eca0b70e22f92b6aa7140febb10d382a7abf0b"}
May 29 17:34:37.027033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.027004    2558 scope.go:117] "RemoveContainer" containerID="c9e045dc73d1fa77c3a0a03213eca0b70e22f92b6aa7140febb10d382a7abf0b"
May 29 17:34:37.028003 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.027982    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-mjxdl" event={"ID":"c7ebb11b-8ee7-4313-9ae1-01629b5129cf","Type":"ContainerStarted","Data":"ec7307c9795914a0d294de9885dd49d887c738ca9e1c8f1903f435fdddcc510f"}
May 29 17:34:37.247283 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.247239    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:34:37.249708 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.249686    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ecfb99b-8aa4-472e-a985-06c40f2b3089-metrics-certs\") pod \"network-metrics-daemon-x8rpq\" (UID: \"6ecfb99b-8aa4-472e-a985-06c40f2b3089\") " pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:34:37.529537 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.529509    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nlz48\""
May 29 17:34:37.537242 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.537226    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8rpq"
May 29 17:34:37.667589 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:37.667553    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x8rpq"]
May 29 17:34:37.670619 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:34:37.670571    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecfb99b_8aa4_472e_a985_06c40f2b3089.slice/crio-dec6272be44d0e3da36f767b6ae41ad8bffc222b27be22ac2f5eb64066dbff3d WatchSource:0}: Error finding container dec6272be44d0e3da36f767b6ae41ad8bffc222b27be22ac2f5eb64066dbff3d: Status 404 returned error can't find the container with id dec6272be44d0e3da36f767b6ae41ad8bffc222b27be22ac2f5eb64066dbff3d
May 29 17:34:38.035370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:38.035332    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-lldmh" event={"ID":"f0e29cd3-95aa-4984-b756-521622bc81be","Type":"ContainerStarted","Data":"9449d25ab92da0d594e84ab7e25e603a22e0e946ce0f804c653ecb2ef4839353"}
May 29 17:34:38.036404 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:38.036380    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8rpq" event={"ID":"6ecfb99b-8aa4-472e-a985-06c40f2b3089","Type":"ContainerStarted","Data":"dec6272be44d0e3da36f767b6ae41ad8bffc222b27be22ac2f5eb64066dbff3d"}
May 29 17:34:39.040872 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:39.040839    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8rpq" event={"ID":"6ecfb99b-8aa4-472e-a985-06c40f2b3089","Type":"ContainerStarted","Data":"82488da00a57fda39eaad7e09dfeef6890d2cfc462dd9d9b9c7606542292e220"}
May 29 17:34:39.040872 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:39.040878    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8rpq" event={"ID":"6ecfb99b-8aa4-472e-a985-06c40f2b3089","Type":"ContainerStarted","Data":"e4c45240f63b40419d860e412008b0411834e686a1cf276853b6b8406302aed0"}
May 29 17:34:39.057704 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:39.057649    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x8rpq" podStartSLOduration=130.901807937 podStartE2EDuration="2m12.057633517s" podCreationTimestamp="2026-05-29 17:32:27 +0000 UTC" firstStartedPulling="2026-05-29 17:34:37.672385108 +0000 UTC m=+130.658207075" lastFinishedPulling="2026-05-29 17:34:38.828210689 +0000 UTC m=+131.814032655" observedRunningTime="2026-05-29 17:34:39.0564763 +0000 UTC m=+132.042298304" watchObservedRunningTime="2026-05-29 17:34:39.057633517 +0000 UTC m=+132.043455505"
May 29 17:34:41.029078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.029034    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7f7f85c465-fwqw6" podUID="64e08fab-ceb6-440c-98b3-d286ffbab85b" containerName="console" containerID="cri-o://b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba" gracePeriod=15
May 29 17:34:41.276586 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.276563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f7f85c465-fwqw6_64e08fab-ceb6-440c-98b3-d286ffbab85b/console/0.log"
May 29 17:34:41.276695 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.276622    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:34:41.384080 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.383996    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-serving-cert\") pod \"64e08fab-ceb6-440c-98b3-d286ffbab85b\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") "
May 29 17:34:41.384080 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384045    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-oauth-serving-cert\") pod \"64e08fab-ceb6-440c-98b3-d286ffbab85b\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") "
May 29 17:34:41.384080 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384076    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-config\") pod \"64e08fab-ceb6-440c-98b3-d286ffbab85b\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") "
May 29 17:34:41.384322 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384105    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-service-ca\") pod \"64e08fab-ceb6-440c-98b3-d286ffbab85b\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") "
May 29 17:34:41.384322 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384127    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6x7vz\" (UniqueName: \"kubernetes.io/projected/64e08fab-ceb6-440c-98b3-d286ffbab85b-kube-api-access-6x7vz\") pod \"64e08fab-ceb6-440c-98b3-d286ffbab85b\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") "
May 29 17:34:41.384322 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384196    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-oauth-config\") pod \"64e08fab-ceb6-440c-98b3-d286ffbab85b\" (UID: \"64e08fab-ceb6-440c-98b3-d286ffbab85b\") "
May 29 17:34:41.384633 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384600    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "64e08fab-ceb6-440c-98b3-d286ffbab85b" (UID: "64e08fab-ceb6-440c-98b3-d286ffbab85b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:41.384633 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384611    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-service-ca" (OuterVolumeSpecName: "service-ca") pod "64e08fab-ceb6-440c-98b3-d286ffbab85b" (UID: "64e08fab-ceb6-440c-98b3-d286ffbab85b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:41.384811 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.384677    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-config" (OuterVolumeSpecName: "console-config") pod "64e08fab-ceb6-440c-98b3-d286ffbab85b" (UID: "64e08fab-ceb6-440c-98b3-d286ffbab85b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:34:41.386272 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.386249    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "64e08fab-ceb6-440c-98b3-d286ffbab85b" (UID: "64e08fab-ceb6-440c-98b3-d286ffbab85b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:34:41.386359 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.386338    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "64e08fab-ceb6-440c-98b3-d286ffbab85b" (UID: "64e08fab-ceb6-440c-98b3-d286ffbab85b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:34:41.386399 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.386381    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e08fab-ceb6-440c-98b3-d286ffbab85b-kube-api-access-6x7vz" (OuterVolumeSpecName: "kube-api-access-6x7vz") pod "64e08fab-ceb6-440c-98b3-d286ffbab85b" (UID: "64e08fab-ceb6-440c-98b3-d286ffbab85b"). InnerVolumeSpecName "kube-api-access-6x7vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:34:41.485659 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.485606    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:41.485659 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.485652    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-oauth-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:41.485659 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.485666    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:41.485928 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.485681    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64e08fab-ceb6-440c-98b3-d286ffbab85b-service-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:41.485928 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.485693    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x7vz\" (UniqueName: \"kubernetes.io/projected/64e08fab-ceb6-440c-98b3-d286ffbab85b-kube-api-access-6x7vz\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:41.485928 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:41.485705    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64e08fab-ceb6-440c-98b3-d286ffbab85b-console-oauth-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:34:42.049809 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.049784    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f7f85c465-fwqw6_64e08fab-ceb6-440c-98b3-d286ffbab85b/console/0.log"
May 29 17:34:42.050183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.049823    2558 generic.go:358] "Generic (PLEG): container finished" podID="64e08fab-ceb6-440c-98b3-d286ffbab85b" containerID="b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba" exitCode=2
May 29 17:34:42.050183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.049889    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7f85c465-fwqw6" event={"ID":"64e08fab-ceb6-440c-98b3-d286ffbab85b","Type":"ContainerDied","Data":"b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba"}
May 29 17:34:42.050183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.049917    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f7f85c465-fwqw6" event={"ID":"64e08fab-ceb6-440c-98b3-d286ffbab85b","Type":"ContainerDied","Data":"64c24b933fbbdc886f2b45025fe32e4dd1fd0a43541ae9f375e6a2e8fe3fbc79"}
May 29 17:34:42.050183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.049919    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f7f85c465-fwqw6"
May 29 17:34:42.050183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.049933    2558 scope.go:117] "RemoveContainer" containerID="b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba"
May 29 17:34:42.057807 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.057791    2558 scope.go:117] "RemoveContainer" containerID="b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba"
May 29 17:34:42.058078 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:34:42.058057    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba\": container with ID starting with b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba not found: ID does not exist" containerID="b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba"
May 29 17:34:42.058148 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.058085    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba"} err="failed to get container status \"b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba\": rpc error: code = NotFound desc = could not find container \"b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba\": container with ID starting with b74c585c19da23f8b5632bf0e2339299e9f0ac1d284868cd80f33816c06b59ba not found: ID does not exist"
May 29 17:34:42.065851 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.065823    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f7f85c465-fwqw6"]
May 29 17:34:42.071715 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:42.071684    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f7f85c465-fwqw6"]
May 29 17:34:43.509964 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:43.509936    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e08fab-ceb6-440c-98b3-d286ffbab85b" path="/var/lib/kubelet/pods/64e08fab-ceb6-440c-98b3-d286ffbab85b/volumes"
May 29 17:34:51.078603 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:51.078567    2558 generic.go:358] "Generic (PLEG): container finished" podID="f2cb3617-4b6a-43f2-a7df-076041e3e852" containerID="f20f551eb7553eb3536633c0d977f333917be93e38b0eddb8c5eb4ec047d3b75" exitCode=0
May 29 17:34:51.079013 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:51.078639    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2rnqk" event={"ID":"f2cb3617-4b6a-43f2-a7df-076041e3e852","Type":"ContainerDied","Data":"f20f551eb7553eb3536633c0d977f333917be93e38b0eddb8c5eb4ec047d3b75"}
May 29 17:34:51.079013 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:51.079001    2558 scope.go:117] "RemoveContainer" containerID="f20f551eb7553eb3536633c0d977f333917be93e38b0eddb8c5eb4ec047d3b75"
May 29 17:34:52.083107 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:34:52.083076    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2rnqk" event={"ID":"f2cb3617-4b6a-43f2-a7df-076041e3e852","Type":"ContainerStarted","Data":"2ae441f05fef36474d2365eace35864fd66cd395dcd3f0c6ff35879596a99435"}
May 29 17:35:20.225047 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.224955    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:35:20.225594 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.225538    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="alertmanager" containerID="cri-o://0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff" gracePeriod=120
May 29 17:35:20.225737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.225599    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-metric" containerID="cri-o://d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f" gracePeriod=120
May 29 17:35:20.225737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.225656    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy" containerID="cri-o://279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7" gracePeriod=120
May 29 17:35:20.225737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.225646    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="prom-label-proxy" containerID="cri-o://ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4" gracePeriod=120
May 29 17:35:20.225737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.225621    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-web" containerID="cri-o://70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b" gracePeriod=120
May 29 17:35:20.225737 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:20.225655    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="config-reloader" containerID="cri-o://57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e" gracePeriod=120
May 29 17:35:21.172541 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172505    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4" exitCode=0
May 29 17:35:21.172541 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172532    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7" exitCode=0
May 29 17:35:21.172541 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172538    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e" exitCode=0
May 29 17:35:21.172541 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172544    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff" exitCode=0
May 29 17:35:21.172817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172574    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"}
May 29 17:35:21.172817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172605    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"}
May 29 17:35:21.172817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172615    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"}
May 29 17:35:21.172817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.172623    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"}
May 29 17:35:21.462242 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.462221    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:21.624251 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624217    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-cluster-tls-config\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624251 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624249    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-main-tls\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624275    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-main-db\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624319    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624439    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-tls-assets\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624572 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624489    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-trusted-ca-bundle\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624572 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624523    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-config-volume\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624572 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624549    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-metrics-client-ca\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624580    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgkhv\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-kube-api-access-zgkhv\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624635    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-web-config\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.624707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.624637    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:35:21.625379 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.625348    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-config-out\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.625514 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.625417    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-web\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.625514 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.625458    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy\") pod \"d4286070-e9e9-4334-8135-59385c71ae93\" (UID: \"d4286070-e9e9-4334-8135-59385c71ae93\") "
May 29 17:35:21.625514 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.625471    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:35:21.627220 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.627023    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.627660 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.627631    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-config-out" (OuterVolumeSpecName: "config-out") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:35:21.627959 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.627934    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.628560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.628283    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.628868 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.628723    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-config-volume" (OuterVolumeSpecName: "config-volume") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.628868 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.628822    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:35:21.629225 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629202    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629286 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629236    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-config-volume\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629286 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629255    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d4286070-e9e9-4334-8135-59385c71ae93-metrics-client-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629286 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629272    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-config-out\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629436 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629295    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629436 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629312    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-main-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629436 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629328    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d4286070-e9e9-4334-8135-59385c71ae93-alertmanager-main-db\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.629436 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629345    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.631182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629794    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:35:21.631182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.629862    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-kube-api-access-zgkhv" (OuterVolumeSpecName: "kube-api-access-zgkhv") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "kube-api-access-zgkhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:35:21.632826 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.632645    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.633008 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.632973    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.644409 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.644385    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-web-config" (OuterVolumeSpecName: "web-config") pod "d4286070-e9e9-4334-8135-59385c71ae93" (UID: "d4286070-e9e9-4334-8135-59385c71ae93"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:35:21.730016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.729927    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-cluster-tls-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.730016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.729965    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-tls-assets\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.730016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.729976    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgkhv\" (UniqueName: \"kubernetes.io/projected/d4286070-e9e9-4334-8135-59385c71ae93-kube-api-access-zgkhv\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.730016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.729987    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-web-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:21.730016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:21.729998    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d4286070-e9e9-4334-8135-59385c71ae93-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:35:22.178453 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178423    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f" exitCode=0
May 29 17:35:22.178453 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178448    2558 generic.go:358] "Generic (PLEG): container finished" podID="d4286070-e9e9-4334-8135-59385c71ae93" containerID="70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b" exitCode=0
May 29 17:35:22.178747 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178490    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"}
May 29 17:35:22.178747 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178518    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"}
May 29 17:35:22.178747 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178529    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d4286070-e9e9-4334-8135-59385c71ae93","Type":"ContainerDied","Data":"90ef77c74949f111b8a8323b98a834e99416645315a48b85a6366831c3cc34fa"}
May 29 17:35:22.178747 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178543    2558 scope.go:117] "RemoveContainer" containerID="ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"
May 29 17:35:22.178747 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.178578    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.186932 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.186913    2558 scope.go:117] "RemoveContainer" containerID="d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"
May 29 17:35:22.193654 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.193638    2558 scope.go:117] "RemoveContainer" containerID="279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"
May 29 17:35:22.200698 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.200675    2558 scope.go:117] "RemoveContainer" containerID="70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"
May 29 17:35:22.201443 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.201414    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:35:22.204946 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.204920    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:35:22.208037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.208022    2558 scope.go:117] "RemoveContainer" containerID="57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"
May 29 17:35:22.214314 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.214298    2558 scope.go:117] "RemoveContainer" containerID="0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"
May 29 17:35:22.220604 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.220586    2558 scope.go:117] "RemoveContainer" containerID="a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"
May 29 17:35:22.227327 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.227311    2558 scope.go:117] "RemoveContainer" containerID="ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"
May 29 17:35:22.227564 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.227543    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4\": container with ID starting with ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4 not found: ID does not exist" containerID="ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"
May 29 17:35:22.227624 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.227571    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"} err="failed to get container status \"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4\": rpc error: code = NotFound desc = could not find container \"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4\": container with ID starting with ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4 not found: ID does not exist"
May 29 17:35:22.227624 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.227590    2558 scope.go:117] "RemoveContainer" containerID="d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"
May 29 17:35:22.227833 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.227816    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f\": container with ID starting with d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f not found: ID does not exist" containerID="d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"
May 29 17:35:22.227884 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.227846    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"} err="failed to get container status \"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f\": rpc error: code = NotFound desc = could not find container \"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f\": container with ID starting with d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f not found: ID does not exist"
May 29 17:35:22.227884 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.227863    2558 scope.go:117] "RemoveContainer" containerID="279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"
May 29 17:35:22.228394 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.228169    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7\": container with ID starting with 279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7 not found: ID does not exist" containerID="279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"
May 29 17:35:22.228394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.228199    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"} err="failed to get container status \"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7\": rpc error: code = NotFound desc = could not find container \"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7\": container with ID starting with 279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7 not found: ID does not exist"
May 29 17:35:22.228394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.228220    2558 scope.go:117] "RemoveContainer" containerID="70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"
May 29 17:35:22.228947 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.228928    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b\": container with ID starting with 70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b not found: ID does not exist" containerID="70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"
May 29 17:35:22.229051 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.228954    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"} err="failed to get container status \"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b\": rpc error: code = NotFound desc = could not find container \"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b\": container with ID starting with 70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b not found: ID does not exist"
May 29 17:35:22.229051 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.228974    2558 scope.go:117] "RemoveContainer" containerID="57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"
May 29 17:35:22.229221 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.229200    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e\": container with ID starting with 57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e not found: ID does not exist" containerID="57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"
May 29 17:35:22.229270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229228    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"} err="failed to get container status \"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e\": rpc error: code = NotFound desc = could not find container \"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e\": container with ID starting with 57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e not found: ID does not exist"
May 29 17:35:22.229270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229248    2558 scope.go:117] "RemoveContainer" containerID="0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"
May 29 17:35:22.229505 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.229488    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff\": container with ID starting with 0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff not found: ID does not exist" containerID="0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"
May 29 17:35:22.229574 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229509    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"} err="failed to get container status \"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff\": rpc error: code = NotFound desc = could not find container \"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff\": container with ID starting with 0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff not found: ID does not exist"
May 29 17:35:22.229574 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229523    2558 scope.go:117] "RemoveContainer" containerID="a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"
May 29 17:35:22.229778 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:35:22.229738    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5\": container with ID starting with a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5 not found: ID does not exist" containerID="a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"
May 29 17:35:22.229854 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229786    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"} err="failed to get container status \"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5\": rpc error: code = NotFound desc = could not find container \"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5\": container with ID starting with a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5 not found: ID does not exist"
May 29 17:35:22.229854 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229807    2558 scope.go:117] "RemoveContainer" containerID="ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"
May 29 17:35:22.229854 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.229811    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:35:22.230048 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230031    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4"} err="failed to get container status \"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4\": rpc error: code = NotFound desc = could not find container \"ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4\": container with ID starting with ee2bf9a5e54d187ad8850d4feb47fffd2812f0acdb709f283891ad01932222c4 not found: ID does not exist"
May 29 17:35:22.230118 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230050    2558 scope.go:117] "RemoveContainer" containerID="d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"
May 29 17:35:22.230235 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230205    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="alertmanager"
May 29 17:35:22.230235 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230225    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="alertmanager"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230238    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="config-reloader"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230248    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="config-reloader"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230257    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e54baf-4490-4121-8689-0cf61ecde613" containerName="console"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230265    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e54baf-4490-4121-8689-0cf61ecde613" containerName="console"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230274    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230274    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f"} err="failed to get container status \"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f\": rpc error: code = NotFound desc = could not find container \"d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f\": container with ID starting with d2efc5c7bf0e65dfa3d04b9372e5d6bf63da503590b0ffa1830e4c26f3df896f not found: ID does not exist"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230299    2558 scope.go:117] "RemoveContainer" containerID="279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230284    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230347    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-metric"
May 29 17:35:22.230356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230356    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-metric"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230368    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="prom-label-proxy"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230377    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="prom-label-proxy"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230398    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e603b99-9c11-4fcb-87f8-5c6ca44c2411" containerName="registry"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230407    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e603b99-9c11-4fcb-87f8-5c6ca44c2411" containerName="registry"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230416    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="init-config-reloader"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230422    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="init-config-reloader"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230429    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-web"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230435    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-web"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230450    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e08fab-ceb6-440c-98b3-d286ffbab85b" containerName="console"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230455    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e08fab-ceb6-440c-98b3-d286ffbab85b" containerName="console"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230544    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-metric"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230558    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e603b99-9c11-4fcb-87f8-5c6ca44c2411" containerName="registry"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230570    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy-web"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230569    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7"} err="failed to get container status \"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7\": rpc error: code = NotFound desc = could not find container \"279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7\": container with ID starting with 279ec63059dbfa5f285fe7c03417517b4ff471130acd542088e0fbf3cd887cb7 not found: ID does not exist"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230597    2558 scope.go:117] "RemoveContainer" containerID="70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230581    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="64e08fab-ceb6-440c-98b3-d286ffbab85b" containerName="console"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230641    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="config-reloader"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230652    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="kube-rbac-proxy"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230664    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="prom-label-proxy"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230674    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="44e54baf-4490-4121-8689-0cf61ecde613" containerName="console"
May 29 17:35:22.230707 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230682    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4286070-e9e9-4334-8135-59385c71ae93" containerName="alertmanager"
May 29 17:35:22.231371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230845    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b"} err="failed to get container status \"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b\": rpc error: code = NotFound desc = could not find container \"70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b\": container with ID starting with 70f4d3fd41af629c6304af9b6cb8aaf596f6e7e1a8ee6283b747ec182ee1e76b not found: ID does not exist"
May 29 17:35:22.231371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.230866    2558 scope.go:117] "RemoveContainer" containerID="57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"
May 29 17:35:22.231371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.231064    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e"} err="failed to get container status \"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e\": rpc error: code = NotFound desc = could not find container \"57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e\": container with ID starting with 57005a89ba689e09bd3864d3d4d0fc531bd9c9c0686f5ee842f4d0c7f6f1200e not found: ID does not exist"
May 29 17:35:22.231371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.231082    2558 scope.go:117] "RemoveContainer" containerID="0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"
May 29 17:35:22.231371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.231279    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff"} err="failed to get container status \"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff\": rpc error: code = NotFound desc = could not find container \"0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff\": container with ID starting with 0673d74085f4bb3a5f9f9ee9eee005efa9f8bc9be989ccfb2a6cd035f1f7ceff not found: ID does not exist"
May 29 17:35:22.231371 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.231300    2558 scope.go:117] "RemoveContainer" containerID="a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"
May 29 17:35:22.231564 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.231483    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5"} err="failed to get container status \"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5\": rpc error: code = NotFound desc = could not find container \"a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5\": container with ID starting with a979cce998d392dc5cf52e69861d25827ec89bab5863c7bee6b439811ed09ff5 not found: ID does not exist"
May 29 17:35:22.236070 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.236053    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.238357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238339    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 29 17:35:22.238442 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238380    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 29 17:35:22.238613 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238593    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 29 17:35:22.238716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238623    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 29 17:35:22.238716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238594    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-whzb5\""
May 29 17:35:22.238716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238707    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 29 17:35:22.238995 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.238979    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 29 17:35:22.239066 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.239040    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 29 17:35:22.239124 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.239040    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 29 17:35:22.244566 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.244155    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 29 17:35:22.246091 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.246073    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:35:22.334330 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334304    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49ssw\" (UniqueName: \"kubernetes.io/projected/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-kube-api-access-49ssw\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-web-config\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334402    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334440    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334469 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-config-out\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-config-volume\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334539    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.334681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.334584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435321 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435230    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49ssw\" (UniqueName: \"kubernetes.io/projected/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-kube-api-access-49ssw\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435321 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435284    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-web-config\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435513 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435394    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435513 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435429    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435513 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435453    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435513 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435480    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435517    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.435700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435562    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-config-out\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435863    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-config-volume\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435906    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435941    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.435990    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.436021    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.436306    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.436358    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.436942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.436584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.438406 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.438356    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-config-out\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.438406 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.438397    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-web-config\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.438560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.438458    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.438709 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.438688    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.438792 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.438687    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.438905 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.438888    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.439266 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.439240    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.439701 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.439678    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-config-volume\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.440437 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.440414    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.443476 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.443453    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49ssw\" (UniqueName: \"kubernetes.io/projected/63d1e22d-e05b-4c10-a51b-7ceefe8d3706-kube-api-access-49ssw\") pod \"alertmanager-main-0\" (UID: \"63d1e22d-e05b-4c10-a51b-7ceefe8d3706\") " pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.546917 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.546875    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 29 17:35:22.679508 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:22.679457    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 29 17:35:22.681732 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:35:22.681703    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d1e22d_e05b_4c10_a51b_7ceefe8d3706.slice/crio-fcd6c24541496117a2b541d93bb32e37b79a5612d460a035717d38beed84bb2b WatchSource:0}: Error finding container fcd6c24541496117a2b541d93bb32e37b79a5612d460a035717d38beed84bb2b: Status 404 returned error can't find the container with id fcd6c24541496117a2b541d93bb32e37b79a5612d460a035717d38beed84bb2b
May 29 17:35:23.183612 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:23.183580    2558 generic.go:358] "Generic (PLEG): container finished" podID="63d1e22d-e05b-4c10-a51b-7ceefe8d3706" containerID="91c8239832010add62ef0bc5f55b15d27c96667e424463b95d998be1bb6e1993" exitCode=0
May 29 17:35:23.183812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:23.183667    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerDied","Data":"91c8239832010add62ef0bc5f55b15d27c96667e424463b95d998be1bb6e1993"}
May 29 17:35:23.183812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:23.183710    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"fcd6c24541496117a2b541d93bb32e37b79a5612d460a035717d38beed84bb2b"}
May 29 17:35:23.511910 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:23.511878    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4286070-e9e9-4334-8135-59385c71ae93" path="/var/lib/kubelet/pods/d4286070-e9e9-4334-8135-59385c71ae93/volumes"
May 29 17:35:24.191397 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.191350    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"24766ab52d530ca5ab9e9b8c5a4dd8c2497090a8ed0376e4164315a6b0d9e40d"}
May 29 17:35:24.191397 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.191393    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"de7e8895e98eafa56e0a38865f3b1c3d2719d3e2aa9177c6e2312bdcdd23b9a8"}
May 29 17:35:24.191397 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.191405    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"7ee068fb572849601fa06f85cc6d278fb79718088b2cfb3ef784282ef196fb7d"}
May 29 17:35:24.191987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.191417    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"5c923dc28f4e500d607f395b46bd8a07786f15eb5f3816934d95310589091681"}
May 29 17:35:24.191987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.191429    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"651c7b11ed41e7b2dde50ef766ace65edcf4b4fc0957f091593f6fd3d2fedcaa"}
May 29 17:35:24.191987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.191440    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63d1e22d-e05b-4c10-a51b-7ceefe8d3706","Type":"ContainerStarted","Data":"cb1e3398463942fc82438078e0cfb9a0977c0fea013b0bfd049b63a0a36969b0"}
May 29 17:35:24.219808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.219738    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.219723102 podStartE2EDuration="2.219723102s" podCreationTimestamp="2026-05-29 17:35:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:35:24.218260605 +0000 UTC m=+177.204082594" watchObservedRunningTime="2026-05-29 17:35:24.219723102 +0000 UTC m=+177.205545092"
May 29 17:35:24.263571 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.263533    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5886fb5559-4ss42"]
May 29 17:35:24.267066 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.267047    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.269517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.269496    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 29 17:35:24.269849 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.269830    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 29 17:35:24.269933 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.269834    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 29 17:35:24.270028 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.270010    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k7trc\""
May 29 17:35:24.270082 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.270062    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 29 17:35:24.270520 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.270500    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 29 17:35:24.276951 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.276926    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 29 17:35:24.279934 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.279909    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5886fb5559-4ss42"]
May 29 17:35:24.353396 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-telemeter-client-tls\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.353609 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-serving-certs-ca-bundle\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.353609 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42b7\" (UniqueName: \"kubernetes.io/projected/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-kube-api-access-g42b7\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.353711 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-federate-client-tls\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.353811 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-metrics-client-ca\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.353960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353938    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-secret-telemeter-client\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.354030 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.353975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.354082 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.354062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455387 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455301    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-telemeter-client-tls\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455387 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455346    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-serving-certs-ca-bundle\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455387 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455376    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g42b7\" (UniqueName: \"kubernetes.io/projected/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-kube-api-access-g42b7\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455408    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-federate-client-tls\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455435    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-metrics-client-ca\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455473    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-secret-telemeter-client\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455498    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.455638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.455546    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.456252 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.456200    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-serving-certs-ca-bundle\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.456440 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.456414    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.456516 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.456426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-metrics-client-ca\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.458152 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.458118    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.458234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.458198    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-secret-telemeter-client\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.458526 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.458505    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-telemeter-client-tls\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.458565 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.458505    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-federate-client-tls\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.463767 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.463736    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42b7\" (UniqueName: \"kubernetes.io/projected/db9c3a7d-60be-4af2-b69f-cac1ba61c4e0-kube-api-access-g42b7\") pod \"telemeter-client-5886fb5559-4ss42\" (UID: \"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0\") " pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.578280 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.578247    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42"
May 29 17:35:24.705598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:24.705502    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5886fb5559-4ss42"]
May 29 17:35:24.708359 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:35:24.708327    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9c3a7d_60be_4af2_b69f_cac1ba61c4e0.slice/crio-6a410d34fd448b7b8660dcc017cddf3ae96750025cd01f0e0a32329ad80a17f2 WatchSource:0}: Error finding container 6a410d34fd448b7b8660dcc017cddf3ae96750025cd01f0e0a32329ad80a17f2: Status 404 returned error can't find the container with id 6a410d34fd448b7b8660dcc017cddf3ae96750025cd01f0e0a32329ad80a17f2
May 29 17:35:25.196585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:25.196550    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42" event={"ID":"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0","Type":"ContainerStarted","Data":"6a410d34fd448b7b8660dcc017cddf3ae96750025cd01f0e0a32329ad80a17f2"}
May 29 17:35:27.206805 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:27.206760    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42" event={"ID":"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0","Type":"ContainerStarted","Data":"b52b6e9e5eb682ca4979eda621187b886272004354ccea5b0eb8208d740e0b8d"}
May 29 17:35:28.211890 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:28.211852    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42" event={"ID":"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0","Type":"ContainerStarted","Data":"c5a92ef350f1e60507da6931ff7a45c8de3fd4d6ed2a1aa30710de7b9cd0e123"}
May 29 17:35:28.211890 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:28.211889    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42" event={"ID":"db9c3a7d-60be-4af2-b69f-cac1ba61c4e0","Type":"ContainerStarted","Data":"b4d090fc15592285e4e29fdf8a93b469834a3733cdcd75161e47a2d1d7c29829"}
May 29 17:35:28.233567 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:28.233494    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5886fb5559-4ss42" podStartSLOduration=1.8403857989999999 podStartE2EDuration="4.233480444s" podCreationTimestamp="2026-05-29 17:35:24 +0000 UTC" firstStartedPulling="2026-05-29 17:35:24.710738206 +0000 UTC m=+177.696560173" lastFinishedPulling="2026-05-29 17:35:27.103832836 +0000 UTC m=+180.089654818" observedRunningTime="2026-05-29 17:35:28.232617369 +0000 UTC m=+181.218439359" watchObservedRunningTime="2026-05-29 17:35:28.233480444 +0000 UTC m=+181.219302434"
May 29 17:35:28.925760 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:28.925728    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c9f74f697-c7xqn"]
May 29 17:35:28.930462 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:28.930445    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:28.941845 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:28.941821    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9f74f697-c7xqn"]
May 29 17:35:29.096877 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.096839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp4bt\" (UniqueName: \"kubernetes.io/projected/b2f2a4ef-5543-4582-9f34-f12c8af627f1-kube-api-access-qp4bt\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.096877 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.096882    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-oauth-serving-cert\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.097078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.096900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-oauth-config\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.097078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.096978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-config\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.097078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.097021    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-trusted-ca-bundle\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.097078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.097059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-serving-cert\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.097078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.097075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-service-ca\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198104    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-serving-cert\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198154    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-service-ca\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198200    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qp4bt\" (UniqueName: \"kubernetes.io/projected/b2f2a4ef-5543-4582-9f34-f12c8af627f1-kube-api-access-qp4bt\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198225    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-oauth-serving-cert\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198242    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-oauth-config\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198270    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-config\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.198598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.198494    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-trusted-ca-bundle\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.199083 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.199054    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-service-ca\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.199182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.199067    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-oauth-serving-cert\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.199182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.199097    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-config\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.199250 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.199206    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-trusted-ca-bundle\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.200682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.200660    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-oauth-config\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.200937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.200913    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-serving-cert\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.206424 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.206407    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp4bt\" (UniqueName: \"kubernetes.io/projected/b2f2a4ef-5543-4582-9f34-f12c8af627f1-kube-api-access-qp4bt\") pod \"console-5c9f74f697-c7xqn\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") " pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.240553 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.240520    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:29.364955 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:29.364919    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c9f74f697-c7xqn"]
May 29 17:35:29.368889 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:35:29.368863    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f2a4ef_5543_4582_9f34_f12c8af627f1.slice/crio-2b80316929c10cb466385692eddac9b9abf2e7c136ca566d8cf40f0ce6c20ce2 WatchSource:0}: Error finding container 2b80316929c10cb466385692eddac9b9abf2e7c136ca566d8cf40f0ce6c20ce2: Status 404 returned error can't find the container with id 2b80316929c10cb466385692eddac9b9abf2e7c136ca566d8cf40f0ce6c20ce2
May 29 17:35:30.219340 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:30.219305    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9f74f697-c7xqn" event={"ID":"b2f2a4ef-5543-4582-9f34-f12c8af627f1","Type":"ContainerStarted","Data":"25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722"}
May 29 17:35:30.219497 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:30.219346    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9f74f697-c7xqn" event={"ID":"b2f2a4ef-5543-4582-9f34-f12c8af627f1","Type":"ContainerStarted","Data":"2b80316929c10cb466385692eddac9b9abf2e7c136ca566d8cf40f0ce6c20ce2"}
May 29 17:35:30.235882 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:30.235828    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c9f74f697-c7xqn" podStartSLOduration=2.235814251 podStartE2EDuration="2.235814251s" podCreationTimestamp="2026-05-29 17:35:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:35:30.235212077 +0000 UTC m=+183.221034066" watchObservedRunningTime="2026-05-29 17:35:30.235814251 +0000 UTC m=+183.221636242"
May 29 17:35:39.240731 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:39.240672    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:39.240731 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:39.240737    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:39.245785 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:39.245760    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:39.249506 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:39.249483    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:35:39.310137 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:35:39.310104    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789dd47cc7-n8bsn"]
May 29 17:36:04.329774 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.329699    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-789dd47cc7-n8bsn" podUID="5ec01832-3f1c-46ed-a54d-25ca8840708a" containerName="console" containerID="cri-o://217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295" gracePeriod=15
May 29 17:36:04.566650 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.566629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-789dd47cc7-n8bsn_5ec01832-3f1c-46ed-a54d-25ca8840708a/console/0.log"
May 29 17:36:04.566770 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.566687    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:36:04.684731 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684703    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-serving-cert\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.684919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684762    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-trusted-ca-bundle\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.684919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684817    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmjfs\" (UniqueName: \"kubernetes.io/projected/5ec01832-3f1c-46ed-a54d-25ca8840708a-kube-api-access-nmjfs\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.684919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684856    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-service-ca\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.684919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684888    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-oauth-config\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.684919 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684918    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-oauth-serving-cert\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.685163 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.684966    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-config\") pod \"5ec01832-3f1c-46ed-a54d-25ca8840708a\" (UID: \"5ec01832-3f1c-46ed-a54d-25ca8840708a\") "
May 29 17:36:04.685254 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.685226    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:36:04.685326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.685265    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:36:04.685326 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.685273    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:36:04.685511 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.685487    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-config" (OuterVolumeSpecName: "console-config") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:36:04.686765 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.686725    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:36:04.686889 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.686869    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:36:04.686944 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.686893    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec01832-3f1c-46ed-a54d-25ca8840708a-kube-api-access-nmjfs" (OuterVolumeSpecName: "kube-api-access-nmjfs") pod "5ec01832-3f1c-46ed-a54d-25ca8840708a" (UID: "5ec01832-3f1c-46ed-a54d-25ca8840708a"). InnerVolumeSpecName "kube-api-access-nmjfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:36:04.786667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786618    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:04.786667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786661    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-trusted-ca-bundle\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:04.786667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786671    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmjfs\" (UniqueName: \"kubernetes.io/projected/5ec01832-3f1c-46ed-a54d-25ca8840708a-kube-api-access-nmjfs\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:04.786667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786681    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-service-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:04.787006 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786691    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-oauth-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:04.787006 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786700    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-oauth-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:04.787006 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:04.786710    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ec01832-3f1c-46ed-a54d-25ca8840708a-console-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:36:05.322797 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.322772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-789dd47cc7-n8bsn_5ec01832-3f1c-46ed-a54d-25ca8840708a/console/0.log"
May 29 17:36:05.322962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.322811    2558 generic.go:358] "Generic (PLEG): container finished" podID="5ec01832-3f1c-46ed-a54d-25ca8840708a" containerID="217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295" exitCode=2
May 29 17:36:05.322962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.322903    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-789dd47cc7-n8bsn"
May 29 17:36:05.322962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.322900    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dd47cc7-n8bsn" event={"ID":"5ec01832-3f1c-46ed-a54d-25ca8840708a","Type":"ContainerDied","Data":"217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295"}
May 29 17:36:05.322962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.322943    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-789dd47cc7-n8bsn" event={"ID":"5ec01832-3f1c-46ed-a54d-25ca8840708a","Type":"ContainerDied","Data":"3a8365c7228557ddb1a2dbd138a92b27fbcde742bf48332b01d8755897c570d7"}
May 29 17:36:05.322962 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.322960    2558 scope.go:117] "RemoveContainer" containerID="217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295"
May 29 17:36:05.331346 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.331202    2558 scope.go:117] "RemoveContainer" containerID="217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295"
May 29 17:36:05.331538 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:36:05.331460    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295\": container with ID starting with 217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295 not found: ID does not exist" containerID="217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295"
May 29 17:36:05.331538 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.331487    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295"} err="failed to get container status \"217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295\": rpc error: code = NotFound desc = could not find container \"217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295\": container with ID starting with 217ddb3148e4cba3c470c805e74bc2758145b593d3cf8773257ee76c705ad295 not found: ID does not exist"
May 29 17:36:05.342965 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.342942    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-789dd47cc7-n8bsn"]
May 29 17:36:05.346967 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.346948    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-789dd47cc7-n8bsn"]
May 29 17:36:05.510895 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:05.510860    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec01832-3f1c-46ed-a54d-25ca8840708a" path="/var/lib/kubelet/pods/5ec01832-3f1c-46ed-a54d-25ca8840708a/volumes"
May 29 17:36:40.185346 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.185265    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6594d7bc86-s6hps"]
May 29 17:36:40.185829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.185624    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec01832-3f1c-46ed-a54d-25ca8840708a" containerName="console"
May 29 17:36:40.185829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.185637    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec01832-3f1c-46ed-a54d-25ca8840708a" containerName="console"
May 29 17:36:40.185829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.185707    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="5ec01832-3f1c-46ed-a54d-25ca8840708a" containerName="console"
May 29 17:36:40.188471 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.188454    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.195893 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.195866    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6594d7bc86-s6hps"]
May 29 17:36:40.280868 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.280833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-trusted-ca-bundle\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.281054 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.280892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-serving-cert\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.281054 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.280928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-oauth-serving-cert\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.281054 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.280968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-oauth-config\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.281054 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.280995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-console-config\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.281054 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.281030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-service-ca\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.281235 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.281078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbgs\" (UniqueName: \"kubernetes.io/projected/028cef1b-2fdc-4882-800c-288b6927f44b-kube-api-access-kwbgs\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381584 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381551    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-trusted-ca-bundle\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381604    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-serving-cert\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381626    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-oauth-serving-cert\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381672    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-oauth-config\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381696    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-console-config\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381930 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381814    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-service-ca\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.381930 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.381865    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbgs\" (UniqueName: \"kubernetes.io/projected/028cef1b-2fdc-4882-800c-288b6927f44b-kube-api-access-kwbgs\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.382488 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.382462    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-console-config\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.382593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.382528    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-service-ca\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.382593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.382533    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-oauth-serving-cert\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.382593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.382548    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-trusted-ca-bundle\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.384637 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.384621    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-serving-cert\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.384779 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.384739    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-oauth-config\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.389437 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.389418    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbgs\" (UniqueName: \"kubernetes.io/projected/028cef1b-2fdc-4882-800c-288b6927f44b-kube-api-access-kwbgs\") pod \"console-6594d7bc86-s6hps\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") " pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.498308 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.498228    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:40.621591 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:40.621528    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6594d7bc86-s6hps"]
May 29 17:36:40.624353 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:36:40.624324    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028cef1b_2fdc_4882_800c_288b6927f44b.slice/crio-aa7b4c0372edb87f240d80249cbbee5564aa28e613243c753506ce1163a4e69a WatchSource:0}: Error finding container aa7b4c0372edb87f240d80249cbbee5564aa28e613243c753506ce1163a4e69a: Status 404 returned error can't find the container with id aa7b4c0372edb87f240d80249cbbee5564aa28e613243c753506ce1163a4e69a
May 29 17:36:41.428255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:41.428221    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6594d7bc86-s6hps" event={"ID":"028cef1b-2fdc-4882-800c-288b6927f44b","Type":"ContainerStarted","Data":"a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f"}
May 29 17:36:41.428626 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:41.428261    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6594d7bc86-s6hps" event={"ID":"028cef1b-2fdc-4882-800c-288b6927f44b","Type":"ContainerStarted","Data":"aa7b4c0372edb87f240d80249cbbee5564aa28e613243c753506ce1163a4e69a"}
May 29 17:36:41.449025 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:41.448973    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6594d7bc86-s6hps" podStartSLOduration=1.448955323 podStartE2EDuration="1.448955323s" podCreationTimestamp="2026-05-29 17:36:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:36:41.442031672 +0000 UTC m=+254.427853675" watchObservedRunningTime="2026-05-29 17:36:41.448955323 +0000 UTC m=+254.434777347"
May 29 17:36:50.498916 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:50.498882    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:50.498916 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:50.498925    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:50.503635 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:50.503612    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:51.463159 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:51.463128    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:36:51.511151 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:36:51.511119    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9f74f697-c7xqn"]
May 29 17:37:07.679991 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.679955    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zpvd7"]
May 29 17:37:07.683468 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.683453    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.685673 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.685657    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 17:37:07.691149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.691126    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zpvd7"]
May 29 17:37:07.818817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.818742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c4e6ae96-80a2-42da-aa01-c205a25ef616-kubelet-config\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.819002 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.818860    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c4e6ae96-80a2-42da-aa01-c205a25ef616-dbus\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.819002 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.818952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4e6ae96-80a2-42da-aa01-c205a25ef616-original-pull-secret\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.920179 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.920138    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4e6ae96-80a2-42da-aa01-c205a25ef616-original-pull-secret\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.920348 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.920204    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c4e6ae96-80a2-42da-aa01-c205a25ef616-kubelet-config\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.920348 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.920234    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c4e6ae96-80a2-42da-aa01-c205a25ef616-dbus\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.920348 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.920336    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c4e6ae96-80a2-42da-aa01-c205a25ef616-kubelet-config\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.920489 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.920418    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c4e6ae96-80a2-42da-aa01-c205a25ef616-dbus\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.922512 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.922489    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c4e6ae96-80a2-42da-aa01-c205a25ef616-original-pull-secret\") pod \"global-pull-secret-syncer-zpvd7\" (UID: \"c4e6ae96-80a2-42da-aa01-c205a25ef616\") " pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:07.993334 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:07.993241    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zpvd7"
May 29 17:37:08.119266 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:08.119198    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zpvd7"]
May 29 17:37:08.122107 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:37:08.122081    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e6ae96_80a2_42da_aa01_c205a25ef616.slice/crio-ae0e39f679d0c27634043d87054468d435e7042c87b5b698aa2f4fd1cf1d5e57 WatchSource:0}: Error finding container ae0e39f679d0c27634043d87054468d435e7042c87b5b698aa2f4fd1cf1d5e57: Status 404 returned error can't find the container with id ae0e39f679d0c27634043d87054468d435e7042c87b5b698aa2f4fd1cf1d5e57
May 29 17:37:08.507698 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:08.507668    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zpvd7" event={"ID":"c4e6ae96-80a2-42da-aa01-c205a25ef616","Type":"ContainerStarted","Data":"ae0e39f679d0c27634043d87054468d435e7042c87b5b698aa2f4fd1cf1d5e57"}
May 29 17:37:13.524416 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:13.524384    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zpvd7" event={"ID":"c4e6ae96-80a2-42da-aa01-c205a25ef616","Type":"ContainerStarted","Data":"7e7e7c13c34d6758bbb0921c56097bb5d589c3e7bd193de1ed36a94a01160300"}
May 29 17:37:13.538685 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:13.538632    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zpvd7" podStartSLOduration=2.162604954 podStartE2EDuration="6.538615339s" podCreationTimestamp="2026-05-29 17:37:07 +0000 UTC" firstStartedPulling="2026-05-29 17:37:08.123893345 +0000 UTC m=+281.109715313" lastFinishedPulling="2026-05-29 17:37:12.499903731 +0000 UTC m=+285.485725698" observedRunningTime="2026-05-29 17:37:13.537643434 +0000 UTC m=+286.523465427" watchObservedRunningTime="2026-05-29 17:37:13.538615339 +0000 UTC m=+286.524437329"
May 29 17:37:16.532828 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.532790    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c9f74f697-c7xqn" podUID="b2f2a4ef-5543-4582-9f34-f12c8af627f1" containerName="console" containerID="cri-o://25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722" gracePeriod=15
May 29 17:37:16.771149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.771127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c9f74f697-c7xqn_b2f2a4ef-5543-4582-9f34-f12c8af627f1/console/0.log"
May 29 17:37:16.771264 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.771187    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:37:16.792156 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792052    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qp4bt\" (UniqueName: \"kubernetes.io/projected/b2f2a4ef-5543-4582-9f34-f12c8af627f1-kube-api-access-qp4bt\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792156 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792105    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-trusted-ca-bundle\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792156 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792156    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-serving-cert\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792414 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792190    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-service-ca\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792414 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792239    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-oauth-serving-cert\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792414 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792295    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-oauth-config\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792414 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792318    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-config\") pod \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\" (UID: \"b2f2a4ef-5543-4582-9f34-f12c8af627f1\") "
May 29 17:37:16.792897 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.792854    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:37:16.793468 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.793077    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-config" (OuterVolumeSpecName: "console-config") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:37:16.793468 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.793171    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:37:16.793468 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.793341    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:37:16.794976 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.794943    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:37:16.795068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.794971    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f2a4ef-5543-4582-9f34-f12c8af627f1-kube-api-access-qp4bt" (OuterVolumeSpecName: "kube-api-access-qp4bt") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "kube-api-access-qp4bt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:37:16.795068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.795020    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2f2a4ef-5543-4582-9f34-f12c8af627f1" (UID: "b2f2a4ef-5543-4582-9f34-f12c8af627f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:37:16.892939 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892912    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-oauth-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:16.892939 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892938    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-oauth-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:16.893129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892950    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:16.893129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892959    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qp4bt\" (UniqueName: \"kubernetes.io/projected/b2f2a4ef-5543-4582-9f34-f12c8af627f1-kube-api-access-qp4bt\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:16.893129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892969    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-trusted-ca-bundle\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:16.893129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892977    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f2a4ef-5543-4582-9f34-f12c8af627f1-console-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:16.893129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:16.892988    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2f2a4ef-5543-4582-9f34-f12c8af627f1-service-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:37:17.541031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.541000    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c9f74f697-c7xqn_b2f2a4ef-5543-4582-9f34-f12c8af627f1/console/0.log"
May 29 17:37:17.541388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.541047    2558 generic.go:358] "Generic (PLEG): container finished" podID="b2f2a4ef-5543-4582-9f34-f12c8af627f1" containerID="25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722" exitCode=2
May 29 17:37:17.541388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.541115    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9f74f697-c7xqn" event={"ID":"b2f2a4ef-5543-4582-9f34-f12c8af627f1","Type":"ContainerDied","Data":"25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722"}
May 29 17:37:17.541388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.541121    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c9f74f697-c7xqn"
May 29 17:37:17.541388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.541147    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c9f74f697-c7xqn" event={"ID":"b2f2a4ef-5543-4582-9f34-f12c8af627f1","Type":"ContainerDied","Data":"2b80316929c10cb466385692eddac9b9abf2e7c136ca566d8cf40f0ce6c20ce2"}
May 29 17:37:17.541388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.541166    2558 scope.go:117] "RemoveContainer" containerID="25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722"
May 29 17:37:17.549134 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.549113    2558 scope.go:117] "RemoveContainer" containerID="25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722"
May 29 17:37:17.549368 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:37:17.549348    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722\": container with ID starting with 25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722 not found: ID does not exist" containerID="25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722"
May 29 17:37:17.549428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.549378    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722"} err="failed to get container status \"25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722\": rpc error: code = NotFound desc = could not find container \"25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722\": container with ID starting with 25543f8430c68588019f77dcfc35161eb4c4255118fc93394f9b17315449d722 not found: ID does not exist"
May 29 17:37:17.557833 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.557802    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c9f74f697-c7xqn"]
May 29 17:37:17.560978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:17.560957    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c9f74f697-c7xqn"]
May 29 17:37:19.510741 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:19.510704    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2f2a4ef-5543-4582-9f34-f12c8af627f1" path="/var/lib/kubelet/pods/b2f2a4ef-5543-4582-9f34-f12c8af627f1/volumes"
May 29 17:37:27.386277 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:27.386245    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:37:27.386775 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:27.386647    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:37:27.391035 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:37:27.391017    2558 kubelet.go:1628] "Image garbage collection succeeded"
May 29 17:39:03.550046 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.550010    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"]
May 29 17:39:03.550534 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.550375    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f2a4ef-5543-4582-9f34-f12c8af627f1" containerName="console"
May 29 17:39:03.550534 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.550388    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f2a4ef-5543-4582-9f34-f12c8af627f1" containerName="console"
May 29 17:39:03.550534 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.550456    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2f2a4ef-5543-4582-9f34-f12c8af627f1" containerName="console"
May 29 17:39:03.553341 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.553320    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:03.555862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.555838    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 29 17:39:03.555964 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.555850    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 29 17:39:03.556575 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.556554    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-l4c4m\""
May 29 17:39:03.569272 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.569247    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"]
May 29 17:39:03.653696 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.653663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj5bz\" (UniqueName: \"kubernetes.io/projected/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc-kube-api-access-gj5bz\") pod \"feast-operator-controller-manager-69fd94f688-v224b\" (UID: \"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc\") " pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:03.754641 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.754597    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj5bz\" (UniqueName: \"kubernetes.io/projected/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc-kube-api-access-gj5bz\") pod \"feast-operator-controller-manager-69fd94f688-v224b\" (UID: \"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc\") " pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:03.763719 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.763680    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj5bz\" (UniqueName: \"kubernetes.io/projected/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc-kube-api-access-gj5bz\") pod \"feast-operator-controller-manager-69fd94f688-v224b\" (UID: \"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc\") " pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:03.863134 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.863051    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:03.988085 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.988060    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"]
May 29 17:39:03.990895 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:39:03.990864    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcba1add_7201_4bc0_bcb1_5f4363f7f6cc.slice/crio-13009538ee4bb2208f457ee89d00a95b8260f6ce828105b72eaf305ae25847d3 WatchSource:0}: Error finding container 13009538ee4bb2208f457ee89d00a95b8260f6ce828105b72eaf305ae25847d3: Status 404 returned error can't find the container with id 13009538ee4bb2208f457ee89d00a95b8260f6ce828105b72eaf305ae25847d3
May 29 17:39:03.992648 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:03.992627    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:39:04.868785 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:04.868719    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b" event={"ID":"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc","Type":"ContainerStarted","Data":"13009538ee4bb2208f457ee89d00a95b8260f6ce828105b72eaf305ae25847d3"}
May 29 17:39:06.876110 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:06.876066    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b" event={"ID":"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc","Type":"ContainerStarted","Data":"2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7"}
May 29 17:39:06.876464 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:06.876206    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:06.893437 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:06.893396    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b" podStartSLOduration=1.646144149 podStartE2EDuration="3.893381731s" podCreationTimestamp="2026-05-29 17:39:03 +0000 UTC" firstStartedPulling="2026-05-29 17:39:03.992779135 +0000 UTC m=+396.978601102" lastFinishedPulling="2026-05-29 17:39:06.240016717 +0000 UTC m=+399.225838684" observedRunningTime="2026-05-29 17:39:06.892550432 +0000 UTC m=+399.878372420" watchObservedRunningTime="2026-05-29 17:39:06.893381731 +0000 UTC m=+399.879203720"
May 29 17:39:17.881479 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:17.881445    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:39:46.521905 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.521816    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"]
May 29 17:39:46.528254 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.528229    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.530946 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.530920    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 29 17:39:46.531106 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.530920    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 29 17:39:46.531535 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.531397    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-qxzqm\""
May 29 17:39:46.531535 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.531421    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 29 17:39:46.531535 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.531441    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 29 17:39:46.531728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.531567    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 29 17:39:46.531728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.531630    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 29 17:39:46.531871 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.531843    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 29 17:39:46.538360 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.537640    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"]
May 29 17:39:46.608078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.608040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94ff3277-1546-415e-87ce-14f609379fcb-feast-data\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.608078 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.608080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-offline-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.608293 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.608153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.608512 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.608482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.608650 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.608541    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbl9w\" (UniqueName: \"kubernetes.io/projected/94ff3277-1546-415e-87ce-14f609379fcb-kube-api-access-hbl9w\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.608650 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.608570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.709451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.709416    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.709461    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbl9w\" (UniqueName: \"kubernetes.io/projected/94ff3277-1546-415e-87ce-14f609379fcb-kube-api-access-hbl9w\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.709480    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.709524    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94ff3277-1546-415e-87ce-14f609379fcb-feast-data\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:39:46.709545    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:39:46.709596    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:39:46.709622    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls podName:94ff3277-1546-415e-87ce-14f609379fcb nodeName:}" failed. No retries permitted until 2026-05-29 17:39:47.209601798 +0000 UTC m=+440.195423765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls") pod "feast-simple-feast-setup-75dbb66f66-t6zsb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb") : secret "feast-simple-feast-setup-registry-tls" not found
May 29 17:39:46.709638 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.709548    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-offline-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.710029 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:39:46.709649    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls podName:94ff3277-1546-415e-87ce-14f609379fcb nodeName:}" failed. No retries permitted until 2026-05-29 17:39:47.209637125 +0000 UTC m=+440.195459100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls") pod "feast-simple-feast-setup-75dbb66f66-t6zsb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb") : secret "feast-simple-feast-setup-ui-tls" not found
May 29 17:39:46.710029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.709685    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.710374 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.710340    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94ff3277-1546-415e-87ce-14f609379fcb-feast-data\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.717483 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.717457    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.720011 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.719989    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-offline-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:46.721215 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:46.721192    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbl9w\" (UniqueName: \"kubernetes.io/projected/94ff3277-1546-415e-87ce-14f609379fcb-kube-api-access-hbl9w\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:47.214982 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.214949    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:47.215137 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.214991    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:47.217449 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.217424    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:47.217556 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.217426    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-t6zsb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:47.450712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.450680    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:39:47.587659 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.587634    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"]
May 29 17:39:47.590524 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:39:47.590496    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ff3277_1546_415e_87ce_14f609379fcb.slice/crio-3858f07eb82874ea66689219b5e285e1788aa3a7713dbc695e16e3517c55345d WatchSource:0}: Error finding container 3858f07eb82874ea66689219b5e285e1788aa3a7713dbc695e16e3517c55345d: Status 404 returned error can't find the container with id 3858f07eb82874ea66689219b5e285e1788aa3a7713dbc695e16e3517c55345d
May 29 17:39:47.999185 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:39:47.999152    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"3858f07eb82874ea66689219b5e285e1788aa3a7713dbc695e16e3517c55345d"}
May 29 17:40:18.098325 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:18.098292    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"}
May 29 17:40:22.112461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:22.112426    2558 generic.go:358] "Generic (PLEG): container finished" podID="94ff3277-1546-415e-87ce-14f609379fcb" containerID="9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c" exitCode=0
May 29 17:40:22.112927 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:22.112509    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"}
May 29 17:40:23.117241 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:23.117206    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"}
May 29 17:40:28.134204 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:28.134168    2558 generic.go:358] "Generic (PLEG): container finished" podID="94ff3277-1546-415e-87ce-14f609379fcb" containerID="88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418" exitCode=0
May 29 17:40:28.134568 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:28.134240    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"}
May 29 17:40:28.143141 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:28.143123    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 29 17:40:29.143702 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.143619    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"}
May 29 17:40:29.144165 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.143713    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"}
May 29 17:40:29.144165 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.143731    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"}
May 29 17:40:29.144165 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.143787    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerStarted","Data":"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"}
May 29 17:40:29.169077 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.169015    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podStartSLOduration=13.555206953 podStartE2EDuration="43.168996404s" podCreationTimestamp="2026-05-29 17:39:46 +0000 UTC" firstStartedPulling="2026-05-29 17:39:47.592238258 +0000 UTC m=+440.578060225" lastFinishedPulling="2026-05-29 17:40:17.206027709 +0000 UTC m=+470.191849676" observedRunningTime="2026-05-29 17:40:29.168069512 +0000 UTC m=+482.153891505" watchObservedRunningTime="2026-05-29 17:40:29.168996404 +0000 UTC m=+482.154818396"
May 29 17:40:29.174307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.174268    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7457f764c6-5n2fd"]
May 29 17:40:29.190765 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.190709    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7457f764c6-5n2fd"]
May 29 17:40:29.190938 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.190866    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295022 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.294961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-console-config\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.295105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-trusted-ca-bundle\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.295163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4659256-ccbb-4a68-a689-cf95b796bc57-console-serving-cert\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295353 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.295251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4659256-ccbb-4a68-a689-cf95b796bc57-console-oauth-config\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295353 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.295286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4pnw\" (UniqueName: \"kubernetes.io/projected/c4659256-ccbb-4a68-a689-cf95b796bc57-kube-api-access-j4pnw\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295463 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.295349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-service-ca\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.295463 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.295376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-oauth-serving-cert\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396569    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4659256-ccbb-4a68-a689-cf95b796bc57-console-serving-cert\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396658    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4659256-ccbb-4a68-a689-cf95b796bc57-console-oauth-config\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396687    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4pnw\" (UniqueName: \"kubernetes.io/projected/c4659256-ccbb-4a68-a689-cf95b796bc57-kube-api-access-j4pnw\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396738    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-service-ca\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396790    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-oauth-serving-cert\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396858    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-console-config\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.396960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.396905    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-trusted-ca-bundle\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.398693 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.398469    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-trusted-ca-bundle\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.398693 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.398622    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-console-config\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.401667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.400161    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-oauth-serving-cert\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.401667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.400403    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c4659256-ccbb-4a68-a689-cf95b796bc57-service-ca\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.401667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.401102    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c4659256-ccbb-4a68-a689-cf95b796bc57-console-oauth-config\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.401667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.401611    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c4659256-ccbb-4a68-a689-cf95b796bc57-console-serving-cert\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.406258 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.406232    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4pnw\" (UniqueName: \"kubernetes.io/projected/c4659256-ccbb-4a68-a689-cf95b796bc57-kube-api-access-j4pnw\") pod \"console-7457f764c6-5n2fd\" (UID: \"c4659256-ccbb-4a68-a689-cf95b796bc57\") " pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.451430 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.451291    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:29.451430 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.451339    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:29.451430 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.451354    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:29.451430 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.451366    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:29.453456 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.453404    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 29 17:40:29.453599 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.453456    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 29 17:40:29.453599 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.453469    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.31:8816: connect: connection refused"
May 29 17:40:29.453725 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.453701    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 29 17:40:29.505182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.505138    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:29.680253 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:29.680216    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7457f764c6-5n2fd"]
May 29 17:40:30.151489 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:30.151376    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7457f764c6-5n2fd" event={"ID":"c4659256-ccbb-4a68-a689-cf95b796bc57","Type":"ContainerStarted","Data":"3d3cc1ae0276735fdcb5730eac8d21b0135dc889f0d3e7ba566abbed670dd8fb"}
May 29 17:40:30.151489 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:30.151429    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7457f764c6-5n2fd" event={"ID":"c4659256-ccbb-4a68-a689-cf95b796bc57","Type":"ContainerStarted","Data":"13fdfc0fcc0040d831c2b227f6f4e27702408afd9b229c6b18b88158df9e2b79"}
May 29 17:40:30.169712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:30.169239    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7457f764c6-5n2fd" podStartSLOduration=1.169217746 podStartE2EDuration="1.169217746s" podCreationTimestamp="2026-05-29 17:40:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:40:30.169105946 +0000 UTC m=+483.154927963" watchObservedRunningTime="2026-05-29 17:40:30.169217746 +0000 UTC m=+483.155039736"
May 29 17:40:32.451562 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:32.451515    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.31:8816: connect: connection refused"
May 29 17:40:32.452146 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:32.451544    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.31:6571: connect: connection refused"
May 29 17:40:32.452337 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:32.451610    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 29 17:40:32.452337 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:32.451646    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 29 17:40:35.452206 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.452174    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.452667 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.452496    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.452915 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.452891    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.453021 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.452923    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.453021 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.452969    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.453021 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.452999    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.453117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.453097    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:35.456797 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:35.456780    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:36.174676 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:36.174639    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:36.174676 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:36.174683    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:36.175370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:36.175349    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:36.177736 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:36.177714    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:40:39.505863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:39.505810    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:39.505863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:39.505862    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:39.511700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:39.511675    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:40.190614 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:40.190583    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7457f764c6-5n2fd"
May 29 17:40:40.234637 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:40:40.234603    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6594d7bc86-s6hps"]
May 29 17:41:05.255598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.255538    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6594d7bc86-s6hps" podUID="028cef1b-2fdc-4882-800c-288b6927f44b" containerName="console" containerID="cri-o://a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f" gracePeriod=15
May 29 17:41:05.513950 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.513896    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6594d7bc86-s6hps_028cef1b-2fdc-4882-800c-288b6927f44b/console/0.log"
May 29 17:41:05.514053 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.513953    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:41:05.610506 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610478    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-trusted-ca-bundle\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.610662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610537    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-serving-cert\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.610662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610574    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-oauth-serving-cert\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.610662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610592    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-console-config\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.610662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610615    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwbgs\" (UniqueName: \"kubernetes.io/projected/028cef1b-2fdc-4882-800c-288b6927f44b-kube-api-access-kwbgs\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.610662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610633    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-service-ca\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.610662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.610653    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-oauth-config\") pod \"028cef1b-2fdc-4882-800c-288b6927f44b\" (UID: \"028cef1b-2fdc-4882-800c-288b6927f44b\") "
May 29 17:41:05.611075 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.611044    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:41:05.611143 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.611066    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:41:05.611143 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.611079    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-console-config" (OuterVolumeSpecName: "console-config") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:41:05.611143 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.611090    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-service-ca" (OuterVolumeSpecName: "service-ca") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:41:05.612800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.612775    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:41:05.612920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.612903    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:41:05.612976 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.612937    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/028cef1b-2fdc-4882-800c-288b6927f44b-kube-api-access-kwbgs" (OuterVolumeSpecName: "kube-api-access-kwbgs") pod "028cef1b-2fdc-4882-800c-288b6927f44b" (UID: "028cef1b-2fdc-4882-800c-288b6927f44b"). InnerVolumeSpecName "kube-api-access-kwbgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:41:05.712161 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712128    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-trusted-ca-bundle\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:05.712161 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712155    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:05.712161 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712165    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-oauth-serving-cert\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:05.712362 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712187    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-console-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:05.712362 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712196    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwbgs\" (UniqueName: \"kubernetes.io/projected/028cef1b-2fdc-4882-800c-288b6927f44b-kube-api-access-kwbgs\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:05.712362 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712206    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/028cef1b-2fdc-4882-800c-288b6927f44b-service-ca\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:05.712362 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:05.712215    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/028cef1b-2fdc-4882-800c-288b6927f44b-console-oauth-config\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:41:06.272828 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.272801    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6594d7bc86-s6hps_028cef1b-2fdc-4882-800c-288b6927f44b/console/0.log"
May 29 17:41:06.273230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.272840    2558 generic.go:358] "Generic (PLEG): container finished" podID="028cef1b-2fdc-4882-800c-288b6927f44b" containerID="a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f" exitCode=2
May 29 17:41:06.273230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.272874    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6594d7bc86-s6hps" event={"ID":"028cef1b-2fdc-4882-800c-288b6927f44b","Type":"ContainerDied","Data":"a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f"}
May 29 17:41:06.273230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.272901    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6594d7bc86-s6hps" event={"ID":"028cef1b-2fdc-4882-800c-288b6927f44b","Type":"ContainerDied","Data":"aa7b4c0372edb87f240d80249cbbee5564aa28e613243c753506ce1163a4e69a"}
May 29 17:41:06.273230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.272913    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6594d7bc86-s6hps"
May 29 17:41:06.273230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.272919    2558 scope.go:117] "RemoveContainer" containerID="a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f"
May 29 17:41:06.281303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.281285    2558 scope.go:117] "RemoveContainer" containerID="a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f"
May 29 17:41:06.281521 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:06.281505    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f\": container with ID starting with a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f not found: ID does not exist" containerID="a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f"
May 29 17:41:06.281565 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.281527    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f"} err="failed to get container status \"a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f\": rpc error: code = NotFound desc = could not find container \"a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f\": container with ID starting with a5a97c32d8c6b88213679c447e4d0e3952e5adb0743e33ff4cda38eab601335f not found: ID does not exist"
May 29 17:41:06.293356 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.293330    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6594d7bc86-s6hps"]
May 29 17:41:06.296934 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:06.296912    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6594d7bc86-s6hps"]
May 29 17:41:07.510865 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:07.510831    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="028cef1b-2fdc-4882-800c-288b6927f44b" path="/var/lib/kubelet/pods/028cef1b-2fdc-4882-800c-288b6927f44b/volumes"
May 29 17:41:37.844874 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:37.844832    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"]
May 29 17:41:37.845450 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:37.845264    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="registry" containerID="cri-o://e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24" gracePeriod=30
May 29 17:41:37.845450 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:37.845350    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online" containerID="cri-o://4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e" gracePeriod=30
May 29 17:41:37.845573 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:37.845344    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="offline" containerID="cri-o://3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f" gracePeriod=30
May 29 17:41:37.845573 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:37.845432    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui" containerID="cri-o://8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad" gracePeriod=30
May 29 17:41:38.090267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.088790    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"]
May 29 17:41:38.090267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.089352    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="028cef1b-2fdc-4882-800c-288b6927f44b" containerName="console"
May 29 17:41:38.090267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.089379    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="028cef1b-2fdc-4882-800c-288b6927f44b" containerName="console"
May 29 17:41:38.090267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.089494    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="028cef1b-2fdc-4882-800c-288b6927f44b" containerName="console"
May 29 17:41:38.093229 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.093206    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.095783 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.095699    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pj2ck\""
May 29 17:41:38.111810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.111778    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"]
May 29 17:41:38.171688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.171649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-offline-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.171994 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.171961    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54rz\" (UniqueName: \"kubernetes.io/projected/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-kube-api-access-n54rz\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.172712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.172687    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-feast-data\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.172841 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.172778    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.172841 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.172810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.172953 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.172846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274130 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274082    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274130 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274137    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274177    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274225    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-offline-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274263    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n54rz\" (UniqueName: \"kubernetes.io/projected/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-kube-api-access-n54rz\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274417 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:38.274270    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 29 17:41:38.274417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274299    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-feast-data\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.274417 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:38.274389    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls podName:9adc5572-99b6-45b5-ac73-75d9ef90c7f8 nodeName:}" failed. No retries permitted until 2026-05-29 17:41:38.774342927 +0000 UTC m=+551.760164894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls") pod "feast-simple-feast-setup-75dbb66f66-5vdms" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8") : secret "feast-simple-feast-setup-online-tls" not found
May 29 17:41:38.275090 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:38.274805    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 29 17:41:38.275090 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.274817    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-feast-data\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.275090 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:38.274874    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls podName:9adc5572-99b6-45b5-ac73-75d9ef90c7f8 nodeName:}" failed. No retries permitted until 2026-05-29 17:41:38.77484166 +0000 UTC m=+551.760663634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls") pod "feast-simple-feast-setup-75dbb66f66-5vdms" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8") : secret "feast-simple-feast-setup-registry-tls" not found
May 29 17:41:38.275090 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:38.274976    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 29 17:41:38.275090 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:41:38.275031    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls podName:9adc5572-99b6-45b5-ac73-75d9ef90c7f8 nodeName:}" failed. No retries permitted until 2026-05-29 17:41:38.775018473 +0000 UTC m=+551.760840458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls") pod "feast-simple-feast-setup-75dbb66f66-5vdms" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8") : secret "feast-simple-feast-setup-ui-tls" not found
May 29 17:41:38.277728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.277682    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-offline-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.284031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.283977    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54rz\" (UniqueName: \"kubernetes.io/projected/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-kube-api-access-n54rz\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.779550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.779459    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.779550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.779504    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.779745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.779646    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.782048 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.782020    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.782048 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.782042    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:38.782188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:38.782023    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls\") pod \"feast-simple-feast-setup-75dbb66f66-5vdms\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") " pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:39.008887 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.008843    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:39.151416 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.151387    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"]
May 29 17:41:39.153353 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:41:39.153316    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9adc5572_99b6_45b5_ac73_75d9ef90c7f8.slice/crio-c9a7ad72170dcfdeb4f872e1e041b38f1ebc5791c1bc1573b1056aa4b1f121c0 WatchSource:0}: Error finding container c9a7ad72170dcfdeb4f872e1e041b38f1ebc5791c1bc1573b1056aa4b1f121c0: Status 404 returned error can't find the container with id c9a7ad72170dcfdeb4f872e1e041b38f1ebc5791c1bc1573b1056aa4b1f121c0
May 29 17:41:39.383589 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.383487    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"}
May 29 17:41:39.383589 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.383539    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"c9a7ad72170dcfdeb4f872e1e041b38f1ebc5791c1bc1573b1056aa4b1f121c0"}
May 29 17:41:39.387706 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.387676    2558 generic.go:358] "Generic (PLEG): container finished" podID="94ff3277-1546-415e-87ce-14f609379fcb" containerID="8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad" exitCode=0
May 29 17:41:39.387706 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.387705    2558 generic.go:358] "Generic (PLEG): container finished" podID="94ff3277-1546-415e-87ce-14f609379fcb" containerID="4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e" exitCode=0
May 29 17:41:39.387880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.387787    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"}
May 29 17:41:39.387880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:39.387810    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"}
May 29 17:41:44.403882 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:44.403846    2558 generic.go:358] "Generic (PLEG): container finished" podID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerID="278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a" exitCode=0
May 29 17:41:44.404268 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:44.403919    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"}
May 29 17:41:45.409144 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:45.409112    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"}
May 29 17:41:46.174995 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:46.174950    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 29 17:41:46.174995 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:46.174973    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 29 17:41:50.426096 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:50.426064    2558 generic.go:358] "Generic (PLEG): container finished" podID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerID="aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650" exitCode=0
May 29 17:41:50.426605 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:50.426133    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"}
May 29 17:41:51.434196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:51.434153    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"}
May 29 17:41:51.434671 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:51.434203    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"}
May 29 17:41:51.434671 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:51.434217    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"}
May 29 17:41:51.434671 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:51.434231    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerStarted","Data":"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"}
May 29 17:41:51.456302 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:51.456243    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podStartSLOduration=13.456224435 podStartE2EDuration="13.456224435s" podCreationTimestamp="2026-05-29 17:41:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:41:51.454983503 +0000 UTC m=+564.440805495" watchObservedRunningTime="2026-05-29 17:41:51.456224435 +0000 UTC m=+564.442046425"
May 29 17:41:54.009125 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.009084    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:54.009712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.009687    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:54.009712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.009713    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:54.009712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.009726    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:54.011644 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.011496    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 29 17:41:54.011644 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.011516    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
May 29 17:41:54.011644 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.011548    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
May 29 17:41:54.011644 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:54.011504    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 29 17:41:56.175566 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:56.175519    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 29 17:41:56.176009 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:56.175646    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 29 17:41:57.010094 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.010058    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.010252 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.010200    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.010489 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.010470    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.010861 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.010789    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.010861 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.010822    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.010861 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.010837    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.011205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.011187    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.011259 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.011248    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.011304 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.011294    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.014999 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.014982    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.466814 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.466782    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:41:57.469826 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:41:57.469804    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:42:06.175104 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:06.175055    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.31:8443: connect: connection refused"
May 29 17:42:06.175465 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:06.175081    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online" probeResult="failure" output="Get \"https://10.134.0.31:6567/health\": dial tcp 10.134.0.31:6567: connect: connection refused"
May 29 17:42:06.175465 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:06.175189    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:42:06.175465 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:06.175234    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:42:08.496569 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.496543    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:42:08.500556 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500530    2558 generic.go:358] "Generic (PLEG): container finished" podID="94ff3277-1546-415e-87ce-14f609379fcb" containerID="3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f" exitCode=137
May 29 17:42:08.500556 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500555    2558 generic.go:358] "Generic (PLEG): container finished" podID="94ff3277-1546-415e-87ce-14f609379fcb" containerID="e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24" exitCode=137
May 29 17:42:08.500725 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500602    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"
May 29 17:42:08.500725 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500600    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"}
May 29 17:42:08.500725 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500714    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"}
May 29 17:42:08.500896 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500730    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb" event={"ID":"94ff3277-1546-415e-87ce-14f609379fcb","Type":"ContainerDied","Data":"3858f07eb82874ea66689219b5e285e1788aa3a7713dbc695e16e3517c55345d"}
May 29 17:42:08.500896 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.500768    2558 scope.go:117] "RemoveContainer" containerID="8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"
May 29 17:42:08.509148 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.509123    2558 scope.go:117] "RemoveContainer" containerID="3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"
May 29 17:42:08.516394 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.516372    2558 scope.go:117] "RemoveContainer" containerID="4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"
May 29 17:42:08.524993 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.524966    2558 scope.go:117] "RemoveContainer" containerID="e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"
May 29 17:42:08.532869 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.532846    2558 scope.go:117] "RemoveContainer" containerID="88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"
May 29 17:42:08.540501 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.540480    2558 scope.go:117] "RemoveContainer" containerID="9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"
May 29 17:42:08.547594 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.547580    2558 scope.go:117] "RemoveContainer" containerID="8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"
May 29 17:42:08.547960 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:42:08.547939    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad\": container with ID starting with 8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad not found: ID does not exist" containerID="8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"
May 29 17:42:08.548025 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.547972    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"} err="failed to get container status \"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad\": rpc error: code = NotFound desc = could not find container \"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad\": container with ID starting with 8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad not found: ID does not exist"
May 29 17:42:08.548025 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.547998    2558 scope.go:117] "RemoveContainer" containerID="3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"
May 29 17:42:08.548236 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:42:08.548217    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f\": container with ID starting with 3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f not found: ID does not exist" containerID="3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"
May 29 17:42:08.548324 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548241    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"} err="failed to get container status \"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f\": rpc error: code = NotFound desc = could not find container \"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f\": container with ID starting with 3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f not found: ID does not exist"
May 29 17:42:08.548324 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548256    2558 scope.go:117] "RemoveContainer" containerID="4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"
May 29 17:42:08.548476 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:42:08.548457    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e\": container with ID starting with 4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e not found: ID does not exist" containerID="4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"
May 29 17:42:08.548514 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548482    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"} err="failed to get container status \"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e\": rpc error: code = NotFound desc = could not find container \"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e\": container with ID starting with 4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e not found: ID does not exist"
May 29 17:42:08.548514 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548498    2558 scope.go:117] "RemoveContainer" containerID="e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"
May 29 17:42:08.548672 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:42:08.548655    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24\": container with ID starting with e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24 not found: ID does not exist" containerID="e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"
May 29 17:42:08.548712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548687    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"} err="failed to get container status \"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24\": rpc error: code = NotFound desc = could not find container \"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24\": container with ID starting with e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24 not found: ID does not exist"
May 29 17:42:08.548712 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548699    2558 scope.go:117] "RemoveContainer" containerID="88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"
May 29 17:42:08.548932 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:42:08.548917    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418\": container with ID starting with 88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418 not found: ID does not exist" containerID="88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"
May 29 17:42:08.548984 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548934    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"} err="failed to get container status \"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418\": rpc error: code = NotFound desc = could not find container \"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418\": container with ID starting with 88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418 not found: ID does not exist"
May 29 17:42:08.548984 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.548948    2558 scope.go:117] "RemoveContainer" containerID="9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"
May 29 17:42:08.549170 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:42:08.549153    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c\": container with ID starting with 9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c not found: ID does not exist" containerID="9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"
May 29 17:42:08.549206 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549175    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"} err="failed to get container status \"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c\": rpc error: code = NotFound desc = could not find container \"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c\": container with ID starting with 9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c not found: ID does not exist"
May 29 17:42:08.549206 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549189    2558 scope.go:117] "RemoveContainer" containerID="8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"
May 29 17:42:08.549415 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549398    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad"} err="failed to get container status \"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad\": rpc error: code = NotFound desc = could not find container \"8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad\": container with ID starting with 8a457eb41afb35ea46741e2884f14a8cce3d0642fbde7812a6073fbbfac24bad not found: ID does not exist"
May 29 17:42:08.549461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549415    2558 scope.go:117] "RemoveContainer" containerID="3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"
May 29 17:42:08.549620 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549596    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f"} err="failed to get container status \"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f\": rpc error: code = NotFound desc = could not find container \"3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f\": container with ID starting with 3a979e3460f7b731f8b66da42d628bb3423f5ba43834454d3c9fd4a76df8b88f not found: ID does not exist"
May 29 17:42:08.549699 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549624    2558 scope.go:117] "RemoveContainer" containerID="4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"
May 29 17:42:08.549829 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549814    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e"} err="failed to get container status \"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e\": rpc error: code = NotFound desc = could not find container \"4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e\": container with ID starting with 4f1f453f7f3bda34bd35ba5497ca4c603d2284e80dd18d5c6c128744eab0360e not found: ID does not exist"
May 29 17:42:08.549869 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.549829    2558 scope.go:117] "RemoveContainer" containerID="e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"
May 29 17:42:08.550036 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.550017    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24"} err="failed to get container status \"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24\": rpc error: code = NotFound desc = could not find container \"e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24\": container with ID starting with e8b11598037c131c2134d3b602e647ac0483f246b80fa47aa59e4ee321220d24 not found: ID does not exist"
May 29 17:42:08.550094 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.550036    2558 scope.go:117] "RemoveContainer" containerID="88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"
May 29 17:42:08.550200 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.550187    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418"} err="failed to get container status \"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418\": rpc error: code = NotFound desc = could not find container \"88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418\": container with ID starting with 88e0cb850a708e1df075431b82c4f8bbd111a20c4a734cdb58cc5437b2a8a418 not found: ID does not exist"
May 29 17:42:08.550237 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.550200    2558 scope.go:117] "RemoveContainer" containerID="9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"
May 29 17:42:08.550364 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.550338    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c"} err="failed to get container status \"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c\": rpc error: code = NotFound desc = could not find container \"9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c\": container with ID starting with 9d4bf40d7b857b709d6f696496d60674e2e88e5f4c33ee9d0e52bfd013eb920c not found: ID does not exist"
May 29 17:42:08.645205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645120    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94ff3277-1546-415e-87ce-14f609379fcb-feast-data\") pod \"94ff3277-1546-415e-87ce-14f609379fcb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") "
May 29 17:42:08.645205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645161    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-offline-tls\") pod \"94ff3277-1546-415e-87ce-14f609379fcb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") "
May 29 17:42:08.645205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645201    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbl9w\" (UniqueName: \"kubernetes.io/projected/94ff3277-1546-415e-87ce-14f609379fcb-kube-api-access-hbl9w\") pod \"94ff3277-1546-415e-87ce-14f609379fcb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") "
May 29 17:42:08.645460 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645233    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls\") pod \"94ff3277-1546-415e-87ce-14f609379fcb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") "
May 29 17:42:08.645460 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645262    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-online-tls\") pod \"94ff3277-1546-415e-87ce-14f609379fcb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") "
May 29 17:42:08.645460 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645318    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls\") pod \"94ff3277-1546-415e-87ce-14f609379fcb\" (UID: \"94ff3277-1546-415e-87ce-14f609379fcb\") "
May 29 17:42:08.645695 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.645670    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94ff3277-1546-415e-87ce-14f609379fcb-feast-data" (OuterVolumeSpecName: "feast-data") pod "94ff3277-1546-415e-87ce-14f609379fcb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:42:08.647716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.647691    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "94ff3277-1546-415e-87ce-14f609379fcb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:42:08.647910 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.647871    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ff3277-1546-415e-87ce-14f609379fcb-kube-api-access-hbl9w" (OuterVolumeSpecName: "kube-api-access-hbl9w") pod "94ff3277-1546-415e-87ce-14f609379fcb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb"). InnerVolumeSpecName "kube-api-access-hbl9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:42:08.647910 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.647879    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "94ff3277-1546-415e-87ce-14f609379fcb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:42:08.647910 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.647889    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "94ff3277-1546-415e-87ce-14f609379fcb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:42:08.648071 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.647949    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-online-tls" (OuterVolumeSpecName: "online-tls") pod "94ff3277-1546-415e-87ce-14f609379fcb" (UID: "94ff3277-1546-415e-87ce-14f609379fcb"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:42:08.746673 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.746638    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:42:08.746673 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.746666    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/94ff3277-1546-415e-87ce-14f609379fcb-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:42:08.746673 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.746675    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:42:08.746978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.746684    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbl9w\" (UniqueName: \"kubernetes.io/projected/94ff3277-1546-415e-87ce-14f609379fcb-kube-api-access-hbl9w\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:42:08.746978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.746696    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:42:08.746978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.746705    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/94ff3277-1546-415e-87ce-14f609379fcb-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:42:08.823417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.823385    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"]
May 29 17:42:08.826377 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:08.826338    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-t6zsb"]
May 29 17:42:09.510481 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:09.510448    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ff3277-1546-415e-87ce-14f609379fcb" path="/var/lib/kubelet/pods/94ff3277-1546-415e-87ce-14f609379fcb/volumes"
May 29 17:42:27.410188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:27.410164    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:42:27.412000 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:27.411977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:42:59.845815 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.845743    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"]
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846262    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846282    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846296    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="feast-apply"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846305    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="feast-apply"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846315    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846324    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846357    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="offline"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846366    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="offline"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846399    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="registry"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846407    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="registry"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846423    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="feast-init"
May 29 17:42:59.846472 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846432    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="feast-init"
May 29 17:42:59.847122 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846521    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="registry"
May 29 17:42:59.847122 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846535    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="offline"
May 29 17:42:59.847122 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846544    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="ui"
May 29 17:42:59.847122 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.846560    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="94ff3277-1546-415e-87ce-14f609379fcb" containerName="online"
May 29 17:42:59.850077 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.850046    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:42:59.852534 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852506    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 29 17:42:59.852700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852506    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 29 17:42:59.852862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852573    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 29 17:42:59.853015 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852593    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 29 17:42:59.853082 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852667    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-wqgdp\""
May 29 17:42:59.853147 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852797    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 29 17:42:59.853203 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852830    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 29 17:42:59.853203 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.852938    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 29 17:42:59.861512 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.861488    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"]
May 29 17:42:59.945937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.945901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:42:59.946132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.945952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shdqs\" (UniqueName: \"kubernetes.io/projected/5644a06c-4361-4295-b67c-0adc005ba56c-kube-api-access-shdqs\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:42:59.946132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.946038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:42:59.946132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.946075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5644a06c-4361-4295-b67c-0adc005ba56c-feast-data\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:42:59.946132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.946104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5644a06c-4361-4295-b67c-0adc005ba56c-registry-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:42:59.946132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:42:59.946128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-offline-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047108 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047070    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5644a06c-4361-4295-b67c-0adc005ba56c-feast-data\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047115    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5644a06c-4361-4295-b67c-0adc005ba56c-registry-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047135    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-offline-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047168    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047201    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shdqs\" (UniqueName: \"kubernetes.io/projected/5644a06c-4361-4295-b67c-0adc005ba56c-kube-api-access-shdqs\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047240    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047564 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:43:00.047352    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 29 17:43:00.047564 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:43:00.047368    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 29 17:43:00.047564 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:43:00.047449    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls podName:5644a06c-4361-4295-b67c-0adc005ba56c nodeName:}" failed. No retries permitted until 2026-05-29 17:43:00.547424083 +0000 UTC m=+633.533246066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls") pod "feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 29 17:43:00.047564 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:43:00.047470    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls podName:5644a06c-4361-4295-b67c-0adc005ba56c nodeName:}" failed. No retries permitted until 2026-05-29 17:43:00.547461133 +0000 UTC m=+633.533283131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls") pod "feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 29 17:43:00.047902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047874    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5644a06c-4361-4295-b67c-0adc005ba56c-feast-data\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.047902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.047895    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5644a06c-4361-4295-b67c-0adc005ba56c-registry-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.050024 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.049999    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-offline-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.055270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.055244    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shdqs\" (UniqueName: \"kubernetes.io/projected/5644a06c-4361-4295-b67c-0adc005ba56c-kube-api-access-shdqs\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.552478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.552442    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.552655 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.552501    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.554904 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.554879    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.555025 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.554914    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls\") pod \"feast-simple-feast-remote-setup-6f567bbdf9-zhqcv\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.763291 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.763245    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:00.899654 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:00.899611    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"]
May 29 17:43:00.903397 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:43:00.903369    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5644a06c_4361_4295_b67c_0adc005ba56c.slice/crio-4842682bf33aac27fd47869225453ce05cdbda830aaf99b66788b201fa01770e WatchSource:0}: Error finding container 4842682bf33aac27fd47869225453ce05cdbda830aaf99b66788b201fa01770e: Status 404 returned error can't find the container with id 4842682bf33aac27fd47869225453ce05cdbda830aaf99b66788b201fa01770e
May 29 17:43:01.653024 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:01.652990    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerStarted","Data":"17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632"}
May 29 17:43:01.653024 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:01.653027    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerStarted","Data":"4842682bf33aac27fd47869225453ce05cdbda830aaf99b66788b201fa01770e"}
May 29 17:43:05.668297 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:05.668199    2558 generic.go:358] "Generic (PLEG): container finished" podID="5644a06c-4361-4295-b67c-0adc005ba56c" containerID="17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632" exitCode=0
May 29 17:43:05.668297 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:05.668241    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerDied","Data":"17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632"}
May 29 17:43:06.673213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:06.673178    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerStarted","Data":"6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88"}
May 29 17:43:11.699149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:11.699119    2558 generic.go:358] "Generic (PLEG): container finished" podID="5644a06c-4361-4295-b67c-0adc005ba56c" containerID="6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88" exitCode=0
May 29 17:43:11.699508 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:11.699193    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerDied","Data":"6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88"}
May 29 17:43:12.706024 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.705985    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerStarted","Data":"ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf"}
May 29 17:43:12.706425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.706041    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerStarted","Data":"89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d"}
May 29 17:43:12.706425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.706058    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerStarted","Data":"fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6"}
May 29 17:43:12.731886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.731829    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podStartSLOduration=13.731811748 podStartE2EDuration="13.731811748s" podCreationTimestamp="2026-05-29 17:42:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:43:12.728064644 +0000 UTC m=+645.713886631" watchObservedRunningTime="2026-05-29 17:43:12.731811748 +0000 UTC m=+645.717633737"
May 29 17:43:12.764405 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.764373    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:12.764405 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.764414    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:12.764639 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.764429    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:12.766498 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.766466    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
May 29 17:43:12.766498 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.766489    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
May 29 17:43:12.766695 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:12.766518    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
May 29 17:43:15.763848 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:15.763804    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
May 29 17:43:15.764302 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:15.763888    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
May 29 17:43:15.764302 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:15.763804    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
May 29 17:43:18.764924 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.764894    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:18.765317 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.765002    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:18.765422 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.765403    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:18.765491 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.765433    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:18.765623 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.765606    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:18.765862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.765848    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:18.769132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:18.769119    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:19.737842 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:19.737810    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:43:19.740678 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:43:19.740660    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:44:21.161569 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.161537    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"]
May 29 17:44:21.162081 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.161907    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online" containerID="cri-o://fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6" gracePeriod=30
May 29 17:44:21.162081 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.162018    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui" containerID="cri-o://ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf" gracePeriod=30
May 29 17:44:21.162081 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.162057    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="offline" containerID="cri-o://89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d" gracePeriod=30
May 29 17:44:21.279904 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.279871    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"]
May 29 17:44:21.280221 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.280192    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="registry" containerID="cri-o://8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174" gracePeriod=30
May 29 17:44:21.280416 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.280247    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="offline" containerID="cri-o://c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5" gracePeriod=30
May 29 17:44:21.280496 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.280274    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online" containerID="cri-o://c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a" gracePeriod=30
May 29 17:44:21.280575 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.280320    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui" containerID="cri-o://bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833" gracePeriod=30
May 29 17:44:21.926992 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.926959    2558 generic.go:358] "Generic (PLEG): container finished" podID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerID="bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833" exitCode=0
May 29 17:44:21.927154 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.927029    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"}
May 29 17:44:21.929258 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.929232    2558 generic.go:358] "Generic (PLEG): container finished" podID="5644a06c-4361-4295-b67c-0adc005ba56c" containerID="ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf" exitCode=0
May 29 17:44:21.929258 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.929252    2558 generic.go:358] "Generic (PLEG): container finished" podID="5644a06c-4361-4295-b67c-0adc005ba56c" containerID="fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6" exitCode=0
May 29 17:44:21.929405 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.929283    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerDied","Data":"ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf"}
May 29 17:44:21.929405 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:21.929304    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerDied","Data":"fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6"}
May 29 17:44:22.934800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:22.934766    2558 generic.go:358] "Generic (PLEG): container finished" podID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerID="c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a" exitCode=0
May 29 17:44:22.934800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:22.934788    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"}
May 29 17:44:27.011278 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:27.011221    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 29 17:44:27.467937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:27.467893    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 29 17:44:28.766041 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:28.766000    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
May 29 17:44:29.738372 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:29.738318    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
May 29 17:44:37.011852 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:37.011807    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 29 17:44:37.467267 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:37.467219    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 29 17:44:38.765844 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:38.765797    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
May 29 17:44:39.738652 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:39.738606    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
May 29 17:44:47.011188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:47.011133    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
May 29 17:44:47.011687 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:47.011319    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:44:47.466989 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:47.466946    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
May 29 17:44:47.467172 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:47.467075    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:44:48.765989 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:48.765949    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
May 29 17:44:48.766428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:48.766069    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:44:49.738117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:49.738078    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
May 29 17:44:49.738304 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:49.738191    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:44:51.394424 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.394400    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:44:51.503522 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.503496    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-offline-tls\") pod \"5644a06c-4361-4295-b67c-0adc005ba56c\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") "
May 29 17:44:51.503665 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.503573    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5644a06c-4361-4295-b67c-0adc005ba56c-feast-data\") pod \"5644a06c-4361-4295-b67c-0adc005ba56c\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") "
May 29 17:44:51.503665 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.503602    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls\") pod \"5644a06c-4361-4295-b67c-0adc005ba56c\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") "
May 29 17:44:51.503665 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.503625    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls\") pod \"5644a06c-4361-4295-b67c-0adc005ba56c\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") "
May 29 17:44:51.503665 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.503649    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shdqs\" (UniqueName: \"kubernetes.io/projected/5644a06c-4361-4295-b67c-0adc005ba56c-kube-api-access-shdqs\") pod \"5644a06c-4361-4295-b67c-0adc005ba56c\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") "
May 29 17:44:51.503886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.503671    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5644a06c-4361-4295-b67c-0adc005ba56c-registry-tls\") pod \"5644a06c-4361-4295-b67c-0adc005ba56c\" (UID: \"5644a06c-4361-4295-b67c-0adc005ba56c\") "
May 29 17:44:51.504115 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.504074    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5644a06c-4361-4295-b67c-0adc005ba56c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5644a06c-4361-4295-b67c-0adc005ba56c" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:44:51.504210 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.504107    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5644a06c-4361-4295-b67c-0adc005ba56c-feast-data" (OuterVolumeSpecName: "feast-data") pod "5644a06c-4361-4295-b67c-0adc005ba56c" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:44:51.505862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.505829    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5644a06c-4361-4295-b67c-0adc005ba56c-kube-api-access-shdqs" (OuterVolumeSpecName: "kube-api-access-shdqs") pod "5644a06c-4361-4295-b67c-0adc005ba56c" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c"). InnerVolumeSpecName "kube-api-access-shdqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:44:51.505862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.505839    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5644a06c-4361-4295-b67c-0adc005ba56c" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:51.506011 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.505992    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls" (OuterVolumeSpecName: "online-tls") pod "5644a06c-4361-4295-b67c-0adc005ba56c" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:51.506094 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.506074    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5644a06c-4361-4295-b67c-0adc005ba56c" (UID: "5644a06c-4361-4295-b67c-0adc005ba56c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:51.604284 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.604257    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5644a06c-4361-4295-b67c-0adc005ba56c-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:51.604284 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.604287    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:51.604451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.604300    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:51.604451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.604313    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shdqs\" (UniqueName: \"kubernetes.io/projected/5644a06c-4361-4295-b67c-0adc005ba56c-kube-api-access-shdqs\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:51.604451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.604326    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/5644a06c-4361-4295-b67c-0adc005ba56c-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:51.604451 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.604338    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5644a06c-4361-4295-b67c-0adc005ba56c-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:51.916094 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:51.916068    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:44:52.008124 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008095    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls\") pod \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") "
May 29 17:44:52.008230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008152    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls\") pod \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") "
May 29 17:44:52.008230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008181    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n54rz\" (UniqueName: \"kubernetes.io/projected/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-kube-api-access-n54rz\") pod \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") "
May 29 17:44:52.008230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008202    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-feast-data\") pod \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") "
May 29 17:44:52.008398 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008234    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls\") pod \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") "
May 29 17:44:52.008398 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008267    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-offline-tls\") pod \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\" (UID: \"9adc5572-99b6-45b5-ac73-75d9ef90c7f8\") "
May 29 17:44:52.008800 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.008772    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-feast-data" (OuterVolumeSpecName: "feast-data") pod "9adc5572-99b6-45b5-ac73-75d9ef90c7f8" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:44:52.010275 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.010252    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "9adc5572-99b6-45b5-ac73-75d9ef90c7f8" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:52.010769 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.010718    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls" (OuterVolumeSpecName: "online-tls") pod "9adc5572-99b6-45b5-ac73-75d9ef90c7f8" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:52.010769 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.010736    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9adc5572-99b6-45b5-ac73-75d9ef90c7f8" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:52.010769 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.010762    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "9adc5572-99b6-45b5-ac73-75d9ef90c7f8" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:44:52.010931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.010723    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-kube-api-access-n54rz" (OuterVolumeSpecName: "kube-api-access-n54rz") pod "9adc5572-99b6-45b5-ac73-75d9ef90c7f8" (UID: "9adc5572-99b6-45b5-ac73-75d9ef90c7f8"). InnerVolumeSpecName "kube-api-access-n54rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:44:52.028299 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.028278    2558 generic.go:358] "Generic (PLEG): container finished" podID="5644a06c-4361-4295-b67c-0adc005ba56c" containerID="89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d" exitCode=137
May 29 17:44:52.028380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.028352    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"
May 29 17:44:52.028380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.028355    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerDied","Data":"89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d"}
May 29 17:44:52.028458 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.028386    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv" event={"ID":"5644a06c-4361-4295-b67c-0adc005ba56c","Type":"ContainerDied","Data":"4842682bf33aac27fd47869225453ce05cdbda830aaf99b66788b201fa01770e"}
May 29 17:44:52.028458 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.028402    2558 scope.go:117] "RemoveContainer" containerID="ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf"
May 29 17:44:52.031178 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.031157    2558 generic.go:358] "Generic (PLEG): container finished" podID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerID="c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5" exitCode=137
May 29 17:44:52.031178 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.031177    2558 generic.go:358] "Generic (PLEG): container finished" podID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerID="8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174" exitCode=137
May 29 17:44:52.031330 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.031181    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"}
May 29 17:44:52.031330 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.031203    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"}
May 29 17:44:52.031330 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.031227    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms" event={"ID":"9adc5572-99b6-45b5-ac73-75d9ef90c7f8","Type":"ContainerDied","Data":"c9a7ad72170dcfdeb4f872e1e041b38f1ebc5791c1bc1573b1056aa4b1f121c0"}
May 29 17:44:52.031330 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.031261    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"
May 29 17:44:52.038899 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.038885    2558 scope.go:117] "RemoveContainer" containerID="89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d"
May 29 17:44:52.048763 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.048704    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"]
May 29 17:44:52.048986 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.048965    2558 scope.go:117] "RemoveContainer" containerID="fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6"
May 29 17:44:52.052034 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.052013    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6f567bbdf9-zhqcv"]
May 29 17:44:52.056363 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.056347    2558 scope.go:117] "RemoveContainer" containerID="6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88"
May 29 17:44:52.062158 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.062138    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"]
May 29 17:44:52.063886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.063871    2558 scope.go:117] "RemoveContainer" containerID="17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632"
May 29 17:44:52.066237 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.066217    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-75dbb66f66-5vdms"]
May 29 17:44:52.071230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.071213    2558 scope.go:117] "RemoveContainer" containerID="ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf"
May 29 17:44:52.071481 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.071461    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf\": container with ID starting with ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf not found: ID does not exist" containerID="ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf"
May 29 17:44:52.071560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.071487    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf"} err="failed to get container status \"ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf\": rpc error: code = NotFound desc = could not find container \"ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf\": container with ID starting with ed303bf672a7f5ac2ab3e618d7199b574855e7849e20196727dc9baaf966cdaf not found: ID does not exist"
May 29 17:44:52.071560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.071504    2558 scope.go:117] "RemoveContainer" containerID="89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d"
May 29 17:44:52.071782 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.071743    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d\": container with ID starting with 89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d not found: ID does not exist" containerID="89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d"
May 29 17:44:52.071861 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.071789    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d"} err="failed to get container status \"89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d\": rpc error: code = NotFound desc = could not find container \"89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d\": container with ID starting with 89f1e2046f1d40af74c226e035382920141a746324c58e1a5acdbf7ba228b12d not found: ID does not exist"
May 29 17:44:52.071861 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.071803    2558 scope.go:117] "RemoveContainer" containerID="fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6"
May 29 17:44:52.072003 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.071988    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6\": container with ID starting with fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6 not found: ID does not exist" containerID="fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6"
May 29 17:44:52.072037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.072006    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6"} err="failed to get container status \"fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6\": rpc error: code = NotFound desc = could not find container \"fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6\": container with ID starting with fa44899f97cf071e0371fb652328c6208d0bb845f278d27e733f3390973ca4d6 not found: ID does not exist"
May 29 17:44:52.072037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.072018    2558 scope.go:117] "RemoveContainer" containerID="6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88"
May 29 17:44:52.072223 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.072208    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88\": container with ID starting with 6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88 not found: ID does not exist" containerID="6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88"
May 29 17:44:52.072273 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.072227    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88"} err="failed to get container status \"6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88\": rpc error: code = NotFound desc = could not find container \"6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88\": container with ID starting with 6c4d462b5d4968358e7ea953156b68f5b49bc18f43d0db3c05364f0634241f88 not found: ID does not exist"
May 29 17:44:52.072273 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.072239    2558 scope.go:117] "RemoveContainer" containerID="17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632"
May 29 17:44:52.072449 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.072433    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632\": container with ID starting with 17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632 not found: ID does not exist" containerID="17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632"
May 29 17:44:52.072492 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.072451    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632"} err="failed to get container status \"17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632\": rpc error: code = NotFound desc = could not find container \"17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632\": container with ID starting with 17dec660b10a06fe5fbd580b145d0babae68ef05beed46403b33365f385b0632 not found: ID does not exist"
May 29 17:44:52.072492 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.072462    2558 scope.go:117] "RemoveContainer" containerID="bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"
May 29 17:44:52.079247 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.079225    2558 scope.go:117] "RemoveContainer" containerID="c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"
May 29 17:44:52.085875 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.085861    2558 scope.go:117] "RemoveContainer" containerID="c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"
May 29 17:44:52.092095 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.092082    2558 scope.go:117] "RemoveContainer" containerID="8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"
May 29 17:44:52.098442 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.098427    2558 scope.go:117] "RemoveContainer" containerID="aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"
May 29 17:44:52.104675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.104659    2558 scope.go:117] "RemoveContainer" containerID="278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"
May 29 17:44:52.109777 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.109744    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:52.109847 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.109779    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:52.109847 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.109792    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:52.109847 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.109802    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:52.109847 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.109811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n54rz\" (UniqueName: \"kubernetes.io/projected/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-kube-api-access-n54rz\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:52.109847 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.109819    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/9adc5572-99b6-45b5-ac73-75d9ef90c7f8-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:44:52.110843 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.110825    2558 scope.go:117] "RemoveContainer" containerID="bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"
May 29 17:44:52.111072 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.111055    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833\": container with ID starting with bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833 not found: ID does not exist" containerID="bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"
May 29 17:44:52.111126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111077    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"} err="failed to get container status \"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833\": rpc error: code = NotFound desc = could not find container \"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833\": container with ID starting with bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833 not found: ID does not exist"
May 29 17:44:52.111126 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111094    2558 scope.go:117] "RemoveContainer" containerID="c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"
May 29 17:44:52.111309 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.111295    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5\": container with ID starting with c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5 not found: ID does not exist" containerID="c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"
May 29 17:44:52.111350 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111312    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"} err="failed to get container status \"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5\": rpc error: code = NotFound desc = could not find container \"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5\": container with ID starting with c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5 not found: ID does not exist"
May 29 17:44:52.111350 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111324    2558 scope.go:117] "RemoveContainer" containerID="c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"
May 29 17:44:52.111507 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.111488    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a\": container with ID starting with c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a not found: ID does not exist" containerID="c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"
May 29 17:44:52.111586 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111516    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"} err="failed to get container status \"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a\": rpc error: code = NotFound desc = could not find container \"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a\": container with ID starting with c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a not found: ID does not exist"
May 29 17:44:52.111586 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111538    2558 scope.go:117] "RemoveContainer" containerID="8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"
May 29 17:44:52.111743 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.111729    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174\": container with ID starting with 8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174 not found: ID does not exist" containerID="8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"
May 29 17:44:52.111808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111746    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"} err="failed to get container status \"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174\": rpc error: code = NotFound desc = could not find container \"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174\": container with ID starting with 8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174 not found: ID does not exist"
May 29 17:44:52.111808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.111778    2558 scope.go:117] "RemoveContainer" containerID="aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"
May 29 17:44:52.111994 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.111978    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650\": container with ID starting with aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650 not found: ID does not exist" containerID="aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"
May 29 17:44:52.112048 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112002    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"} err="failed to get container status \"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650\": rpc error: code = NotFound desc = could not find container \"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650\": container with ID starting with aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650 not found: ID does not exist"
May 29 17:44:52.112048 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112021    2558 scope.go:117] "RemoveContainer" containerID="278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"
May 29 17:44:52.112243 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:44:52.112229    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a\": container with ID starting with 278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a not found: ID does not exist" containerID="278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"
May 29 17:44:52.112287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112247    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"} err="failed to get container status \"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a\": rpc error: code = NotFound desc = could not find container \"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a\": container with ID starting with 278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a not found: ID does not exist"
May 29 17:44:52.112287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112260    2558 scope.go:117] "RemoveContainer" containerID="bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"
May 29 17:44:52.112438 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112420    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833"} err="failed to get container status \"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833\": rpc error: code = NotFound desc = could not find container \"bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833\": container with ID starting with bd6342034388d8ba78267236d00ab1a413644ac9582d0a7db3d73f1192a27833 not found: ID does not exist"
May 29 17:44:52.112479 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112445    2558 scope.go:117] "RemoveContainer" containerID="c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"
May 29 17:44:52.112654 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112640    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5"} err="failed to get container status \"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5\": rpc error: code = NotFound desc = could not find container \"c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5\": container with ID starting with c269f4cbb87c396f94afc3cf978b74bc4b9a1614512da54e10b6130c44eeb0d5 not found: ID does not exist"
May 29 17:44:52.112654 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112654    2558 scope.go:117] "RemoveContainer" containerID="c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"
May 29 17:44:52.112842 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112824    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a"} err="failed to get container status \"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a\": rpc error: code = NotFound desc = could not find container \"c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a\": container with ID starting with c4514099973665abea09610290ac77cb67e372d79ca20bf2781deff3fcf7509a not found: ID does not exist"
May 29 17:44:52.112891 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.112843    2558 scope.go:117] "RemoveContainer" containerID="8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"
May 29 17:44:52.113028 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.113012    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174"} err="failed to get container status \"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174\": rpc error: code = NotFound desc = could not find container \"8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174\": container with ID starting with 8f97165ae88ef207cb6f2a12b7ea40bad286da8f0426da6e1f072a1531146174 not found: ID does not exist"
May 29 17:44:52.113077 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.113028    2558 scope.go:117] "RemoveContainer" containerID="aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"
May 29 17:44:52.113208 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.113194    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650"} err="failed to get container status \"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650\": rpc error: code = NotFound desc = could not find container \"aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650\": container with ID starting with aac1c013eef4a11ef4bc529746e8342a4fafaa70a4e2190a7f27e6e0615de650 not found: ID does not exist"
May 29 17:44:52.113254 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.113209    2558 scope.go:117] "RemoveContainer" containerID="278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"
May 29 17:44:52.113364 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:52.113349    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a"} err="failed to get container status \"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a\": rpc error: code = NotFound desc = could not find container \"278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a\": container with ID starting with 278921b96d1a718d64e28529ac49c5d75cbbb23308e0a8374e60d5f5b3bf543a not found: ID does not exist"
May 29 17:44:53.510950 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:53.510921    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" path="/var/lib/kubelet/pods/5644a06c-4361-4295-b67c-0adc005ba56c/volumes"
May 29 17:44:53.511437 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:44:53.511424    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" path="/var/lib/kubelet/pods/9adc5572-99b6-45b5-ac73-75d9ef90c7f8/volumes"
May 29 17:45:04.363796 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.363761    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-l5pcn"]
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364128    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364142    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364151    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="offline"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364157    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="offline"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364165    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364171    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364178    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="offline"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364184    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="offline"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364196    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364201    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364209    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="feast-apply"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364214    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="feast-apply"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364220    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="feast-init"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364225    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="feast-init"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364231    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="feast-apply"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364235    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="feast-apply"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364244    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="feast-init"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364249    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="feast-init"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364254    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364259    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364265    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="registry"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364270    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="registry"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364323    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="registry"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364331    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="ui"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364339    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="online"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364345    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="offline"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364350    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9adc5572-99b6-45b5-ac73-75d9ef90c7f8" containerName="ui"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364359    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="online"
May 29 17:45:04.364370 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.364366    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="5644a06c-4361-4295-b67c-0adc005ba56c" containerName="offline"
May 29 17:45:04.373528 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.373506    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.373714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.373689    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-l5pcn"]
May 29 17:45:04.375896 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.375877    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 29 17:45:04.375998 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.375880    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 29 17:45:04.376539 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.376523    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 29 17:45:04.376614 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.376563    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-xchr8\""
May 29 17:45:04.406101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.406074    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-bm78n"]
May 29 17:45:04.409309 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.409294    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:45:04.415575 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.415550    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-bm78n"]
May 29 17:45:04.511448 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.511413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lxhf\" (UniqueName: \"kubernetes.io/projected/70cb788f-2be4-46d5-957a-ca301b3647c2-kube-api-access-7lxhf\") pod \"redis-854544c579-bm78n\" (UID: \"70cb788f-2be4-46d5-957a-ca301b3647c2\") " pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:45:04.511608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.511494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ad77ab7b-a272-4108-ae5d-c85298d4daa8-postgresdata\") pod \"postgres-7c7656cc6d-l5pcn\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") " pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.511608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.511554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9b68\" (UniqueName: \"kubernetes.io/projected/ad77ab7b-a272-4108-ae5d-c85298d4daa8-kube-api-access-r9b68\") pod \"postgres-7c7656cc6d-l5pcn\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") " pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.612664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.612637    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7lxhf\" (UniqueName: \"kubernetes.io/projected/70cb788f-2be4-46d5-957a-ca301b3647c2-kube-api-access-7lxhf\") pod \"redis-854544c579-bm78n\" (UID: \"70cb788f-2be4-46d5-957a-ca301b3647c2\") " pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:45:04.612808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.612675    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ad77ab7b-a272-4108-ae5d-c85298d4daa8-postgresdata\") pod \"postgres-7c7656cc6d-l5pcn\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") " pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.612808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.612697    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9b68\" (UniqueName: \"kubernetes.io/projected/ad77ab7b-a272-4108-ae5d-c85298d4daa8-kube-api-access-r9b68\") pod \"postgres-7c7656cc6d-l5pcn\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") " pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.613065 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.613044    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ad77ab7b-a272-4108-ae5d-c85298d4daa8-postgresdata\") pod \"postgres-7c7656cc6d-l5pcn\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") " pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.621550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.621481    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lxhf\" (UniqueName: \"kubernetes.io/projected/70cb788f-2be4-46d5-957a-ca301b3647c2-kube-api-access-7lxhf\") pod \"redis-854544c579-bm78n\" (UID: \"70cb788f-2be4-46d5-957a-ca301b3647c2\") " pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:45:04.621661 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.621633    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9b68\" (UniqueName: \"kubernetes.io/projected/ad77ab7b-a272-4108-ae5d-c85298d4daa8-kube-api-access-r9b68\") pod \"postgres-7c7656cc6d-l5pcn\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") " pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.700366 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.700345    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:45:04.719103 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.719083    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:45:04.831219 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.831117    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-l5pcn"]
May 29 17:45:04.833731 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:45:04.833695    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad77ab7b_a272_4108_ae5d_c85298d4daa8.slice/crio-131ba797dd6fa92dc2d9744d9df9ea13607cd9227dcb3544a05f5f3122432844 WatchSource:0}: Error finding container 131ba797dd6fa92dc2d9744d9df9ea13607cd9227dcb3544a05f5f3122432844: Status 404 returned error can't find the container with id 131ba797dd6fa92dc2d9744d9df9ea13607cd9227dcb3544a05f5f3122432844
May 29 17:45:04.835396 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.835378    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:45:04.853604 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:04.853581    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-bm78n"]
May 29 17:45:04.855762 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:45:04.855729    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70cb788f_2be4_46d5_957a_ca301b3647c2.slice/crio-98df7744c224e6dfb8992d80bc7fbffb66d3c74886305c520f8002c6f4ac79ea WatchSource:0}: Error finding container 98df7744c224e6dfb8992d80bc7fbffb66d3c74886305c520f8002c6f4ac79ea: Status 404 returned error can't find the container with id 98df7744c224e6dfb8992d80bc7fbffb66d3c74886305c520f8002c6f4ac79ea
May 29 17:45:05.072264 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:05.072227    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-bm78n" event={"ID":"70cb788f-2be4-46d5-957a-ca301b3647c2","Type":"ContainerStarted","Data":"98df7744c224e6dfb8992d80bc7fbffb66d3c74886305c520f8002c6f4ac79ea"}
May 29 17:45:05.073202 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:05.073181    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn" event={"ID":"ad77ab7b-a272-4108-ae5d-c85298d4daa8","Type":"ContainerStarted","Data":"131ba797dd6fa92dc2d9744d9df9ea13607cd9227dcb3544a05f5f3122432844"}
May 29 17:45:07.083037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:07.082992    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-bm78n" event={"ID":"70cb788f-2be4-46d5-957a-ca301b3647c2","Type":"ContainerStarted","Data":"c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f"}
May 29 17:45:07.099237 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:07.099184    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-bm78n" podStartSLOduration=1.544878384 podStartE2EDuration="3.099166249s" podCreationTimestamp="2026-05-29 17:45:04 +0000 UTC" firstStartedPulling="2026-05-29 17:45:04.857285826 +0000 UTC m=+757.843107792" lastFinishedPulling="2026-05-29 17:45:06.411573674 +0000 UTC m=+759.397395657" observedRunningTime="2026-05-29 17:45:07.096829328 +0000 UTC m=+760.082651316" watchObservedRunningTime="2026-05-29 17:45:07.099166249 +0000 UTC m=+760.084988242"
May 29 17:45:10.094327 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:10.094242    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn" event={"ID":"ad77ab7b-a272-4108-ae5d-c85298d4daa8","Type":"ContainerStarted","Data":"40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc"}
May 29 17:45:10.109220 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:10.109164    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn" podStartSLOduration=1.130814194 podStartE2EDuration="6.109146883s" podCreationTimestamp="2026-05-29 17:45:04 +0000 UTC" firstStartedPulling="2026-05-29 17:45:04.835499716 +0000 UTC m=+757.821321682" lastFinishedPulling="2026-05-29 17:45:09.813832395 +0000 UTC m=+762.799654371" observedRunningTime="2026-05-29 17:45:10.107000318 +0000 UTC m=+763.092822303" watchObservedRunningTime="2026-05-29 17:45:10.109146883 +0000 UTC m=+763.094968873"
May 29 17:45:13.105672 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.105641    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"]
May 29 17:45:13.111541 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.111522    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.113827 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.113806    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 29 17:45:13.113942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.113824    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-xb84v\""
May 29 17:45:13.113942 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.113894    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 29 17:45:13.114070 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.113970    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 29 17:45:13.114150 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.114133    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 29 17:45:13.121425 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.121405    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"]
May 29 17:45:13.190966 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.190930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.191270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.190972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b2v6\" (UniqueName: \"kubernetes.io/projected/0de53eb6-09be-4139-b0c9-e1467c28317e-kube-api-access-7b2v6\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.191270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.190997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.191270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.191066    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0de53eb6-09be-4139-b0c9-e1467c28317e-feast-data\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.191270 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.191105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-offline-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.292248 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.292212    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7b2v6\" (UniqueName: \"kubernetes.io/projected/0de53eb6-09be-4139-b0c9-e1467c28317e-kube-api-access-7b2v6\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.292248 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.292253    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.292490 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:45:13.292344    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 29 17:45:13.292490 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.292387    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0de53eb6-09be-4139-b0c9-e1467c28317e-feast-data\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.292490 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:45:13.292401    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls podName:0de53eb6-09be-4139-b0c9-e1467c28317e nodeName:}" failed. No retries permitted until 2026-05-29 17:45:13.792382601 +0000 UTC m=+766.778204568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls") pod "feast-credit-scoring-86677c9f44-5shb5" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e") : secret "feast-credit-scoring-online-tls" not found
May 29 17:45:13.292490 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.292458    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-offline-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.292700 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.292536    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.292700 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:45:13.292647    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
May 29 17:45:13.292700 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:45:13.292697    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls podName:0de53eb6-09be-4139-b0c9-e1467c28317e nodeName:}" failed. No retries permitted until 2026-05-29 17:45:13.79267818 +0000 UTC m=+766.778500152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls") pod "feast-credit-scoring-86677c9f44-5shb5" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e") : secret "feast-credit-scoring-registry-tls" not found
May 29 17:45:13.292882 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.292807    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0de53eb6-09be-4139-b0c9-e1467c28317e-feast-data\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.294867 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.294849    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-offline-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.301234 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.301209    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b2v6\" (UniqueName: \"kubernetes.io/projected/0de53eb6-09be-4139-b0c9-e1467c28317e-kube-api-access-7b2v6\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.796621 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.796538    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.796621 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.796620    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.799097 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.799071    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:13.799207 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:13.799101    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls\") pod \"feast-credit-scoring-86677c9f44-5shb5\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") " pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:14.022168 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:14.022119    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:14.169101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:14.169076    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"]
May 29 17:45:14.170628 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:45:14.170600    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de53eb6_09be_4139_b0c9_e1467c28317e.slice/crio-8d7f98593dc40732ee87398bb2339abfad39f497fe22516dbc9bd97c2ee9858a WatchSource:0}: Error finding container 8d7f98593dc40732ee87398bb2339abfad39f497fe22516dbc9bd97c2ee9858a: Status 404 returned error can't find the container with id 8d7f98593dc40732ee87398bb2339abfad39f497fe22516dbc9bd97c2ee9858a
May 29 17:45:15.114366 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:15.114314    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerStarted","Data":"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"}
May 29 17:45:15.114366 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:15.114370    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerStarted","Data":"8d7f98593dc40732ee87398bb2339abfad39f497fe22516dbc9bd97c2ee9858a"}
May 29 17:45:16.119241 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:16.119209    2558 generic.go:358] "Generic (PLEG): container finished" podID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerID="543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1" exitCode=0
May 29 17:45:16.119241 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:16.119248    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerDied","Data":"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"}
May 29 17:45:17.123888 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:17.123856    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerStarted","Data":"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"}
May 29 17:45:22.140810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:22.140780    2558 generic.go:358] "Generic (PLEG): container finished" podID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerID="a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b" exitCode=0
May 29 17:45:22.141124 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:22.140826    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerDied","Data":"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"}
May 29 17:45:23.147827 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:23.147789    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerStarted","Data":"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"}
May 29 17:45:23.148192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:23.147840    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerStarted","Data":"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"}
May 29 17:45:23.148192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:23.147855    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerStarted","Data":"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"}
May 29 17:45:23.171560 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:23.171505    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podStartSLOduration=10.171486142 podStartE2EDuration="10.171486142s" podCreationTimestamp="2026-05-29 17:45:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:45:23.169458845 +0000 UTC m=+776.155280832" watchObservedRunningTime="2026-05-29 17:45:23.171486142 +0000 UTC m=+776.157308132"
May 29 17:45:24.022365 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:24.022323    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:24.022365 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:24.022371    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:24.022673 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:24.022380    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:26.022593 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:26.022554    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:26.023174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:26.023139    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:26.023174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:26.023165    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:26.023808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:26.023706    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.37:8816: connect: connection refused"
May 29 17:45:26.023808 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:26.023779    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 29 17:45:26.023991 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:26.023778    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
May 29 17:45:29.023286 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:29.022951    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
May 29 17:45:29.024026 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:29.024002    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:29.025173 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:29.025150    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:29.028637 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:29.028609    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:29.173867 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:29.173835    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:32.022863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:32.022819    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
May 29 17:45:35.022999 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:35.022971    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:45:35.023637 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:45:35.023620    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:46:39.844276 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.844238    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"]
May 29 17:46:39.845063 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.844531    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry" containerID="cri-o://473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5" gracePeriod=30
May 29 17:46:39.845063 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.844588    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online" containerID="cri-o://389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50" gracePeriod=30
May 29 17:46:39.845063 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.844618    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="offline" containerID="cri-o://a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19" gracePeriod=30
May 29 17:46:39.860562 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.860528    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-l5pcn"]
May 29 17:46:39.860722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.860703    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn" podUID="ad77ab7b-a272-4108-ae5d-c85298d4daa8" containerName="postgres" containerID="cri-o://40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc" gracePeriod=30
May 29 17:46:39.869423 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.869387    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-bm78n"]
May 29 17:46:39.869619 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:39.869597    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-bm78n" podUID="70cb788f-2be4-46d5-957a-ca301b3647c2" containerName="redis" containerID="cri-o://c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f" gracePeriod=30
May 29 17:46:40.116530 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.116508    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:46:40.149486 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.149461    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:46:40.154924 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.154898    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9b68\" (UniqueName: \"kubernetes.io/projected/ad77ab7b-a272-4108-ae5d-c85298d4daa8-kube-api-access-r9b68\") pod \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") "
May 29 17:46:40.155093 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.154948    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ad77ab7b-a272-4108-ae5d-c85298d4daa8-postgresdata\") pod \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\" (UID: \"ad77ab7b-a272-4108-ae5d-c85298d4daa8\") "
May 29 17:46:40.157856 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.157822    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad77ab7b-a272-4108-ae5d-c85298d4daa8-kube-api-access-r9b68" (OuterVolumeSpecName: "kube-api-access-r9b68") pod "ad77ab7b-a272-4108-ae5d-c85298d4daa8" (UID: "ad77ab7b-a272-4108-ae5d-c85298d4daa8"). InnerVolumeSpecName "kube-api-access-r9b68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:46:40.186204 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.186162    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad77ab7b-a272-4108-ae5d-c85298d4daa8-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ad77ab7b-a272-4108-ae5d-c85298d4daa8" (UID: "ad77ab7b-a272-4108-ae5d-c85298d4daa8"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:46:40.256402 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.256368    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lxhf\" (UniqueName: \"kubernetes.io/projected/70cb788f-2be4-46d5-957a-ca301b3647c2-kube-api-access-7lxhf\") pod \"70cb788f-2be4-46d5-957a-ca301b3647c2\" (UID: \"70cb788f-2be4-46d5-957a-ca301b3647c2\") "
May 29 17:46:40.256585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.256525    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9b68\" (UniqueName: \"kubernetes.io/projected/ad77ab7b-a272-4108-ae5d-c85298d4daa8-kube-api-access-r9b68\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:46:40.256585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.256536    2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ad77ab7b-a272-4108-ae5d-c85298d4daa8-postgresdata\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:46:40.258480 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.258450    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70cb788f-2be4-46d5-957a-ca301b3647c2-kube-api-access-7lxhf" (OuterVolumeSpecName: "kube-api-access-7lxhf") pod "70cb788f-2be4-46d5-957a-ca301b3647c2" (UID: "70cb788f-2be4-46d5-957a-ca301b3647c2"). InnerVolumeSpecName "kube-api-access-7lxhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:46:40.357117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.356972    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lxhf\" (UniqueName: \"kubernetes.io/projected/70cb788f-2be4-46d5-957a-ca301b3647c2-kube-api-access-7lxhf\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:46:40.416236 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.416197    2558 generic.go:358] "Generic (PLEG): container finished" podID="70cb788f-2be4-46d5-957a-ca301b3647c2" containerID="c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f" exitCode=0
May 29 17:46:40.416428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.416268    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-bm78n"
May 29 17:46:40.416428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.416293    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-bm78n" event={"ID":"70cb788f-2be4-46d5-957a-ca301b3647c2","Type":"ContainerDied","Data":"c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f"}
May 29 17:46:40.416428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.416328    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-bm78n" event={"ID":"70cb788f-2be4-46d5-957a-ca301b3647c2","Type":"ContainerDied","Data":"98df7744c224e6dfb8992d80bc7fbffb66d3c74886305c520f8002c6f4ac79ea"}
May 29 17:46:40.416428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.416348    2558 scope.go:117] "RemoveContainer" containerID="c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f"
May 29 17:46:40.417664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.417594    2558 generic.go:358] "Generic (PLEG): container finished" podID="ad77ab7b-a272-4108-ae5d-c85298d4daa8" containerID="40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc" exitCode=0
May 29 17:46:40.417664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.417643    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn"
May 29 17:46:40.417664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.417648    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn" event={"ID":"ad77ab7b-a272-4108-ae5d-c85298d4daa8","Type":"ContainerDied","Data":"40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc"}
May 29 17:46:40.417883 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.417672    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-l5pcn" event={"ID":"ad77ab7b-a272-4108-ae5d-c85298d4daa8","Type":"ContainerDied","Data":"131ba797dd6fa92dc2d9744d9df9ea13607cd9227dcb3544a05f5f3122432844"}
May 29 17:46:40.428336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.428281    2558 scope.go:117] "RemoveContainer" containerID="c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f"
May 29 17:46:40.428692 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:46:40.428666    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f\": container with ID starting with c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f not found: ID does not exist" containerID="c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f"
May 29 17:46:40.428797 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.428700    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f"} err="failed to get container status \"c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f\": rpc error: code = NotFound desc = could not find container \"c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f\": container with ID starting with c0c56a8f2a9ff9f5e1c463ab3185c9b1d117492f0ce9d6a3cf8df44c0865dd4f not found: ID does not exist"
May 29 17:46:40.428797 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.428719    2558 scope.go:117] "RemoveContainer" containerID="40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc"
May 29 17:46:40.436531 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.436514    2558 scope.go:117] "RemoveContainer" containerID="40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc"
May 29 17:46:40.436822 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:46:40.436795    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc\": container with ID starting with 40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc not found: ID does not exist" containerID="40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc"
May 29 17:46:40.436920 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.436828    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc"} err="failed to get container status \"40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc\": rpc error: code = NotFound desc = could not find container \"40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc\": container with ID starting with 40685b3e8144a41726dbcb7e86e7af24e2d4bde8ac919113944427b80f4eaecc not found: ID does not exist"
May 29 17:46:40.441681 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.441655    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-bm78n"]
May 29 17:46:40.444049 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.444028    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-bm78n"]
May 29 17:46:40.452663 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.452619    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-l5pcn"]
May 29 17:46:40.462790 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:40.459274    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-l5pcn"]
May 29 17:46:41.424675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:41.424644    2558 generic.go:358] "Generic (PLEG): container finished" podID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerID="389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50" exitCode=0
May 29 17:46:41.424675 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:41.424678    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerDied","Data":"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"}
May 29 17:46:41.510864 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:41.510832    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70cb788f-2be4-46d5-957a-ca301b3647c2" path="/var/lib/kubelet/pods/70cb788f-2be4-46d5-957a-ca301b3647c2/volumes"
May 29 17:46:41.511179 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:41.511167    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad77ab7b-a272-4108-ae5d-c85298d4daa8" path="/var/lib/kubelet/pods/ad77ab7b-a272-4108-ae5d-c85298d4daa8/volumes"
May 29 17:46:49.171137 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:49.171093    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 29 17:46:59.171482 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:46:59.171428    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 29 17:47:09.171626 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:09.171577    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
May 29 17:47:09.172074 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:09.171778    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:47:10.508134 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.508111    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:47:10.521357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521326    2558 generic.go:358] "Generic (PLEG): container finished" podID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerID="a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19" exitCode=137
May 29 17:47:10.521357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521352    2558 generic.go:358] "Generic (PLEG): container finished" podID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerID="473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5" exitCode=137
May 29 17:47:10.521357 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521354    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerDied","Data":"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"}
May 29 17:47:10.521649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521392    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerDied","Data":"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"}
May 29 17:47:10.521649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521403    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"
May 29 17:47:10.521649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521418    2558 scope.go:117] "RemoveContainer" containerID="a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"
May 29 17:47:10.521649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.521408    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-86677c9f44-5shb5" event={"ID":"0de53eb6-09be-4139-b0c9-e1467c28317e","Type":"ContainerDied","Data":"8d7f98593dc40732ee87398bb2339abfad39f497fe22516dbc9bd97c2ee9858a"}
May 29 17:47:10.529378 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.529351    2558 scope.go:117] "RemoveContainer" containerID="389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"
May 29 17:47:10.538252 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.538231    2558 scope.go:117] "RemoveContainer" containerID="473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"
May 29 17:47:10.545937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.545908    2558 scope.go:117] "RemoveContainer" containerID="a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"
May 29 17:47:10.553744 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.553719    2558 scope.go:117] "RemoveContainer" containerID="543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"
May 29 17:47:10.560650 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.560628    2558 scope.go:117] "RemoveContainer" containerID="a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"
May 29 17:47:10.560922 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:47:10.560903    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19\": container with ID starting with a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19 not found: ID does not exist" containerID="a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"
May 29 17:47:10.560978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.560935    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"} err="failed to get container status \"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19\": rpc error: code = NotFound desc = could not find container \"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19\": container with ID starting with a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19 not found: ID does not exist"
May 29 17:47:10.560978 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.560956    2558 scope.go:117] "RemoveContainer" containerID="389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"
May 29 17:47:10.561186 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:47:10.561162    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50\": container with ID starting with 389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50 not found: ID does not exist" containerID="389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"
May 29 17:47:10.561233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561185    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"} err="failed to get container status \"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50\": rpc error: code = NotFound desc = could not find container \"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50\": container with ID starting with 389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50 not found: ID does not exist"
May 29 17:47:10.561233 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561204    2558 scope.go:117] "RemoveContainer" containerID="473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"
May 29 17:47:10.561406 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:47:10.561389    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5\": container with ID starting with 473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5 not found: ID does not exist" containerID="473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"
May 29 17:47:10.561470 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561413    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"} err="failed to get container status \"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5\": rpc error: code = NotFound desc = could not find container \"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5\": container with ID starting with 473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5 not found: ID does not exist"
May 29 17:47:10.561470 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561438    2558 scope.go:117] "RemoveContainer" containerID="a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"
May 29 17:47:10.561690 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:47:10.561675    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b\": container with ID starting with a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b not found: ID does not exist" containerID="a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"
May 29 17:47:10.561745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561695    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"} err="failed to get container status \"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b\": rpc error: code = NotFound desc = could not find container \"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b\": container with ID starting with a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b not found: ID does not exist"
May 29 17:47:10.561745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561707    2558 scope.go:117] "RemoveContainer" containerID="543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"
May 29 17:47:10.561922 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:47:10.561904    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1\": container with ID starting with 543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1 not found: ID does not exist" containerID="543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"
May 29 17:47:10.561959 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561927    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"} err="failed to get container status \"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1\": rpc error: code = NotFound desc = could not find container \"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1\": container with ID starting with 543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1 not found: ID does not exist"
May 29 17:47:10.561959 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.561940    2558 scope.go:117] "RemoveContainer" containerID="a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"
May 29 17:47:10.562128 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562109    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19"} err="failed to get container status \"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19\": rpc error: code = NotFound desc = could not find container \"a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19\": container with ID starting with a789257f1be204a581a317ed99818e848ffde83cb5e29fe1650084227261ed19 not found: ID does not exist"
May 29 17:47:10.562199 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562131    2558 scope.go:117] "RemoveContainer" containerID="389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"
May 29 17:47:10.562325 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562310    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50"} err="failed to get container status \"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50\": rpc error: code = NotFound desc = could not find container \"389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50\": container with ID starting with 389b4aaa1987633c42f1b207d9487ce6ce90b2d503c7ea27400cebac68d9bd50 not found: ID does not exist"
May 29 17:47:10.562375 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562325    2558 scope.go:117] "RemoveContainer" containerID="473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"
May 29 17:47:10.562510 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562492    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5"} err="failed to get container status \"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5\": rpc error: code = NotFound desc = could not find container \"473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5\": container with ID starting with 473a8370af7f0dd41ae5e56cd7012b5e36e05d4b163cd9428f5c8fec5853b1a5 not found: ID does not exist"
May 29 17:47:10.562551 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562511    2558 scope.go:117] "RemoveContainer" containerID="a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"
May 29 17:47:10.562726 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562709    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b"} err="failed to get container status \"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b\": rpc error: code = NotFound desc = could not find container \"a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b\": container with ID starting with a129ee0bd1a917bd6b1d424086597d08b1ec274443fe7b41e2124429bbb4707b not found: ID does not exist"
May 29 17:47:10.562831 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562727    2558 scope.go:117] "RemoveContainer" containerID="543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"
May 29 17:47:10.562934 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.562915    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1"} err="failed to get container status \"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1\": rpc error: code = NotFound desc = could not find container \"543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1\": container with ID starting with 543688d4618d03fa27364c057bf6469ab0f7e86b28d874eaebd6518c8bd18ae1 not found: ID does not exist"
May 29 17:47:10.617842 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.617806    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls\") pod \"0de53eb6-09be-4139-b0c9-e1467c28317e\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") "
May 29 17:47:10.618018 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.617865    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0de53eb6-09be-4139-b0c9-e1467c28317e-feast-data\") pod \"0de53eb6-09be-4139-b0c9-e1467c28317e\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") "
May 29 17:47:10.618018 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.617901    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-offline-tls\") pod \"0de53eb6-09be-4139-b0c9-e1467c28317e\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") "
May 29 17:47:10.618018 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.618011    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls\") pod \"0de53eb6-09be-4139-b0c9-e1467c28317e\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") "
May 29 17:47:10.618177 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.618030    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7b2v6\" (UniqueName: \"kubernetes.io/projected/0de53eb6-09be-4139-b0c9-e1467c28317e-kube-api-access-7b2v6\") pod \"0de53eb6-09be-4139-b0c9-e1467c28317e\" (UID: \"0de53eb6-09be-4139-b0c9-e1467c28317e\") "
May 29 17:47:10.620053 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.619997    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0de53eb6-09be-4139-b0c9-e1467c28317e" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:47:10.620148 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.620052    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls" (OuterVolumeSpecName: "online-tls") pod "0de53eb6-09be-4139-b0c9-e1467c28317e" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:47:10.620148 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.620113    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de53eb6-09be-4139-b0c9-e1467c28317e-kube-api-access-7b2v6" (OuterVolumeSpecName: "kube-api-access-7b2v6") pod "0de53eb6-09be-4139-b0c9-e1467c28317e" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e"). InnerVolumeSpecName "kube-api-access-7b2v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:47:10.620276 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.620260    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0de53eb6-09be-4139-b0c9-e1467c28317e" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:47:10.626631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.626608    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0de53eb6-09be-4139-b0c9-e1467c28317e-feast-data" (OuterVolumeSpecName: "feast-data") pod "0de53eb6-09be-4139-b0c9-e1467c28317e" (UID: "0de53eb6-09be-4139-b0c9-e1467c28317e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:47:10.719475 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.719428    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:47:10.719475 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.719473    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0de53eb6-09be-4139-b0c9-e1467c28317e-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:47:10.719475 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.719481    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:47:10.719475 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.719489    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0de53eb6-09be-4139-b0c9-e1467c28317e-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:47:10.719727 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.719498    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7b2v6\" (UniqueName: \"kubernetes.io/projected/0de53eb6-09be-4139-b0c9-e1467c28317e-kube-api-access-7b2v6\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:47:10.844311 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.844278    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"]
May 29 17:47:10.848013 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:10.847985    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-86677c9f44-5shb5"]
May 29 17:47:11.510280 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:11.510249    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" path="/var/lib/kubelet/pods/0de53eb6-09be-4139-b0c9-e1467c28317e/volumes"
May 29 17:47:27.435021 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:27.434994    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:47:27.436778 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:47:27.436734    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:48:47.073273 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073193    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-97tgx"]
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073524    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="feast-apply"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073536    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="feast-apply"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073549    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70cb788f-2be4-46d5-957a-ca301b3647c2" containerName="redis"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073555    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70cb788f-2be4-46d5-957a-ca301b3647c2" containerName="redis"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073561    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="offline"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073568    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="offline"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073579    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad77ab7b-a272-4108-ae5d-c85298d4daa8" containerName="postgres"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073588    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad77ab7b-a272-4108-ae5d-c85298d4daa8" containerName="postgres"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073599    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073608    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073626    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="feast-init"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073633    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="feast-init"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073655    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073663    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073808    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="registry"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073826    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="online"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073835    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="ad77ab7b-a272-4108-ae5d-c85298d4daa8" containerName="postgres"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073844    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="70cb788f-2be4-46d5-957a-ca301b3647c2" containerName="redis"
May 29 17:48:47.073855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.073856    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0de53eb6-09be-4139-b0c9-e1467c28317e" containerName="offline"
May 29 17:48:47.077084 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.077063    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:48:47.079413 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.079390    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 29 17:48:47.080250 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.080233    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-vfsm8\""
May 29 17:48:47.080359 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.080274    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 29 17:48:47.089688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.089657    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-97tgx"]
May 29 17:48:47.206402 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.206363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnpqk\" (UniqueName: \"kubernetes.io/projected/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4-kube-api-access-xnpqk\") pod \"redis-854544c579-97tgx\" (UID: \"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4\") " pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:48:47.307795 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.307732    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnpqk\" (UniqueName: \"kubernetes.io/projected/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4-kube-api-access-xnpqk\") pod \"redis-854544c579-97tgx\" (UID: \"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4\") " pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:48:47.315521 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.315499    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnpqk\" (UniqueName: \"kubernetes.io/projected/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4-kube-api-access-xnpqk\") pod \"redis-854544c579-97tgx\" (UID: \"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4\") " pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:48:47.392867 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.392784    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:48:47.518823 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.518781    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-97tgx"]
May 29 17:48:47.521485 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:48:47.521461    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd6fba62_bb95_425d_a3e3_8ed050d3f1b4.slice/crio-ceb9b81cac2b98cb0951a5072d49df62fd394c7a1996f0179fbe7f1e9a578d7e WatchSource:0}: Error finding container ceb9b81cac2b98cb0951a5072d49df62fd394c7a1996f0179fbe7f1e9a578d7e: Status 404 returned error can't find the container with id ceb9b81cac2b98cb0951a5072d49df62fd394c7a1996f0179fbe7f1e9a578d7e
May 29 17:48:47.811818 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.811781    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-97tgx" event={"ID":"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4","Type":"ContainerStarted","Data":"d1eb32d24cfdd981af5735f083636c78377501c06b7fdbc911b3291be53eaad8"}
May 29 17:48:47.812008 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.811825    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-97tgx" event={"ID":"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4","Type":"ContainerStarted","Data":"ceb9b81cac2b98cb0951a5072d49df62fd394c7a1996f0179fbe7f1e9a578d7e"}
May 29 17:48:47.824738 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:47.824692    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-97tgx" podStartSLOduration=0.824677944 podStartE2EDuration="824.677944ms" podCreationTimestamp="2026-05-29 17:48:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:48:47.824203918 +0000 UTC m=+980.810025908" watchObservedRunningTime="2026-05-29 17:48:47.824677944 +0000 UTC m=+980.810499932"
May 29 17:48:52.496995 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.496959    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-zl22x"]
May 29 17:48:52.500178 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.500161    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.502714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.502692    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 29 17:48:52.505875 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.505853    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-zl22x"]
May 29 17:48:52.647655 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.647634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk2v6\" (UniqueName: \"kubernetes.io/projected/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-kube-api-access-tk2v6\") pod \"postgres-7c7656cc6d-zl22x\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.647809 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.647666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-postgresdata\") pod \"postgres-7c7656cc6d-zl22x\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.748193 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.748135    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tk2v6\" (UniqueName: \"kubernetes.io/projected/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-kube-api-access-tk2v6\") pod \"postgres-7c7656cc6d-zl22x\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.748193 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.748173    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-postgresdata\") pod \"postgres-7c7656cc6d-zl22x\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.748464 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.748450    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-postgresdata\") pod \"postgres-7c7656cc6d-zl22x\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.756342 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.756317    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk2v6\" (UniqueName: \"kubernetes.io/projected/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-kube-api-access-tk2v6\") pod \"postgres-7c7656cc6d-zl22x\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.812418 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.812389    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:48:52.934540 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:52.934512    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-zl22x"]
May 29 17:48:52.937602 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:48:52.937574    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f10f6cb_aa90_4a1f_8bc1_c2a1a9238e51.slice/crio-8ccf6c23062ed06bbc2e36c6eb975197e29375eeb93fe00a7e25786a51f995cb WatchSource:0}: Error finding container 8ccf6c23062ed06bbc2e36c6eb975197e29375eeb93fe00a7e25786a51f995cb: Status 404 returned error can't find the container with id 8ccf6c23062ed06bbc2e36c6eb975197e29375eeb93fe00a7e25786a51f995cb
May 29 17:48:53.833254 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:53.833221    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x" event={"ID":"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51","Type":"ContainerStarted","Data":"3ecf4404c75e7ef45f84d5c5d57f2d2ff0a8d5e00397ca90831cfc0824ddb82d"}
May 29 17:48:53.833254 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:53.833258    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x" event={"ID":"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51","Type":"ContainerStarted","Data":"8ccf6c23062ed06bbc2e36c6eb975197e29375eeb93fe00a7e25786a51f995cb"}
May 29 17:48:53.849099 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:53.849056    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x" podStartSLOduration=1.8490432989999999 podStartE2EDuration="1.849043299s" podCreationTimestamp="2026-05-29 17:48:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:48:53.848764892 +0000 UTC m=+986.834586875" watchObservedRunningTime="2026-05-29 17:48:53.849043299 +0000 UTC m=+986.834865287"
May 29 17:48:58.136674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.136640    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"]
May 29 17:48:58.140427 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.140405    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.142857 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.142830    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 29 17:48:58.142968 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.142897    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 29 17:48:58.142968 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.142932    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-kmqcj\""
May 29 17:48:58.143091 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.142930    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 29 17:48:58.148974 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.148948    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"]
May 29 17:48:58.298879 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.298842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.298879 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.298884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-feast-data\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.299099 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.298991    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqqg9\" (UniqueName: \"kubernetes.io/projected/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-kube-api-access-fqqg9\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.299099 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.299032    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-registry-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.399620 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.399532    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-registry-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.399620 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.399607    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.399881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.399631    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-feast-data\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.399881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.399689    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqqg9\" (UniqueName: \"kubernetes.io/projected/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-kube-api-access-fqqg9\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.399881 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:48:58.399728    2558 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
May 29 17:48:58.399881 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:48:58.399826    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls podName:ef2ff5a8-2e97-4ece-813a-2ba98311c9ff nodeName:}" failed. No retries permitted until 2026-05-29 17:48:58.899802471 +0000 UTC m=+991.885624439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls") pod "feast-credit-scoring-74c5585fcf-8htwr" (UID: "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff") : secret "feast-credit-scoring-online-tls" not found
May 29 17:48:58.400255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.400235    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-feast-data\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.402055 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.402033    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-registry-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.407621 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.407600    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqqg9\" (UniqueName: \"kubernetes.io/projected/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-kube-api-access-fqqg9\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.905313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.905272    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:58.907709 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:58.907686    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls\") pod \"feast-credit-scoring-74c5585fcf-8htwr\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") " pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:59.050319 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:59.050279    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:48:59.177990 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:59.177949    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"]
May 29 17:48:59.181060 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:48:59.181036    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2ff5a8_2e97_4ece_813a_2ba98311c9ff.slice/crio-b7c4d1cbf9a4f1c778699bb1dd1f1ed7ce31d26e86c1638c1d3a6069619f78fb WatchSource:0}: Error finding container b7c4d1cbf9a4f1c778699bb1dd1f1ed7ce31d26e86c1638c1d3a6069619f78fb: Status 404 returned error can't find the container with id b7c4d1cbf9a4f1c778699bb1dd1f1ed7ce31d26e86c1638c1d3a6069619f78fb
May 29 17:48:59.855148 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:59.855108    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerStarted","Data":"dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba"}
May 29 17:48:59.855148 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:48:59.855151    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerStarted","Data":"b7c4d1cbf9a4f1c778699bb1dd1f1ed7ce31d26e86c1638c1d3a6069619f78fb"}
May 29 17:49:00.859445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:00.859412    2558 generic.go:358] "Generic (PLEG): container finished" podID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerID="dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba" exitCode=0
May 29 17:49:00.859831 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:00.859453    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerDied","Data":"dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba"}
May 29 17:49:01.863822 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:01.863783    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerStarted","Data":"0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054"}
May 29 17:49:07.884145 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:07.884063    2558 generic.go:358] "Generic (PLEG): container finished" podID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerID="0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054" exitCode=0
May 29 17:49:07.884145 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:07.884104    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerDied","Data":"0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054"}
May 29 17:49:08.890583 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:08.890552    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerStarted","Data":"a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3"}
May 29 17:49:08.891069 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:08.890594    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerStarted","Data":"234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4"}
May 29 17:49:08.912325 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:08.912269    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podStartSLOduration=10.91225166 podStartE2EDuration="10.91225166s" podCreationTimestamp="2026-05-29 17:48:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:49:08.909971197 +0000 UTC m=+1001.895793184" watchObservedRunningTime="2026-05-29 17:49:08.91225166 +0000 UTC m=+1001.898073649"
May 29 17:49:09.051151 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:09.051108    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:09.051328 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:09.051167    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:11.051458 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:11.051411    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:11.051458 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:11.051463    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:11.053067 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:11.053042    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.40:6567/health\": dial tcp 10.134.0.40:6567: connect: connection refused"
May 29 17:49:11.053067 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:11.053051    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.40:6571: connect: connection refused"
May 29 17:49:14.051632 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:14.051567    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.40:6571: connect: connection refused"
May 29 17:49:14.058762 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:14.058719    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:14.062740 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:14.062717    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:17.051133 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:17.051094    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.40:6571: connect: connection refused"
May 29 17:49:20.051839 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:20.051809    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:20.052486 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:20.052469    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:49:23.980856 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:23.980814    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"]
May 29 17:49:23.983902 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:23.983886    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:23.986939 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:23.986918    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-69hnj\""
May 29 17:49:23.987300 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:23.987283    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 29 17:49:23.987508 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:23.987487    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 29 17:49:23.987508 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:23.987504    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 29 17:49:24.004776 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.004738    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"]
May 29 17:49:24.026464 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.026445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.026598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.026485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-feast-data\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.026598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.026513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-online-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.026598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.026551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92xr7\" (UniqueName: \"kubernetes.io/projected/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-kube-api-access-92xr7\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.127106 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.127082    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-feast-data\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.127230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.127121    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-online-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.127230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.127137    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92xr7\" (UniqueName: \"kubernetes.io/projected/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-kube-api-access-92xr7\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.127230 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.127182    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.127351 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:49:24.127301    2558 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
May 29 17:49:24.127397 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:49:24.127386    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls podName:8148a7da-7fbd-4ab8-8bb7-4384b9bff628 nodeName:}" failed. No retries permitted until 2026-05-29 17:49:24.627366778 +0000 UTC m=+1017.613188754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls") pod "feast-driver-ranking-846d57948-4tw5x" (UID: "8148a7da-7fbd-4ab8-8bb7-4384b9bff628") : secret "feast-driver-ranking-registry-tls" not found
May 29 17:49:24.127523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.127500    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-feast-data\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.129407 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.129386    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-online-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.135426 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.135407    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92xr7\" (UniqueName: \"kubernetes.io/projected/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-kube-api-access-92xr7\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.631612 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.631575    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.634073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.634039    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls\") pod \"feast-driver-ranking-846d57948-4tw5x\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") " pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:24.894232 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:24.894154    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:25.021655 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:25.021627    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"]
May 29 17:49:25.023975 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:49:25.023949    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8148a7da_7fbd_4ab8_8bb7_4384b9bff628.slice/crio-ac32eeafc7f1d41cd6b62df178e93631ce59e9ac8f798fa85f1bd1334b9781c6 WatchSource:0}: Error finding container ac32eeafc7f1d41cd6b62df178e93631ce59e9ac8f798fa85f1bd1334b9781c6: Status 404 returned error can't find the container with id ac32eeafc7f1d41cd6b62df178e93631ce59e9ac8f798fa85f1bd1334b9781c6
May 29 17:49:25.963710 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:25.963674    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerStarted","Data":"980e5ea9ce00acb244e90bba6b0a78d780e9b54d1d5e92aec6338f6385205186"}
May 29 17:49:25.963710 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:25.963713    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerStarted","Data":"ac32eeafc7f1d41cd6b62df178e93631ce59e9ac8f798fa85f1bd1334b9781c6"}
May 29 17:49:29.978743 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:29.978709    2558 generic.go:358] "Generic (PLEG): container finished" podID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerID="980e5ea9ce00acb244e90bba6b0a78d780e9b54d1d5e92aec6338f6385205186" exitCode=0
May 29 17:49:29.979129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:29.978785    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerDied","Data":"980e5ea9ce00acb244e90bba6b0a78d780e9b54d1d5e92aec6338f6385205186"}
May 29 17:49:30.983822 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:30.983787    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerStarted","Data":"e326062ca9de122a31e6a7dc70dd059946a387499a7bcfa674231e280a7a4b8e"}
May 29 17:49:38.011361 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:38.011326    2558 generic.go:358] "Generic (PLEG): container finished" podID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerID="e326062ca9de122a31e6a7dc70dd059946a387499a7bcfa674231e280a7a4b8e" exitCode=0
May 29 17:49:38.011713 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:38.011401    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerDied","Data":"e326062ca9de122a31e6a7dc70dd059946a387499a7bcfa674231e280a7a4b8e"}
May 29 17:49:38.014950 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:38.014933    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 29 17:49:39.018239 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.018199    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerStarted","Data":"ed5d0a2c3080007bff1f58d8cbf2c4822ad2f325f1222c2c6edbfd1336fe7bc3"}
May 29 17:49:39.018602 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.018249    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerStarted","Data":"abf8151c8ca49f5e83528a2761943ee386c721ccc6149a9e9a63c45c59f5f9f0"}
May 29 17:49:39.041564 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.041506    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podStartSLOduration=16.04149002 podStartE2EDuration="16.04149002s" podCreationTimestamp="2026-05-29 17:49:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:49:39.039853698 +0000 UTC m=+1032.025675711" watchObservedRunningTime="2026-05-29 17:49:39.04149002 +0000 UTC m=+1032.027312008"
May 29 17:49:39.895265 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.895224    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:39.895431 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.895276    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:39.896721 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.896690    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.41:6571: connect: connection refused"
May 29 17:49:39.896856 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:39.896740    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online" probeResult="failure" output="Get \"https://10.134.0.41:6567/health\": dial tcp 10.134.0.41:6567: connect: connection refused"
May 29 17:49:42.895180 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:42.895124    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.41:6571: connect: connection refused"
May 29 17:49:42.895543 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:42.895142    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online" probeResult="failure" output="Get \"https://10.134.0.41:6567/health\": dial tcp 10.134.0.41:6567: connect: connection refused"
May 29 17:49:44.895012 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:44.894979    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:44.895012 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:44.895016    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:45.894796 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:45.894732    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.41:6571: connect: connection refused"
May 29 17:49:45.899838 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:45.899805    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:45.902820 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:45.902797    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:48.895642 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:48.895609    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:49:48.896243 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:49:48.896225    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:51:01.654539 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.654483    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"]
May 29 17:51:01.655069 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.654697    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b" podUID="fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" containerName="manager" containerID="cri-o://2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7" gracePeriod=10
May 29 17:51:01.922445 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.922359    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"]
May 29 17:51:01.922996 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.922735    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry" containerID="cri-o://234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4" gracePeriod=30
May 29 17:51:01.922996 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.922827    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online" containerID="cri-o://a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3" gracePeriod=30
May 29 17:51:01.930090 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.930067    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"]
May 29 17:51:01.943237 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:01.943217    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:51:02.047565 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.047531    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj5bz\" (UniqueName: \"kubernetes.io/projected/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc-kube-api-access-gj5bz\") pod \"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc\" (UID: \"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc\") "
May 29 17:51:02.049738 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.049711    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc-kube-api-access-gj5bz" (OuterVolumeSpecName: "kube-api-access-gj5bz") pod "fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" (UID: "fcba1add-7201-4bc0-bcb1-5f4363f7f6cc"). InnerVolumeSpecName "kube-api-access-gj5bz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:51:02.148817 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.148776    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj5bz\" (UniqueName: \"kubernetes.io/projected/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc-kube-api-access-gj5bz\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:02.296990 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.296956    2558 generic.go:358] "Generic (PLEG): container finished" podID="fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" containerID="2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7" exitCode=0
May 29 17:51:02.297174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.297026    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"
May 29 17:51:02.297174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.297040    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b" event={"ID":"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc","Type":"ContainerDied","Data":"2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7"}
May 29 17:51:02.297174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.297074    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b" event={"ID":"fcba1add-7201-4bc0-bcb1-5f4363f7f6cc","Type":"ContainerDied","Data":"13009538ee4bb2208f457ee89d00a95b8260f6ce828105b72eaf305ae25847d3"}
May 29 17:51:02.297174 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.297094    2558 scope.go:117] "RemoveContainer" containerID="2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7"
May 29 17:51:02.297523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.297495    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online" containerID="cri-o://ed5d0a2c3080007bff1f58d8cbf2c4822ad2f325f1222c2c6edbfd1336fe7bc3" gracePeriod=30
May 29 17:51:02.297632 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.297498    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry" containerID="cri-o://abf8151c8ca49f5e83528a2761943ee386c721ccc6149a9e9a63c45c59f5f9f0" gracePeriod=30
May 29 17:51:02.307478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.307459    2558 scope.go:117] "RemoveContainer" containerID="2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7"
May 29 17:51:02.307790 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:51:02.307746    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7\": container with ID starting with 2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7 not found: ID does not exist" containerID="2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7"
May 29 17:51:02.307845 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.307805    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7"} err="failed to get container status \"2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7\": rpc error: code = NotFound desc = could not find container \"2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7\": container with ID starting with 2ea93cbe621aa3c157a82f98b94e30e48e0ff4919ae61fbd1d99cc2ce86380c7 not found: ID does not exist"
May 29 17:51:02.318478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.318437    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"]
May 29 17:51:02.322188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:02.322170    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-69fd94f688-v224b"]
May 29 17:51:03.304183 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:03.304154    2558 generic.go:358] "Generic (PLEG): container finished" podID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerID="a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3" exitCode=0
May 29 17:51:03.304563 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:03.304221    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerDied","Data":"a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3"}
May 29 17:51:03.305984 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:03.305966    2558 generic.go:358] "Generic (PLEG): container finished" podID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerID="ed5d0a2c3080007bff1f58d8cbf2c4822ad2f325f1222c2c6edbfd1336fe7bc3" exitCode=0
May 29 17:51:03.306059 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:03.306018    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerDied","Data":"ed5d0a2c3080007bff1f58d8cbf2c4822ad2f325f1222c2c6edbfd1336fe7bc3"}
May 29 17:51:03.511350 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:03.511318    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" path="/var/lib/kubelet/pods/fcba1add-7201-4bc0-bcb1-5f4363f7f6cc/volumes"
May 29 17:51:04.059540 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.059499    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.40:6567/health\": dial tcp 10.134.0.40:6567: connect: connection refused"
May 29 17:51:04.184409 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.184372    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-zl22x"]
May 29 17:51:04.184582 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.184564    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x" podUID="4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" containerName="postgres" containerID="cri-o://3ecf4404c75e7ef45f84d5c5d57f2d2ff0a8d5e00397ca90831cfc0824ddb82d" gracePeriod=30
May 29 17:51:04.190251 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.190225    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-97tgx"]
May 29 17:51:04.190492 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.190467    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-97tgx" podUID="fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" containerName="redis" containerID="cri-o://d1eb32d24cfdd981af5735f083636c78377501c06b7fdbc911b3291be53eaad8" gracePeriod=30
May 29 17:51:04.318262 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.318181    2558 generic.go:358] "Generic (PLEG): container finished" podID="fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" containerID="d1eb32d24cfdd981af5735f083636c78377501c06b7fdbc911b3291be53eaad8" exitCode=0
May 29 17:51:04.318606 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.318251    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-97tgx" event={"ID":"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4","Type":"ContainerDied","Data":"d1eb32d24cfdd981af5735f083636c78377501c06b7fdbc911b3291be53eaad8"}
May 29 17:51:04.320017 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.319993    2558 generic.go:358] "Generic (PLEG): container finished" podID="4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" containerID="3ecf4404c75e7ef45f84d5c5d57f2d2ff0a8d5e00397ca90831cfc0824ddb82d" exitCode=0
May 29 17:51:04.320111 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.320039    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x" event={"ID":"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51","Type":"ContainerDied","Data":"3ecf4404c75e7ef45f84d5c5d57f2d2ff0a8d5e00397ca90831cfc0824ddb82d"}
May 29 17:51:04.444365 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.444346    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:51:04.447655 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.447638    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:51:04.468980 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.468957    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-postgresdata\") pod \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") "
May 29 17:51:04.469107 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.469063    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk2v6\" (UniqueName: \"kubernetes.io/projected/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-kube-api-access-tk2v6\") pod \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\" (UID: \"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51\") "
May 29 17:51:04.469182 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.469127    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnpqk\" (UniqueName: \"kubernetes.io/projected/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4-kube-api-access-xnpqk\") pod \"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4\" (UID: \"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4\") "
May 29 17:51:04.472404 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.472373    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4-kube-api-access-xnpqk" (OuterVolumeSpecName: "kube-api-access-xnpqk") pod "fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" (UID: "fd6fba62-bb95-425d-a3e3-8ed050d3f1b4"). InnerVolumeSpecName "kube-api-access-xnpqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:51:04.472532 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.472425    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-kube-api-access-tk2v6" (OuterVolumeSpecName: "kube-api-access-tk2v6") pod "4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" (UID: "4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51"). InnerVolumeSpecName "kube-api-access-tk2v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:51:04.504661 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.504627    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" (UID: "4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:51:04.570989 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.570899    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnpqk\" (UniqueName: \"kubernetes.io/projected/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4-kube-api-access-xnpqk\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:04.570989 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.570939    2558 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-postgresdata\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:04.570989 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:04.570950    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk2v6\" (UniqueName: \"kubernetes.io/projected/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51-kube-api-access-tk2v6\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:05.323971 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.323941    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x"
May 29 17:51:05.323971 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.323955    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-zl22x" event={"ID":"4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51","Type":"ContainerDied","Data":"8ccf6c23062ed06bbc2e36c6eb975197e29375eeb93fe00a7e25786a51f995cb"}
May 29 17:51:05.324440 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.323997    2558 scope.go:117] "RemoveContainer" containerID="3ecf4404c75e7ef45f84d5c5d57f2d2ff0a8d5e00397ca90831cfc0824ddb82d"
May 29 17:51:05.325175 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.325158    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-97tgx"
May 29 17:51:05.325257 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.325167    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-97tgx" event={"ID":"fd6fba62-bb95-425d-a3e3-8ed050d3f1b4","Type":"ContainerDied","Data":"ceb9b81cac2b98cb0951a5072d49df62fd394c7a1996f0179fbe7f1e9a578d7e"}
May 29 17:51:05.332006 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.331987    2558 scope.go:117] "RemoveContainer" containerID="d1eb32d24cfdd981af5735f083636c78377501c06b7fdbc911b3291be53eaad8"
May 29 17:51:05.347767 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.347727    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-zl22x"]
May 29 17:51:05.351201 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.351179    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-zl22x"]
May 29 17:51:05.363868 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.363845    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-97tgx"]
May 29 17:51:05.365679 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.365657    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-97tgx"]
May 29 17:51:05.510193 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.510131    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" path="/var/lib/kubelet/pods/4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51/volumes"
May 29 17:51:05.510417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.510405    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" path="/var/lib/kubelet/pods/fd6fba62-bb95-425d-a3e3-8ed050d3f1b4/volumes"
May 29 17:51:05.900825 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:05.900720    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online" probeResult="failure" output="Get \"https://10.134.0.41:6567/health\": dial tcp 10.134.0.41:6567: connect: connection refused"
May 29 17:51:14.060339 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:14.060294    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.40:6567/health\": dial tcp 10.134.0.40:6567: connect: connection refused"
May 29 17:51:15.901061 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:15.901023    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online" probeResult="failure" output="Get \"https://10.134.0.41:6567/health\": dial tcp 10.134.0.41:6567: connect: connection refused"
May 29 17:51:24.059413 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:24.059371    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online" probeResult="failure" output="Get \"https://10.134.0.40:6567/health\": dial tcp 10.134.0.40:6567: connect: connection refused"
May 29 17:51:24.059830 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:24.059500    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:51:25.901033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:25.900977    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online" probeResult="failure" output="Get \"https://10.134.0.41:6567/health\": dial tcp 10.134.0.41:6567: connect: connection refused"
May 29 17:51:25.901461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:25.901102    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:51:32.110885 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.110857    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:51:32.199603 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.199514    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqqg9\" (UniqueName: \"kubernetes.io/projected/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-kube-api-access-fqqg9\") pod \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") "
May 29 17:51:32.199603 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.199566    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls\") pod \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") "
May 29 17:51:32.199603 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.199599    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-registry-tls\") pod \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") "
May 29 17:51:32.199872 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.199635    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-feast-data\") pod \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\" (UID: \"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff\") "
May 29 17:51:32.201855 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.201827    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls" (OuterVolumeSpecName: "online-tls") pod "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" (UID: "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:51:32.201969 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.201882    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" (UID: "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:51:32.201969 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.201931    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-kube-api-access-fqqg9" (OuterVolumeSpecName: "kube-api-access-fqqg9") pod "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" (UID: "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff"). InnerVolumeSpecName "kube-api-access-fqqg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:51:32.208813 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.208747    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-feast-data" (OuterVolumeSpecName: "feast-data") pod "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" (UID: "ef2ff5a8-2e97-4ece-813a-2ba98311c9ff"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:51:32.300363 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.300329    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:32.300363 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.300361    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqqg9\" (UniqueName: \"kubernetes.io/projected/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-kube-api-access-fqqg9\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:32.300363 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.300371    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:32.300576 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.300381    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:32.421430 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.421396    2558 generic.go:358] "Generic (PLEG): container finished" podID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerID="234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4" exitCode=137
May 29 17:51:32.421610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.421468    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"
May 29 17:51:32.421610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.421468    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerDied","Data":"234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4"}
May 29 17:51:32.421610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.421577    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr" event={"ID":"ef2ff5a8-2e97-4ece-813a-2ba98311c9ff","Type":"ContainerDied","Data":"b7c4d1cbf9a4f1c778699bb1dd1f1ed7ce31d26e86c1638c1d3a6069619f78fb"}
May 29 17:51:32.421610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.421605    2558 scope.go:117] "RemoveContainer" containerID="a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3"
May 29 17:51:32.423933 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.423895    2558 generic.go:358] "Generic (PLEG): container finished" podID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerID="abf8151c8ca49f5e83528a2761943ee386c721ccc6149a9e9a63c45c59f5f9f0" exitCode=137
May 29 17:51:32.424038 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.423954    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerDied","Data":"abf8151c8ca49f5e83528a2761943ee386c721ccc6149a9e9a63c45c59f5f9f0"}
May 29 17:51:32.430159 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.430133    2558 scope.go:117] "RemoveContainer" containerID="234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4"
May 29 17:51:32.437935 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.437805    2558 scope.go:117] "RemoveContainer" containerID="0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054"
May 29 17:51:32.443360 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.443334    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"]
May 29 17:51:32.445802 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.445783    2558 scope.go:117] "RemoveContainer" containerID="dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba"
May 29 17:51:32.448619 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.448596    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-74c5585fcf-8htwr"]
May 29 17:51:32.453589 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.453567    2558 scope.go:117] "RemoveContainer" containerID="a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3"
May 29 17:51:32.453882 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:51:32.453860    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3\": container with ID starting with a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3 not found: ID does not exist" containerID="a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3"
May 29 17:51:32.453954 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.453892    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3"} err="failed to get container status \"a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3\": rpc error: code = NotFound desc = could not find container \"a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3\": container with ID starting with a2f4fcdb90408337e2cb3d1cdd7976276e6b09152661eb78c2fde69e607377a3 not found: ID does not exist"
May 29 17:51:32.453954 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.453913    2558 scope.go:117] "RemoveContainer" containerID="234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4"
May 29 17:51:32.454173 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:51:32.454148    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4\": container with ID starting with 234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4 not found: ID does not exist" containerID="234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4"
May 29 17:51:32.454217 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.454178    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4"} err="failed to get container status \"234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4\": rpc error: code = NotFound desc = could not find container \"234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4\": container with ID starting with 234d0e187eb6d15840b86a14867ecd7bce24d5db6e36acc7c88b724e99a393e4 not found: ID does not exist"
May 29 17:51:32.454217 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.454194    2558 scope.go:117] "RemoveContainer" containerID="0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054"
May 29 17:51:32.454393 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:51:32.454374    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054\": container with ID starting with 0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054 not found: ID does not exist" containerID="0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054"
May 29 17:51:32.454454 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.454396    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054"} err="failed to get container status \"0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054\": rpc error: code = NotFound desc = could not find container \"0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054\": container with ID starting with 0c58d0a4fc1e4136c5c33da1cab3630cf3faaf87a0303e63e780c63eddbdf054 not found: ID does not exist"
May 29 17:51:32.454454 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.454408    2558 scope.go:117] "RemoveContainer" containerID="dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba"
May 29 17:51:32.454658 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:51:32.454639    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba\": container with ID starting with dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba not found: ID does not exist" containerID="dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba"
May 29 17:51:32.454713 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.454665    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba"} err="failed to get container status \"dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba\": rpc error: code = NotFound desc = could not find container \"dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba\": container with ID starting with dfaab8ac3efb209a1f0b359854c7e7fe9f86d6f9c5ced309279d281428da65ba not found: ID does not exist"
May 29 17:51:32.929893 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:32.929869    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:51:33.004858 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.004818    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-online-tls\") pod \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") "
May 29 17:51:33.005071 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.004869    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92xr7\" (UniqueName: \"kubernetes.io/projected/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-kube-api-access-92xr7\") pod \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") "
May 29 17:51:33.005071 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.004905    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-feast-data\") pod \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") "
May 29 17:51:33.005071 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.005014    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls\") pod \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\" (UID: \"8148a7da-7fbd-4ab8-8bb7-4384b9bff628\") "
May 29 17:51:33.005378 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.005351    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-feast-data" (OuterVolumeSpecName: "feast-data") pod "8148a7da-7fbd-4ab8-8bb7-4384b9bff628" (UID: "8148a7da-7fbd-4ab8-8bb7-4384b9bff628"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:51:33.007042 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.007017    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8148a7da-7fbd-4ab8-8bb7-4384b9bff628" (UID: "8148a7da-7fbd-4ab8-8bb7-4384b9bff628"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:51:33.007166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.007132    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-online-tls" (OuterVolumeSpecName: "online-tls") pod "8148a7da-7fbd-4ab8-8bb7-4384b9bff628" (UID: "8148a7da-7fbd-4ab8-8bb7-4384b9bff628"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:51:33.007229 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.007193    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-kube-api-access-92xr7" (OuterVolumeSpecName: "kube-api-access-92xr7") pod "8148a7da-7fbd-4ab8-8bb7-4384b9bff628" (UID: "8148a7da-7fbd-4ab8-8bb7-4384b9bff628"). InnerVolumeSpecName "kube-api-access-92xr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:51:33.105816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.105726    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:33.105816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.105783    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92xr7\" (UniqueName: \"kubernetes.io/projected/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-kube-api-access-92xr7\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:33.105816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.105794    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:33.105816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.105803    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8148a7da-7fbd-4ab8-8bb7-4384b9bff628-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:51:33.429708 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.429573    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x" event={"ID":"8148a7da-7fbd-4ab8-8bb7-4384b9bff628","Type":"ContainerDied","Data":"ac32eeafc7f1d41cd6b62df178e93631ce59e9ac8f798fa85f1bd1334b9781c6"}
May 29 17:51:33.429708 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.429588    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"
May 29 17:51:33.429708 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.429631    2558 scope.go:117] "RemoveContainer" containerID="ed5d0a2c3080007bff1f58d8cbf2c4822ad2f325f1222c2c6edbfd1336fe7bc3"
May 29 17:51:33.440525 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.440495    2558 scope.go:117] "RemoveContainer" containerID="abf8151c8ca49f5e83528a2761943ee386c721ccc6149a9e9a63c45c59f5f9f0"
May 29 17:51:33.451030 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.450850    2558 scope.go:117] "RemoveContainer" containerID="e326062ca9de122a31e6a7dc70dd059946a387499a7bcfa674231e280a7a4b8e"
May 29 17:51:33.457772 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.457730    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"]
May 29 17:51:33.460694 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.460672    2558 scope.go:117] "RemoveContainer" containerID="980e5ea9ce00acb244e90bba6b0a78d780e9b54d1d5e92aec6338f6385205186"
May 29 17:51:33.463381 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.463354    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-846d57948-4tw5x"]
May 29 17:51:33.510831 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.510788    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" path="/var/lib/kubelet/pods/8148a7da-7fbd-4ab8-8bb7-4384b9bff628/volumes"
May 29 17:51:33.511351 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.511330    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" path="/var/lib/kubelet/pods/ef2ff5a8-2e97-4ece-813a-2ba98311c9ff/volumes"
May 29 17:51:33.544609 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.544571    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"]
May 29 17:51:33.545016 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.544999    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545019    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545031    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="feast-init"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545039    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="feast-init"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545054    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="feast-init"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545062    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="feast-init"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545087    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="feast-apply"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545095    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="feast-apply"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545108    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" containerName="manager"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545116    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" containerName="manager"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545126    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online"
May 29 17:51:33.545129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545134    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545144    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" containerName="redis"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545152    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" containerName="redis"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545167    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" containerName="postgres"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545175    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" containerName="postgres"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545184    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545196    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545204    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545212    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545223    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="feast-apply"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545232    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="feast-apply"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545338    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="fcba1add-7201-4bc0-bcb1-5f4363f7f6cc" containerName="manager"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545351    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="registry"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545362    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="4f10f6cb-aa90-4a1f-8bc1-c2a1a9238e51" containerName="postgres"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545375    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8148a7da-7fbd-4ab8-8bb7-4384b9bff628" containerName="online"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545386    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="online"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545397    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="ef2ff5a8-2e97-4ece-813a-2ba98311c9ff" containerName="registry"
May 29 17:51:33.545680 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.545406    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd6fba62-bb95-425d-a3e3-8ed050d3f1b4" containerName="redis"
May 29 17:51:33.551202 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.551175    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.553448 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.553424    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 29 17:51:33.553716 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.553695    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 29 17:51:33.553856 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.553785    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 29 17:51:33.553924 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.553859    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 29 17:51:33.553979 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.553943    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 29 17:51:33.554036 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.554000    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 29 17:51:33.554168 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.554152    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-qzskn\""
May 29 17:51:33.559467 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.559439    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"]
May 29 17:51:33.710523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.710414    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.710523 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.710490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5k7\" (UniqueName: \"kubernetes.io/projected/0914653c-6127-4756-b0d7-643ab7fb66e4-kube-api-access-7l5k7\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.710793 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.710534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.710793 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.710597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.710793 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.710649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0914653c-6127-4756-b0d7-643ab7fb66e4-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.710793 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.710669    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811052 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811019    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811052 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811055    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0914653c-6127-4756-b0d7-643ab7fb66e4-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811074    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811102    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811140    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5k7\" (UniqueName: \"kubernetes.io/projected/0914653c-6127-4756-b0d7-643ab7fb66e4-kube-api-access-7l5k7\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811303 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811173    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.811561 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.811430    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0914653c-6127-4756-b0d7-643ab7fb66e4-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.813630 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.813600    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.813777 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.813660    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.813777 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.813660    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.813777 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.813726    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.818717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.818693    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5k7\" (UniqueName: \"kubernetes.io/projected/0914653c-6127-4756-b0d7-643ab7fb66e4-kube-api-access-7l5k7\") pod \"feast-simple-feast-setup-664fcfcc58-m7tfv\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:33.871557 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:33.871519    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:51:34.004551 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:34.004513    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"]
May 29 17:51:34.006719 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:51:34.006688    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0914653c_6127_4756_b0d7_643ab7fb66e4.slice/crio-c172fea7836b69ee98411f942ea251fbfe6509dfa57ae568d58251c652d97941 WatchSource:0}: Error finding container c172fea7836b69ee98411f942ea251fbfe6509dfa57ae568d58251c652d97941: Status 404 returned error can't find the container with id c172fea7836b69ee98411f942ea251fbfe6509dfa57ae568d58251c652d97941
May 29 17:51:34.008570 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:34.008553    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:51:34.436031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:34.435991    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"c172fea7836b69ee98411f942ea251fbfe6509dfa57ae568d58251c652d97941"}
May 29 17:51:49.489122 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:49.489086    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"96d928197b403d3988fab362e76ed03656afe90fe774265de0106c323a4830dc"}
May 29 17:51:53.502659 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:53.502626    2558 generic.go:358] "Generic (PLEG): container finished" podID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerID="96d928197b403d3988fab362e76ed03656afe90fe774265de0106c323a4830dc" exitCode=0
May 29 17:51:53.503037 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:53.502674    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"96d928197b403d3988fab362e76ed03656afe90fe774265de0106c323a4830dc"}
May 29 17:51:54.508299 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:54.508268    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"732127a070f383ad363ebbf172e567b45b9a0f51c2a0973320a45077d24195dd"}
May 29 17:51:59.523673 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:59.523637    2558 generic.go:358] "Generic (PLEG): container finished" podID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerID="732127a070f383ad363ebbf172e567b45b9a0f51c2a0973320a45077d24195dd" exitCode=0
May 29 17:51:59.524066 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:51:59.523712    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"732127a070f383ad363ebbf172e567b45b9a0f51c2a0973320a45077d24195dd"}
May 29 17:52:00.531839 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.531790    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"cdac87e74bc04fd8aefb1d291f90e82f6fb31c42bc44f97f91392b3b1ec77d73"}
May 29 17:52:00.532296 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.531849    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"0fea2519eb255f00ed6027890e39cd02ad7fecdd9542a3d65dca4d7d91f52662"}
May 29 17:52:00.532296 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.531865    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"e3d505e53c895272440f3d87c4c99ba3b8d415c1b82c4132cf333031dde2c01a"}
May 29 17:52:00.532296 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.531876    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerStarted","Data":"1d86195b43214c8eb4b9213b71053dde395ae83880237a4bbd76ef0c5ac4ab8c"}
May 29 17:52:00.557098 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.557030    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podStartSLOduration=12.990590065 podStartE2EDuration="27.557008892s" podCreationTimestamp="2026-05-29 17:51:33 +0000 UTC" firstStartedPulling="2026-05-29 17:51:34.008697262 +0000 UTC m=+1146.994519228" lastFinishedPulling="2026-05-29 17:51:48.575116088 +0000 UTC m=+1161.560938055" observedRunningTime="2026-05-29 17:52:00.555479071 +0000 UTC m=+1173.541301071" watchObservedRunningTime="2026-05-29 17:52:00.557008892 +0000 UTC m=+1173.542830885"
May 29 17:52:00.872287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.872189    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:00.872287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.872239    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:00.872287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.872256    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:00.872287 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.872268    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:00.874583 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.874541    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.42:8443: connect: connection refused"
May 29 17:52:00.874728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.874571    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.42:8816: connect: connection refused"
May 29 17:52:00.874728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.874584    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.42:6571: connect: connection refused"
May 29 17:52:00.874728 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:00.874663    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.42:6567/health\": dial tcp 10.134.0.42:6567: connect: connection refused"
May 29 17:52:03.871900 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.871848    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:03.872417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872050    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:03.872417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872187    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:03.872417 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872219    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:03.872718 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872678    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.42:8443: connect: connection refused"
May 29 17:52:03.872935 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872678    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.42:8816: connect: connection refused"
May 29 17:52:03.873161 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872736    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.42:6571: connect: connection refused"
May 29 17:52:03.873269 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:03.872818    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.42:6567/health\": dial tcp 10.134.0.42:6567: connect: connection refused"
May 29 17:52:06.872932 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.872899    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:06.873280 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.873079    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:06.873280 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.873187    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:06.873987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.873932    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:06.874133 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.874109    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:06.874245 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.874231    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:06.877717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:06.877697    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:07.560029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:07.560000    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:52:27.459484 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:27.459450    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:52:27.462199 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:52:27.462173    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:53:09.453123 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.453089    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"]
May 29 17:53:09.453587 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.453472    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="registry" containerID="cri-o://1d86195b43214c8eb4b9213b71053dde395ae83880237a4bbd76ef0c5ac4ab8c" gracePeriod=30
May 29 17:53:09.453810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.453735    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online" containerID="cri-o://e3d505e53c895272440f3d87c4c99ba3b8d415c1b82c4132cf333031dde2c01a" gracePeriod=30
May 29 17:53:09.453810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.453796    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui" containerID="cri-o://cdac87e74bc04fd8aefb1d291f90e82f6fb31c42bc44f97f91392b3b1ec77d73" gracePeriod=30
May 29 17:53:09.454020 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.453880    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="offline" containerID="cri-o://0fea2519eb255f00ed6027890e39cd02ad7fecdd9542a3d65dca4d7d91f52662" gracePeriod=30
May 29 17:53:09.865478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.865344    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"]
May 29 17:53:09.870188 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.870162    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:09.872959 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.872928    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g74vp\""
May 29 17:53:09.882960 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.882934    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"]
May 29 17:53:09.937196 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.937161    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:09.937380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.937212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gff52\" (UniqueName: \"kubernetes.io/projected/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-kube-api-access-gff52\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:09.937380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.937319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:09.937380 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.937357    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:09.937556 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.937388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:09.937556 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:09.937432    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.038258 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038223    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.038258 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038266    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gff52\" (UniqueName: \"kubernetes.io/projected/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-kube-api-access-gff52\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.038550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038454    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.038550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038496    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.038550 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038528    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.038706 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038577    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.039012 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:53:10.038809    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 29 17:53:10.039012 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.038881    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.039012 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:53:10.038889    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls podName:abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1 nodeName:}" failed. No retries permitted until 2026-05-29 17:53:10.538868761 +0000 UTC m=+1243.524690728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-hd5tl" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1") : secret "feast-simple-feast-setup-registry-tls" not found
May 29 17:53:10.041190 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.041165    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.041343 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.041324    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.041620 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.041602    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.051449 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.051412    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gff52\" (UniqueName: \"kubernetes.io/projected/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-kube-api-access-gff52\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.541545 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.541510    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.543879 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.543856    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-hd5tl\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.755231 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.755193    2558 generic.go:358] "Generic (PLEG): container finished" podID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerID="cdac87e74bc04fd8aefb1d291f90e82f6fb31c42bc44f97f91392b3b1ec77d73" exitCode=0
May 29 17:53:10.755231 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.755226    2558 generic.go:358] "Generic (PLEG): container finished" podID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerID="e3d505e53c895272440f3d87c4c99ba3b8d415c1b82c4132cf333031dde2c01a" exitCode=0
May 29 17:53:10.755435 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.755262    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"cdac87e74bc04fd8aefb1d291f90e82f6fb31c42bc44f97f91392b3b1ec77d73"}
May 29 17:53:10.755435 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.755295    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"e3d505e53c895272440f3d87c4c99ba3b8d415c1b82c4132cf333031dde2c01a"}
May 29 17:53:10.781509 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.781472    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:10.921342 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:10.921313    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"]
May 29 17:53:10.923830 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:53:10.923798    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabe1edb3_8dd8_4c81_a22a_715d5a9e2bf1.slice/crio-efb63e38b36cf4e2b31dfc8fe69831d213ceb28e71ab33aff502f7ab8af7ecd4 WatchSource:0}: Error finding container efb63e38b36cf4e2b31dfc8fe69831d213ceb28e71ab33aff502f7ab8af7ecd4: Status 404 returned error can't find the container with id efb63e38b36cf4e2b31dfc8fe69831d213ceb28e71ab33aff502f7ab8af7ecd4
May 29 17:53:11.760103 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:11.760061    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"19eeff2e356f53fb98583fa1cb9c4db387de1767718aa6c5eeb45c245d59b255"}
May 29 17:53:11.760103 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:11.760101    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"efb63e38b36cf4e2b31dfc8fe69831d213ceb28e71ab33aff502f7ab8af7ecd4"}
May 29 17:53:15.774124 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:15.774084    2558 generic.go:358] "Generic (PLEG): container finished" podID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerID="19eeff2e356f53fb98583fa1cb9c4db387de1767718aa6c5eeb45c245d59b255" exitCode=0
May 29 17:53:15.774650 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:15.774165    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"19eeff2e356f53fb98583fa1cb9c4db387de1767718aa6c5eeb45c245d59b255"}
May 29 17:53:16.779305 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:16.779267    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"ba688b21e5c4ab94d973ee483fc4b38085024c17b5ebe49cee4605461efc8f3e"}
May 29 17:53:16.874641 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:16.874595    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.42:8443: connect: connection refused"
May 29 17:53:17.557956 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:17.557909    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.42:6567/health\": dial tcp 10.134.0.42:6567: connect: connection refused"
May 29 17:53:21.796413 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:21.796328    2558 generic.go:358] "Generic (PLEG): container finished" podID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerID="ba688b21e5c4ab94d973ee483fc4b38085024c17b5ebe49cee4605461efc8f3e" exitCode=0
May 29 17:53:21.796413 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:21.796385    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"ba688b21e5c4ab94d973ee483fc4b38085024c17b5ebe49cee4605461efc8f3e"}
May 29 17:53:22.804941 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:22.804903    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"4c4f38d4ed8767640fd60f611b5d38b3cdcf4409d734bae739e34a3e401b60eb"}
May 29 17:53:22.805484 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:22.805456    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"ee8304a5857afbf3191761802944fc9c3bdecb36722a29c468e30525d640afa2"}
May 29 17:53:22.805610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:22.805593    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"872fd4a209e1133a5c6cd870db91c16d08931a157426fcc2b4784acd4a01989a"}
May 29 17:53:22.805710 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:22.805696    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerStarted","Data":"f9bc6306d57108ea6b9ecb9335693fb07a1f85388c8dae9fb96cbcfbe4f70340"}
May 29 17:53:22.839880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:22.839806    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podStartSLOduration=13.839783144 podStartE2EDuration="13.839783144s" podCreationTimestamp="2026-05-29 17:53:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:53:22.836801632 +0000 UTC m=+1255.822623620" watchObservedRunningTime="2026-05-29 17:53:22.839783144 +0000 UTC m=+1255.825605134"
May 29 17:53:25.782585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.782526    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:25.782585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.782588    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:25.783262 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.782600    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:25.783262 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.782612    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:25.784781 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.784716    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.43:8816: connect: connection refused"
May 29 17:53:25.784781 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.784766    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.43:6571: connect: connection refused"
May 29 17:53:25.785010 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.784795    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.43:6567/health\": dial tcp 10.134.0.43:6567: connect: connection refused"
May 29 17:53:25.785010 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:25.784876    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.43:8443: connect: connection refused"
May 29 17:53:26.875129 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:26.874684    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.42:8443: connect: connection refused"
May 29 17:53:27.557866 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:27.557830    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.42:6567/health\": dial tcp 10.134.0.42:6567: connect: connection refused"
May 29 17:53:28.782921 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.782894    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.783294 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.782982    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.783294 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.783231    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.783608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.783574    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.783608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.783607    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.783844 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.783620    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.784055 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.784038    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.784108 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.784099    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.784152 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.784143    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.787416 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.787399    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.828906 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.828881    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:28.831447 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:28.831429    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:53:36.873819 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:36.873770    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.42:8443: connect: connection refused"
May 29 17:53:36.874278 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:36.873941    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:53:37.557508 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:37.557470    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.42:6567/health\": dial tcp 10.134.0.42:6567: connect: connection refused"
May 29 17:53:37.557685 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:37.557583    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:53:39.863608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:39.863520    2558 generic.go:358] "Generic (PLEG): container finished" podID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerID="0fea2519eb255f00ed6027890e39cd02ad7fecdd9542a3d65dca4d7d91f52662" exitCode=137
May 29 17:53:39.863608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:39.863548    2558 generic.go:358] "Generic (PLEG): container finished" podID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerID="1d86195b43214c8eb4b9213b71053dde395ae83880237a4bbd76ef0c5ac4ab8c" exitCode=137
May 29 17:53:39.863608 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:39.863591    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"0fea2519eb255f00ed6027890e39cd02ad7fecdd9542a3d65dca4d7d91f52662"}
May 29 17:53:39.864050 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:39.863629    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"1d86195b43214c8eb4b9213b71053dde395ae83880237a4bbd76ef0c5ac4ab8c"}
May 29 17:53:40.095132 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.095114    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:53:40.104241 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104222    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l5k7\" (UniqueName: \"kubernetes.io/projected/0914653c-6127-4756-b0d7-643ab7fb66e4-kube-api-access-7l5k7\") pod \"0914653c-6127-4756-b0d7-643ab7fb66e4\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") "
May 29 17:53:40.104320 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104267    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0914653c-6127-4756-b0d7-643ab7fb66e4-feast-data\") pod \"0914653c-6127-4756-b0d7-643ab7fb66e4\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") "
May 29 17:53:40.104320 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104289    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-ui-tls\") pod \"0914653c-6127-4756-b0d7-643ab7fb66e4\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") "
May 29 17:53:40.104320 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104304    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-offline-tls\") pod \"0914653c-6127-4756-b0d7-643ab7fb66e4\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") "
May 29 17:53:40.104480 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104367    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-registry-tls\") pod \"0914653c-6127-4756-b0d7-643ab7fb66e4\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") "
May 29 17:53:40.104480 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104417    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-online-tls\") pod \"0914653c-6127-4756-b0d7-643ab7fb66e4\" (UID: \"0914653c-6127-4756-b0d7-643ab7fb66e4\") "
May 29 17:53:40.104852 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.104819    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0914653c-6127-4756-b0d7-643ab7fb66e4-feast-data" (OuterVolumeSpecName: "feast-data") pod "0914653c-6127-4756-b0d7-643ab7fb66e4" (UID: "0914653c-6127-4756-b0d7-643ab7fb66e4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:53:40.106664 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.106635    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0914653c-6127-4756-b0d7-643ab7fb66e4-kube-api-access-7l5k7" (OuterVolumeSpecName: "kube-api-access-7l5k7") pod "0914653c-6127-4756-b0d7-643ab7fb66e4" (UID: "0914653c-6127-4756-b0d7-643ab7fb66e4"). InnerVolumeSpecName "kube-api-access-7l5k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:53:40.106795 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.106742    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-online-tls" (OuterVolumeSpecName: "online-tls") pod "0914653c-6127-4756-b0d7-643ab7fb66e4" (UID: "0914653c-6127-4756-b0d7-643ab7fb66e4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:53:40.106862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.106799    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0914653c-6127-4756-b0d7-643ab7fb66e4" (UID: "0914653c-6127-4756-b0d7-643ab7fb66e4"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:53:40.106862 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.106824    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0914653c-6127-4756-b0d7-643ab7fb66e4" (UID: "0914653c-6127-4756-b0d7-643ab7fb66e4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:53:40.106946 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.106863    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0914653c-6127-4756-b0d7-643ab7fb66e4" (UID: "0914653c-6127-4756-b0d7-643ab7fb66e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:53:40.205517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.205493    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:53:40.205517 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.205517    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:53:40.205693 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.205526    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l5k7\" (UniqueName: \"kubernetes.io/projected/0914653c-6127-4756-b0d7-643ab7fb66e4-kube-api-access-7l5k7\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:53:40.205693 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.205536    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0914653c-6127-4756-b0d7-643ab7fb66e4-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:53:40.205693 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.205544    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:53:40.205693 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.205552    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0914653c-6127-4756-b0d7-643ab7fb66e4-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:53:40.868886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.868858    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv" event={"ID":"0914653c-6127-4756-b0d7-643ab7fb66e4","Type":"ContainerDied","Data":"c172fea7836b69ee98411f942ea251fbfe6509dfa57ae568d58251c652d97941"}
May 29 17:53:40.868886 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.868897    2558 scope.go:117] "RemoveContainer" containerID="cdac87e74bc04fd8aefb1d291f90e82f6fb31c42bc44f97f91392b3b1ec77d73"
May 29 17:53:40.869349 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.868992    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"
May 29 17:53:40.877197 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.877174    2558 scope.go:117] "RemoveContainer" containerID="0fea2519eb255f00ed6027890e39cd02ad7fecdd9542a3d65dca4d7d91f52662"
May 29 17:53:40.884311 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.884295    2558 scope.go:117] "RemoveContainer" containerID="e3d505e53c895272440f3d87c4c99ba3b8d415c1b82c4132cf333031dde2c01a"
May 29 17:53:40.890937 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.890918    2558 scope.go:117] "RemoveContainer" containerID="1d86195b43214c8eb4b9213b71053dde395ae83880237a4bbd76ef0c5ac4ab8c"
May 29 17:53:40.894214 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.894193    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"]
May 29 17:53:40.898140 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.898119    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m7tfv"]
May 29 17:53:40.900280 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.900217    2558 scope.go:117] "RemoveContainer" containerID="732127a070f383ad363ebbf172e567b45b9a0f51c2a0973320a45077d24195dd"
May 29 17:53:40.908546 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:40.908529    2558 scope.go:117] "RemoveContainer" containerID="96d928197b403d3988fab362e76ed03656afe90fe774265de0106c323a4830dc"
May 29 17:53:41.510600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:53:41.510569    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" path="/var/lib/kubelet/pods/0914653c-6127-4756-b0d7-643ab7fb66e4/volumes"
May 29 17:54:31.920863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.920827    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"]
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921166    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="feast-apply"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921177    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="feast-apply"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921185    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="registry"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921190    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="registry"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921196    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921202    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921211    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="offline"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921218    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="offline"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921223    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921228    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921239    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="feast-init"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921245    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="feast-init"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921294    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="registry"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921306    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="online"
May 29 17:54:31.921313 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921317    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="offline"
May 29 17:54:31.921786 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.921329    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="0914653c-6127-4756-b0d7-643ab7fb66e4" containerName="ui"
May 29 17:54:31.925901 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.925886    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:31.930614 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.930592    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 29 17:54:31.931156 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.931140    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 29 17:54:31.931436 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.931414    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 29 17:54:31.931542 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.931477    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 29 17:54:31.931685 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.931667    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 29 17:54:31.931788 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.931673    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-rk8hc\""
May 29 17:54:31.932014 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.931998    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 29 17:54:31.949223 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:31.949201    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"]
May 29 17:54:32.022290 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.022270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.022400 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.022306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.022400 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.022327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkdf\" (UniqueName: \"kubernetes.io/projected/f437fd0f-553c-4244-a9b7-dda32af7fce8-kube-api-access-5kkdf\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.022400 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.022348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.022522 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.022446    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f437fd0f-553c-4244-a9b7-dda32af7fce8-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.022522 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.022469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f437fd0f-553c-4244-a9b7-dda32af7fce8-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123302 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123278    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f437fd0f-553c-4244-a9b7-dda32af7fce8-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123305    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f437fd0f-553c-4244-a9b7-dda32af7fce8-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123331    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123357    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123388    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkdf\" (UniqueName: \"kubernetes.io/projected/f437fd0f-553c-4244-a9b7-dda32af7fce8-kube-api-access-5kkdf\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123428 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123412    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.123700 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:54:32.123441    2558 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 29 17:54:32.123700 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:54:32.123512    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls podName:f437fd0f-553c-4244-a9b7-dda32af7fce8 nodeName:}" failed. No retries permitted until 2026-05-29 17:54:32.623492309 +0000 UTC m=+1325.609314279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-h8kf9" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 29 17:54:32.123863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.123796    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f437fd0f-553c-4244-a9b7-dda32af7fce8-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.124088 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.124059    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f437fd0f-553c-4244-a9b7-dda32af7fce8-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.125987 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.125969    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.126073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.125992    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.136031 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.136014    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkdf\" (UniqueName: \"kubernetes.io/projected/f437fd0f-553c-4244-a9b7-dda32af7fce8-kube-api-access-5kkdf\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.627295 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.627248    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.629656 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.629629    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-h8kf9\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:32.836986 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:32.836956    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:33.005832 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:33.005806    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"]
May 29 17:54:33.007470 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:54:33.007445    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf437fd0f_553c_4244_a9b7_dda32af7fce8.slice/crio-b0093cd795bc2b1fd8012f794fc9a79284c1b11a6fe992e541dd75fec68671a2 WatchSource:0}: Error finding container b0093cd795bc2b1fd8012f794fc9a79284c1b11a6fe992e541dd75fec68671a2: Status 404 returned error can't find the container with id b0093cd795bc2b1fd8012f794fc9a79284c1b11a6fe992e541dd75fec68671a2
May 29 17:54:33.038022 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:33.037992    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerStarted","Data":"b0093cd795bc2b1fd8012f794fc9a79284c1b11a6fe992e541dd75fec68671a2"}
May 29 17:54:34.042185 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:34.042149    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerStarted","Data":"81e2bae925d86207706fa66879ef12ab8cd04b99452441f94b33639ca29f3968"}
May 29 17:54:38.056000 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:38.055968    2558 generic.go:358] "Generic (PLEG): container finished" podID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerID="81e2bae925d86207706fa66879ef12ab8cd04b99452441f94b33639ca29f3968" exitCode=0
May 29 17:54:38.056373 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:38.056037    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerDied","Data":"81e2bae925d86207706fa66879ef12ab8cd04b99452441f94b33639ca29f3968"}
May 29 17:54:39.061071 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:39.061036    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerStarted","Data":"18564ee3315bbbe41eee9d958dc764d9b020b770aeed440896164829092ff7e9"}
May 29 17:54:44.078227 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:44.078195    2558 generic.go:358] "Generic (PLEG): container finished" podID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerID="18564ee3315bbbe41eee9d958dc764d9b020b770aeed440896164829092ff7e9" exitCode=0
May 29 17:54:44.078740 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:44.078243    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerDied","Data":"18564ee3315bbbe41eee9d958dc764d9b020b770aeed440896164829092ff7e9"}
May 29 17:54:45.084149 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:45.084107    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerStarted","Data":"24e38753aec2fd815d594ba65af2192f4798b6338395de1c0942af3202e0ae43"}
May 29 17:54:45.084528 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:45.084164    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerStarted","Data":"42efc90c64e2a75c83858e6120cb3247d4b8bc00926c9fc42612a5bf2345fb8f"}
May 29 17:54:45.084528 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:45.084180    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerStarted","Data":"f7f768416531ef4e8a090be92168cefa4110330ca04de79b6c49b475e5bc6cc6"}
May 29 17:54:45.159605 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:45.159547    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podStartSLOduration=14.159530177 podStartE2EDuration="14.159530177s" podCreationTimestamp="2026-05-29 17:54:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:54:45.157273498 +0000 UTC m=+1338.143095485" watchObservedRunningTime="2026-05-29 17:54:45.159530177 +0000 UTC m=+1338.145352164"
May 29 17:54:47.837114 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:47.837064    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:47.837595 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:47.837131    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:47.837595 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:47.837146    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:47.839101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:47.839061    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.44:8443: connect: connection refused"
May 29 17:54:47.839101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:47.839079    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.44:6567/health\": dial tcp 10.134.0.44:6567: connect: connection refused"
May 29 17:54:47.839307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:47.839103    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.44:8816: connect: connection refused"
May 29 17:54:50.838710 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:50.838675    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:50.839152 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:50.838979    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:50.839232 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:50.839215    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:50.839423 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:50.839409    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:50.842795 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:50.842777    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:51.108052 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:51.107970    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:51.108052 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:51.108004    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:51.108488 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:51.108473    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:54:51.110662 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:54:51.110645    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:55:53.069229 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.069194    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"]
May 29 17:55:53.069863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.069510    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online" containerID="cri-o://f7f768416531ef4e8a090be92168cefa4110330ca04de79b6c49b475e5bc6cc6" gracePeriod=30
May 29 17:55:53.069863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.069579    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui" containerID="cri-o://24e38753aec2fd815d594ba65af2192f4798b6338395de1c0942af3202e0ae43" gracePeriod=30
May 29 17:55:53.069863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.069618    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="offline" containerID="cri-o://42efc90c64e2a75c83858e6120cb3247d4b8bc00926c9fc42612a5bf2345fb8f" gracePeriod=30
May 29 17:55:53.229171 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.229130    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"]
May 29 17:55:53.229630 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.229545    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="registry" containerID="cri-o://f9bc6306d57108ea6b9ecb9335693fb07a1f85388c8dae9fb96cbcfbe4f70340" gracePeriod=30
May 29 17:55:53.229630 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.229582    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui" containerID="cri-o://4c4f38d4ed8767640fd60f611b5d38b3cdcf4409d734bae739e34a3e401b60eb" gracePeriod=30
May 29 17:55:53.229853 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.229635    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online" containerID="cri-o://872fd4a209e1133a5c6cd870db91c16d08931a157426fcc2b4784acd4a01989a" gracePeriod=30
May 29 17:55:53.229853 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:53.229598    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="offline" containerID="cri-o://ee8304a5857afbf3191761802944fc9c3bdecb36722a29c468e30525d640afa2" gracePeriod=30
May 29 17:55:54.301378 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.301288    2558 generic.go:358] "Generic (PLEG): container finished" podID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerID="4c4f38d4ed8767640fd60f611b5d38b3cdcf4409d734bae739e34a3e401b60eb" exitCode=0
May 29 17:55:54.301378 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.301311    2558 generic.go:358] "Generic (PLEG): container finished" podID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerID="872fd4a209e1133a5c6cd870db91c16d08931a157426fcc2b4784acd4a01989a" exitCode=0
May 29 17:55:54.301378 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.301364    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"4c4f38d4ed8767640fd60f611b5d38b3cdcf4409d734bae739e34a3e401b60eb"}
May 29 17:55:54.301839 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.301404    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"872fd4a209e1133a5c6cd870db91c16d08931a157426fcc2b4784acd4a01989a"}
May 29 17:55:54.303691 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.303670    2558 generic.go:358] "Generic (PLEG): container finished" podID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerID="24e38753aec2fd815d594ba65af2192f4798b6338395de1c0942af3202e0ae43" exitCode=0
May 29 17:55:54.303691 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.303687    2558 generic.go:358] "Generic (PLEG): container finished" podID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerID="f7f768416531ef4e8a090be92168cefa4110330ca04de79b6c49b475e5bc6cc6" exitCode=0
May 29 17:55:54.303863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.303726    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerDied","Data":"24e38753aec2fd815d594ba65af2192f4798b6338395de1c0942af3202e0ae43"}
May 29 17:55:54.303863 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:54.303745    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerDied","Data":"f7f768416531ef4e8a090be92168cefa4110330ca04de79b6c49b475e5bc6cc6"}
May 29 17:55:58.784400 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:58.784350    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.43:8443: connect: connection refused"
May 29 17:55:58.829891 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:55:58.829857    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.43:6567/health\": dial tcp 10.134.0.43:6567: connect: connection refused"
May 29 17:56:01.108424 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:01.108384    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.44:8443: connect: connection refused"
May 29 17:56:01.108816 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:01.108430    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.44:6567/health\": dial tcp 10.134.0.44:6567: connect: connection refused"
May 29 17:56:08.784200 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:08.784155    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.43:8443: connect: connection refused"
May 29 17:56:08.829938 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:08.829894    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.43:6567/health\": dial tcp 10.134.0.43:6567: connect: connection refused"
May 29 17:56:11.109047 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:11.108954    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.44:8443: connect: connection refused"
May 29 17:56:11.109404 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:11.108956    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.44:6567/health\": dial tcp 10.134.0.44:6567: connect: connection refused"
May 29 17:56:18.783812 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:18.783736    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.43:8443: connect: connection refused"
May 29 17:56:18.784228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:18.783901    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:56:18.829142 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:18.829107    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online" probeResult="failure" output="Get \"https://10.134.0.43:6567/health\": dial tcp 10.134.0.43:6567: connect: connection refused"
May 29 17:56:18.829323 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:18.829205    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:56:21.108561 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:21.108510    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.44:8443: connect: connection refused"
May 29 17:56:21.108561 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:21.108544    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online" probeResult="failure" output="Get \"https://10.134.0.44:6567/health\": dial tcp 10.134.0.44:6567: connect: connection refused"
May 29 17:56:21.108997 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:21.108660    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:56:21.108997 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:21.108707    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:56:23.397791 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.397691    2558 generic.go:358] "Generic (PLEG): container finished" podID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerID="42efc90c64e2a75c83858e6120cb3247d4b8bc00926c9fc42612a5bf2345fb8f" exitCode=137
May 29 17:56:23.397791 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.397781    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerDied","Data":"42efc90c64e2a75c83858e6120cb3247d4b8bc00926c9fc42612a5bf2345fb8f"}
May 29 17:56:23.400374 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.400356    2558 generic.go:358] "Generic (PLEG): container finished" podID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerID="ee8304a5857afbf3191761802944fc9c3bdecb36722a29c468e30525d640afa2" exitCode=137
May 29 17:56:23.400374 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.400373    2558 generic.go:358] "Generic (PLEG): container finished" podID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerID="f9bc6306d57108ea6b9ecb9335693fb07a1f85388c8dae9fb96cbcfbe4f70340" exitCode=137
May 29 17:56:23.400526 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.400431    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"ee8304a5857afbf3191761802944fc9c3bdecb36722a29c468e30525d640afa2"}
May 29 17:56:23.400526 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.400460    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"f9bc6306d57108ea6b9ecb9335693fb07a1f85388c8dae9fb96cbcfbe4f70340"}
May 29 17:56:23.712528 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.712505    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:56:23.774200 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774161    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-online-tls\") pod \"f437fd0f-553c-4244-a9b7-dda32af7fce8\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") "
May 29 17:56:23.774200 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774208    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f437fd0f-553c-4244-a9b7-dda32af7fce8-registry-tls\") pod \"f437fd0f-553c-4244-a9b7-dda32af7fce8\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") "
May 29 17:56:23.774576 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774231    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls\") pod \"f437fd0f-553c-4244-a9b7-dda32af7fce8\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") "
May 29 17:56:23.774576 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774250    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-offline-tls\") pod \"f437fd0f-553c-4244-a9b7-dda32af7fce8\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") "
May 29 17:56:23.774576 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774418    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f437fd0f-553c-4244-a9b7-dda32af7fce8-feast-data\") pod \"f437fd0f-553c-4244-a9b7-dda32af7fce8\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") "
May 29 17:56:23.774770 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774586    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f437fd0f-553c-4244-a9b7-dda32af7fce8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f437fd0f-553c-4244-a9b7-dda32af7fce8" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 17:56:23.774876 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.774857    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f437fd0f-553c-4244-a9b7-dda32af7fce8-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:23.775040 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.775022    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f437fd0f-553c-4244-a9b7-dda32af7fce8-feast-data" (OuterVolumeSpecName: "feast-data") pod "f437fd0f-553c-4244-a9b7-dda32af7fce8" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:56:23.776478 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.776456    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f437fd0f-553c-4244-a9b7-dda32af7fce8" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:23.776577 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.776485    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-online-tls" (OuterVolumeSpecName: "online-tls") pod "f437fd0f-553c-4244-a9b7-dda32af7fce8" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:23.776733 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.776721    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f437fd0f-553c-4244-a9b7-dda32af7fce8" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:23.875217 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.875192    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kkdf\" (UniqueName: \"kubernetes.io/projected/f437fd0f-553c-4244-a9b7-dda32af7fce8-kube-api-access-5kkdf\") pod \"f437fd0f-553c-4244-a9b7-dda32af7fce8\" (UID: \"f437fd0f-553c-4244-a9b7-dda32af7fce8\") "
May 29 17:56:23.875461 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.875445    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:23.875532 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.875468    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:23.875532 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.875481    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f437fd0f-553c-4244-a9b7-dda32af7fce8-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:23.875532 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.875495    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f437fd0f-553c-4244-a9b7-dda32af7fce8-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:23.876561 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.876543    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:56:23.877205 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.877183    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f437fd0f-553c-4244-a9b7-dda32af7fce8-kube-api-access-5kkdf" (OuterVolumeSpecName: "kube-api-access-5kkdf") pod "f437fd0f-553c-4244-a9b7-dda32af7fce8" (UID: "f437fd0f-553c-4244-a9b7-dda32af7fce8"). InnerVolumeSpecName "kube-api-access-5kkdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:56:23.976583 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976497    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-ui-tls\") pod \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") "
May 29 17:56:23.976583 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976531    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gff52\" (UniqueName: \"kubernetes.io/projected/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-kube-api-access-gff52\") pod \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") "
May 29 17:56:23.976583 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976552    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-feast-data\") pod \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") "
May 29 17:56:23.976583 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976575    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls\") pod \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") "
May 29 17:56:23.977299 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976600    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-online-tls\") pod \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") "
May 29 17:56:23.977299 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976624    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-offline-tls\") pod \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\" (UID: \"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1\") "
May 29 17:56:23.977299 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.976828    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kkdf\" (UniqueName: \"kubernetes.io/projected/f437fd0f-553c-4244-a9b7-dda32af7fce8-kube-api-access-5kkdf\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:23.977498 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.977342    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-feast-data" (OuterVolumeSpecName: "feast-data") pod "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:56:23.978804 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.978769    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-online-tls" (OuterVolumeSpecName: "online-tls") pod "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:23.978918 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.978828    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-kube-api-access-gff52" (OuterVolumeSpecName: "kube-api-access-gff52") pod "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1"). InnerVolumeSpecName "kube-api-access-gff52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:56:23.978918 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.978826    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:23.979111 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.979094    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:23.979179 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:23.979116    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" (UID: "abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:56:24.077770 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.077717    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:24.077931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.077778    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gff52\" (UniqueName: \"kubernetes.io/projected/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-kube-api-access-gff52\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:24.077931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.077796    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:24.077931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.077810    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:24.077931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.077823    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:24.077931 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.077836    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:56:24.406209 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.406121    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"
May 29 17:56:24.406643 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.406120    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl" event={"ID":"abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1","Type":"ContainerDied","Data":"efb63e38b36cf4e2b31dfc8fe69831d213ceb28e71ab33aff502f7ab8af7ecd4"}
May 29 17:56:24.406643 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.406263    2558 scope.go:117] "RemoveContainer" containerID="4c4f38d4ed8767640fd60f611b5d38b3cdcf4409d734bae739e34a3e401b60eb"
May 29 17:56:24.408513 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.408486    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9" event={"ID":"f437fd0f-553c-4244-a9b7-dda32af7fce8","Type":"ContainerDied","Data":"b0093cd795bc2b1fd8012f794fc9a79284c1b11a6fe992e541dd75fec68671a2"}
May 29 17:56:24.408631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.408534    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"
May 29 17:56:24.415927 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.415907    2558 scope.go:117] "RemoveContainer" containerID="ee8304a5857afbf3191761802944fc9c3bdecb36722a29c468e30525d640afa2"
May 29 17:56:24.423496 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.423481    2558 scope.go:117] "RemoveContainer" containerID="872fd4a209e1133a5c6cd870db91c16d08931a157426fcc2b4784acd4a01989a"
May 29 17:56:24.429669 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.429644    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"]
May 29 17:56:24.431780 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.431737    2558 scope.go:117] "RemoveContainer" containerID="f9bc6306d57108ea6b9ecb9335693fb07a1f85388c8dae9fb96cbcfbe4f70340"
May 29 17:56:24.432671 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.432652    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-hd5tl"]
May 29 17:56:24.439298 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.439282    2558 scope.go:117] "RemoveContainer" containerID="ba688b21e5c4ab94d973ee483fc4b38085024c17b5ebe49cee4605461efc8f3e"
May 29 17:56:24.443846 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.443826    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"]
May 29 17:56:24.447483 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.447465    2558 scope.go:117] "RemoveContainer" containerID="19eeff2e356f53fb98583fa1cb9c4db387de1767718aa6c5eeb45c245d59b255"
May 29 17:56:24.447637 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.447616    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-h8kf9"]
May 29 17:56:24.454600 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.454584    2558 scope.go:117] "RemoveContainer" containerID="24e38753aec2fd815d594ba65af2192f4798b6338395de1c0942af3202e0ae43"
May 29 17:56:24.461775 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.461740    2558 scope.go:117] "RemoveContainer" containerID="42efc90c64e2a75c83858e6120cb3247d4b8bc00926c9fc42612a5bf2345fb8f"
May 29 17:56:24.468512 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.468495    2558 scope.go:117] "RemoveContainer" containerID="f7f768416531ef4e8a090be92168cefa4110330ca04de79b6c49b475e5bc6cc6"
May 29 17:56:24.475596 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.475580    2558 scope.go:117] "RemoveContainer" containerID="18564ee3315bbbe41eee9d958dc764d9b020b770aeed440896164829092ff7e9"
May 29 17:56:24.482353 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:24.482334    2558 scope.go:117] "RemoveContainer" containerID="81e2bae925d86207706fa66879ef12ab8cd04b99452441f94b33639ca29f3968"
May 29 17:56:25.510582 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:25.510550    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" path="/var/lib/kubelet/pods/abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1/volumes"
May 29 17:56:25.511187 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:56:25.511172    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" path="/var/lib/kubelet/pods/f437fd0f-553c-4244-a9b7-dda32af7fce8/volumes"
May 29 17:57:03.092203 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092165    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"]
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092616    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="feast-init"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092629    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="feast-init"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092643    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="feast-init"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092651    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="feast-init"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092662    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092671    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092688    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="offline"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092696    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="offline"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092710    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui"
May 29 17:57:03.092714 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092718    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092729    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="feast-apply"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092737    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="feast-apply"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092765    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="feast-apply"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092775    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="feast-apply"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092785    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="registry"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092794    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="registry"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092802    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="offline"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092810    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="offline"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092820    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092827    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092837    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092910    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="online"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092923    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="offline"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092933    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="ui"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092942    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="offline"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092950    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="abe1edb3-8dd8-4c81-a22a-715d5a9e2bf1" containerName="registry"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092961    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="online"
May 29 17:57:03.093117 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.092973    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="f437fd0f-553c-4244-a9b7-dda32af7fce8" containerName="ui"
May 29 17:57:03.097051 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.097032    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.099496 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.099471    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 29 17:57:03.099610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.099519    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 29 17:57:03.099893 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.099876    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-z9x9h\""
May 29 17:57:03.099893 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.099887    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 29 17:57:03.100055 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.099911    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 29 17:57:03.100217 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.100171    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 29 17:57:03.100323 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.100301    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 29 17:57:03.107729 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.107708    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"]
May 29 17:57:03.222430 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.222401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.222585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.222435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.222585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.222468    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.222585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.222549    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.222585 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.222581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbvg\" (UniqueName: \"kubernetes.io/projected/a519dcdb-c7be-4af7-b4a5-91cc5219af66-kube-api-access-mtbvg\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.222879 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.222649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a519dcdb-c7be-4af7-b4a5-91cc5219af66-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323086 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323062    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a519dcdb-c7be-4af7-b4a5-91cc5219af66-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323093    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323115    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323156    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323174    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323192    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbvg\" (UniqueName: \"kubernetes.io/projected/a519dcdb-c7be-4af7-b4a5-91cc5219af66-kube-api-access-mtbvg\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.323509 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:57:03.323287    2558 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 29 17:57:03.323509 ip-10-0-138-69 kubenswrapper[2558]: E0529 17:57:03.323366    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls podName:a519dcdb-c7be-4af7-b4a5-91cc5219af66 nodeName:}" failed. No retries permitted until 2026-05-29 17:57:03.823345582 +0000 UTC m=+1476.809167549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-jqpzw" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66") : secret "feast-simple-feast-setup-offline-tls" not found
May 29 17:57:03.323627 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.323515    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a519dcdb-c7be-4af7-b4a5-91cc5219af66-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.325745 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.325720    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.325869 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.325732    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.325869 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.325775    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.331807 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.331788    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbvg\" (UniqueName: \"kubernetes.io/projected/a519dcdb-c7be-4af7-b4a5-91cc5219af66-kube-api-access-mtbvg\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.828511 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.828457    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:03.830950 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:03.830930    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-jqpzw\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:04.026008 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:04.025977    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:04.157077 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:04.157050    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"]
May 29 17:57:04.159293 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:57:04.159263    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda519dcdb_c7be_4af7_b4a5_91cc5219af66.slice/crio-a81ae56ce784aa831cdd4e8eb197e2181bf5b22d77dd3549cb0e9d098d1723b2 WatchSource:0}: Error finding container a81ae56ce784aa831cdd4e8eb197e2181bf5b22d77dd3549cb0e9d098d1723b2: Status 404 returned error can't find the container with id a81ae56ce784aa831cdd4e8eb197e2181bf5b22d77dd3549cb0e9d098d1723b2
May 29 17:57:04.161034 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:04.161018    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 17:57:04.526068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:04.526032    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"b908f3b35456d6ba8a6b88006bc5c6d1317a72045a1080c944e19ff158c286a1"}
May 29 17:57:04.526068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:04.526070    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"a81ae56ce784aa831cdd4e8eb197e2181bf5b22d77dd3549cb0e9d098d1723b2"}
May 29 17:57:09.542187 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:09.542157    2558 generic.go:358] "Generic (PLEG): container finished" podID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerID="b908f3b35456d6ba8a6b88006bc5c6d1317a72045a1080c944e19ff158c286a1" exitCode=0
May 29 17:57:09.542590 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:09.542228    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"b908f3b35456d6ba8a6b88006bc5c6d1317a72045a1080c944e19ff158c286a1"}
May 29 17:57:10.546870 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:10.546828    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"7ab89e87fb9af1895ed31ebc393beed127768468049bc7aaff52f9421b815ed7"}
May 29 17:57:15.563540 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:15.563503    2558 generic.go:358] "Generic (PLEG): container finished" podID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerID="7ab89e87fb9af1895ed31ebc393beed127768468049bc7aaff52f9421b815ed7" exitCode=0
May 29 17:57:15.563936 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:15.563578    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"7ab89e87fb9af1895ed31ebc393beed127768468049bc7aaff52f9421b815ed7"}
May 29 17:57:16.571473 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:16.571430    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"225cc41c714d32d3f8f2e2ba19840be29550b68b569c4ce4e19ee288553fbbb3"}
May 29 17:57:16.571981 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:16.571483    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"dfc5a74c809289b828a847a87179c8334319a5747bb3d185473516096cafd5b2"}
May 29 17:57:16.571981 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:16.571499    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"8fd967a1836f83fb1c6d2afc854592e06e15308f13a882d3ddab355fab031260"}
May 29 17:57:16.571981 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:16.571516    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerStarted","Data":"5e8ae4e4d395d8be0f0b5a0ba73709bd5077c28e41df0ed59c5b1710a565b516"}
May 29 17:57:16.596036 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:16.595978    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podStartSLOduration=13.595957351 podStartE2EDuration="13.595957351s" podCreationTimestamp="2026-05-29 17:57:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:57:16.593821047 +0000 UTC m=+1489.579643033" watchObservedRunningTime="2026-05-29 17:57:16.595957351 +0000 UTC m=+1489.581779340"
May 29 17:57:19.026634 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.026594    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:19.027166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.026651    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:19.027166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.026668    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:19.027166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.026681    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:19.028813 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.028772    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.45:6571: connect: connection refused"
May 29 17:57:19.028813 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.028784    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.45:8816: connect: connection refused"
May 29 17:57:19.029033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.028816    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online" probeResult="failure" output="Get \"https://10.134.0.45:6567/health\": dial tcp 10.134.0.45:6567: connect: connection refused"
May 29 17:57:19.029033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:19.028873    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.45:8443: connect: connection refused"
May 29 17:57:22.027654 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.027623    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028109 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028062    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028109 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028091    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028109 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028105    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028116    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028130    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028543 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028520    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028632 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028572    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.028632 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.028605    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.032228 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.032210    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.593137 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.593102    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:22.596061 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:22.596039    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:57:27.484156 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:27.484127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:57:27.487553 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:57:27.487531    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 17:58:24.601144 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:24.601110    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"]
May 29 17:58:24.603631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:24.601434    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="registry" containerID="cri-o://5e8ae4e4d395d8be0f0b5a0ba73709bd5077c28e41df0ed59c5b1710a565b516" gracePeriod=30
May 29 17:58:24.603631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:24.601554    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui" containerID="cri-o://225cc41c714d32d3f8f2e2ba19840be29550b68b569c4ce4e19ee288553fbbb3" gracePeriod=30
May 29 17:58:24.603631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:24.601571    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online" containerID="cri-o://8fd967a1836f83fb1c6d2afc854592e06e15308f13a882d3ddab355fab031260" gracePeriod=30
May 29 17:58:24.603631 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:24.601573    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="offline" containerID="cri-o://dfc5a74c809289b828a847a87179c8334319a5747bb3d185473516096cafd5b2" gracePeriod=30
May 29 17:58:25.002236 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.002197    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"]
May 29 17:58:25.007067 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.007042    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.009649 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.009612    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-qjtbk\""
May 29 17:58:25.019742 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.019706    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"]
May 29 17:58:25.131688 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.131655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.131881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.131792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.131881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.131819    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdzfv\" (UniqueName: \"kubernetes.io/projected/37bed718-2f88-4484-b154-24cc6297a1d3-kube-api-access-hdzfv\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.131881 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.131854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.132029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.131947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37bed718-2f88-4484-b154-24cc6297a1d3-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.132029 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.131985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.232810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.232766    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.232810 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.232816    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37bed718-2f88-4484-b154-24cc6297a1d3-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.233073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.232835    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.233073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.232868    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.233073 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.233049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.233250 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.233081    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdzfv\" (UniqueName: \"kubernetes.io/projected/37bed718-2f88-4484-b154-24cc6297a1d3-kube-api-access-hdzfv\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.233307 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.233270    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37bed718-2f88-4484-b154-24cc6297a1d3-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.235500 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.235472    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.235500 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.235494    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.235682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.235567    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.235682 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.235589    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.241990 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.241969    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdzfv\" (UniqueName: \"kubernetes.io/projected/37bed718-2f88-4484-b154-24cc6297a1d3-kube-api-access-hdzfv\") pod \"feast-simple-feast-setup-664fcfcc58-z87cg\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.320033 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.320006    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:25.450741 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.450716    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"]
May 29 17:58:25.452968 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:58:25.452942    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37bed718_2f88_4484_b154_24cc6297a1d3.slice/crio-f955dfa340f412b84e163df843661f64a08aa6f0a0477328bd79877f4b28b67d WatchSource:0}: Error finding container f955dfa340f412b84e163df843661f64a08aa6f0a0477328bd79877f4b28b67d: Status 404 returned error can't find the container with id f955dfa340f412b84e163df843661f64a08aa6f0a0477328bd79877f4b28b67d
May 29 17:58:25.781499 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.781461    2558 generic.go:358] "Generic (PLEG): container finished" podID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerID="225cc41c714d32d3f8f2e2ba19840be29550b68b569c4ce4e19ee288553fbbb3" exitCode=0
May 29 17:58:25.781499 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.781487    2558 generic.go:358] "Generic (PLEG): container finished" podID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerID="8fd967a1836f83fb1c6d2afc854592e06e15308f13a882d3ddab355fab031260" exitCode=0
May 29 17:58:25.782057 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.781537    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"225cc41c714d32d3f8f2e2ba19840be29550b68b569c4ce4e19ee288553fbbb3"}
May 29 17:58:25.782057 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.781568    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"8fd967a1836f83fb1c6d2afc854592e06e15308f13a882d3ddab355fab031260"}
May 29 17:58:25.782879 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.782853    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"}
May 29 17:58:25.782879 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:25.782879    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"f955dfa340f412b84e163df843661f64a08aa6f0a0477328bd79877f4b28b67d"}
May 29 17:58:30.798396 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:30.798359    2558 generic.go:358] "Generic (PLEG): container finished" podID="37bed718-2f88-4484-b154-24cc6297a1d3" containerID="c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066" exitCode=0
May 29 17:58:30.798396 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:30.798399    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"}
May 29 17:58:31.803576 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:31.803539    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"}
May 29 17:58:32.028663 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:32.028613    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.45:8443: connect: connection refused"
May 29 17:58:32.593277 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:32.593228    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online" probeResult="failure" output="Get \"https://10.134.0.45:6567/health\": dial tcp 10.134.0.45:6567: connect: connection refused"
May 29 17:58:36.820165 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:36.820133    2558 generic.go:358] "Generic (PLEG): container finished" podID="37bed718-2f88-4484-b154-24cc6297a1d3" containerID="bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745" exitCode=0
May 29 17:58:36.820536 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:36.820204    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"}
May 29 17:58:37.829141 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:37.829101    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"}
May 29 17:58:37.829636 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:37.829149    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"}
May 29 17:58:37.829636 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:37.829164    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"}
May 29 17:58:37.829636 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:37.829178    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerStarted","Data":"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"}
May 29 17:58:37.853476 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:37.853169    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podStartSLOduration=13.853148453 podStartE2EDuration="13.853148453s" podCreationTimestamp="2026-05-29 17:58:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 17:58:37.852129815 +0000 UTC m=+1570.837951812" watchObservedRunningTime="2026-05-29 17:58:37.853148453 +0000 UTC m=+1570.838970446"
May 29 17:58:40.320678 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.320630    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:40.321192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.320692    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:40.321192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.320707    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:40.321192 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.320718    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:40.322798 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.322741    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.46:8816: connect: connection refused"
May 29 17:58:40.323055 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.322785    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.46:8443: connect: connection refused"
May 29 17:58:40.323186 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.322800    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.46:6571: connect: connection refused"
May 29 17:58:40.323186 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:40.322831    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.46:6567/health\": dial tcp 10.134.0.46:6567: connect: connection refused"
May 29 17:58:42.028871 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:42.028422    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.45:8443: connect: connection refused"
May 29 17:58:42.594210 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:42.594174    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online" probeResult="failure" output="Get \"https://10.134.0.45:6567/health\": dial tcp 10.134.0.45:6567: connect: connection refused"
May 29 17:58:43.321683 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.321644    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322101 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.321817    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322156 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322135    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322198 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322160    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322198 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322173    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322198 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322186    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322480 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322454    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322610 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322572    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.322687 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.322671    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.326276 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.326259    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.851722 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.851693    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:43.854598 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:43.854578    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 17:58:52.029187 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:52.029145    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.45:8443: connect: connection refused"
May 29 17:58:52.029717 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:52.029261    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:58:52.593524 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:52.593470    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online" probeResult="failure" output="Get \"https://10.134.0.45:6567/health\": dial tcp 10.134.0.45:6567: connect: connection refused"
May 29 17:58:52.593734 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:52.593646    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:58:54.889135 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:54.889055    2558 generic.go:358] "Generic (PLEG): container finished" podID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerID="dfc5a74c809289b828a847a87179c8334319a5747bb3d185473516096cafd5b2" exitCode=137
May 29 17:58:54.889135 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:54.889081    2558 generic.go:358] "Generic (PLEG): container finished" podID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerID="5e8ae4e4d395d8be0f0b5a0ba73709bd5077c28e41df0ed59c5b1710a565b516" exitCode=137
May 29 17:58:54.889135 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:54.889100    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"dfc5a74c809289b828a847a87179c8334319a5747bb3d185473516096cafd5b2"}
May 29 17:58:54.889135 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:54.889123    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"5e8ae4e4d395d8be0f0b5a0ba73709bd5077c28e41df0ed59c5b1710a565b516"}
May 29 17:58:55.242790 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.242770    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:58:55.304970 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.304944    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-online-tls\") pod \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") "
May 29 17:58:55.304970 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.304972    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls\") pod \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") "
May 29 17:58:55.305151 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.305038    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-registry-tls\") pod \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") "
May 29 17:58:55.305151 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.305060    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a519dcdb-c7be-4af7-b4a5-91cc5219af66-feast-data\") pod \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") "
May 29 17:58:55.305151 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.305090    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtbvg\" (UniqueName: \"kubernetes.io/projected/a519dcdb-c7be-4af7-b4a5-91cc5219af66-kube-api-access-mtbvg\") pod \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") "
May 29 17:58:55.305288 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.305255    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-ui-tls\") pod \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\" (UID: \"a519dcdb-c7be-4af7-b4a5-91cc5219af66\") "
May 29 17:58:55.305639 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.305606    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a519dcdb-c7be-4af7-b4a5-91cc5219af66-feast-data" (OuterVolumeSpecName: "feast-data") pod "a519dcdb-c7be-4af7-b4a5-91cc5219af66" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 17:58:55.307385 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.307351    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a519dcdb-c7be-4af7-b4a5-91cc5219af66" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:58:55.307602 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.307572    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-online-tls" (OuterVolumeSpecName: "online-tls") pod "a519dcdb-c7be-4af7-b4a5-91cc5219af66" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:58:55.307698 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.307628    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a519dcdb-c7be-4af7-b4a5-91cc5219af66" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:58:55.307698 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.307675    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a519dcdb-c7be-4af7-b4a5-91cc5219af66" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 17:58:55.307833 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.307693    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a519dcdb-c7be-4af7-b4a5-91cc5219af66-kube-api-access-mtbvg" (OuterVolumeSpecName: "kube-api-access-mtbvg") pod "a519dcdb-c7be-4af7-b4a5-91cc5219af66" (UID: "a519dcdb-c7be-4af7-b4a5-91cc5219af66"). InnerVolumeSpecName "kube-api-access-mtbvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 17:58:55.406880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.406849    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:58:55.406880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.406873    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:58:55.406880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.406883    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:58:55.406880 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.406890    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a519dcdb-c7be-4af7-b4a5-91cc5219af66-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:58:55.407128 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.406899    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtbvg\" (UniqueName: \"kubernetes.io/projected/a519dcdb-c7be-4af7-b4a5-91cc5219af66-kube-api-access-mtbvg\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:58:55.407128 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.406908    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a519dcdb-c7be-4af7-b4a5-91cc5219af66-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 17:58:55.894062 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.893984    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw" event={"ID":"a519dcdb-c7be-4af7-b4a5-91cc5219af66","Type":"ContainerDied","Data":"a81ae56ce784aa831cdd4e8eb197e2181bf5b22d77dd3549cb0e9d098d1723b2"}
May 29 17:58:55.894062 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.894025    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"
May 29 17:58:55.894506 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.894031    2558 scope.go:117] "RemoveContainer" containerID="225cc41c714d32d3f8f2e2ba19840be29550b68b569c4ce4e19ee288553fbbb3"
May 29 17:58:55.902464 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.902446    2558 scope.go:117] "RemoveContainer" containerID="dfc5a74c809289b828a847a87179c8334319a5747bb3d185473516096cafd5b2"
May 29 17:58:55.909388 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.909374    2558 scope.go:117] "RemoveContainer" containerID="8fd967a1836f83fb1c6d2afc854592e06e15308f13a882d3ddab355fab031260"
May 29 17:58:55.913733 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.913713    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"]
May 29 17:58:55.916849 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.916828    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-jqpzw"]
May 29 17:58:55.917764 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.917735    2558 scope.go:117] "RemoveContainer" containerID="5e8ae4e4d395d8be0f0b5a0ba73709bd5077c28e41df0ed59c5b1710a565b516"
May 29 17:58:55.924803 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.924790    2558 scope.go:117] "RemoveContainer" containerID="7ab89e87fb9af1895ed31ebc393beed127768468049bc7aaff52f9421b815ed7"
May 29 17:58:55.931470 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:55.931453    2558 scope.go:117] "RemoveContainer" containerID="b908f3b35456d6ba8a6b88006bc5c6d1317a72045a1080c944e19ff158c286a1"
May 29 17:58:57.511166 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:58:57.511135    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" path="/var/lib/kubelet/pods/a519dcdb-c7be-4af7-b4a5-91cc5219af66/volumes"
May 29 17:59:46.507255 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507219    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"]
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507539    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="offline"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507550    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="offline"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507559    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507567    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507575    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="registry"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507580    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="registry"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507592    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="feast-init"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507598    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="feast-init"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507611    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="feast-apply"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507615    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="feast-apply"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507627    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online"
May 29 17:59:46.507674 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507631    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online"
May 29 17:59:46.508068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507685    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="offline"
May 29 17:59:46.508068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507694    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="online"
May 29 17:59:46.508068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507701    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="registry"
May 29 17:59:46.508068 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.507707    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a519dcdb-c7be-4af7-b4a5-91cc5219af66" containerName="ui"
May 29 17:59:46.512423 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.512402    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.515056 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.515032    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 29 17:59:46.515185 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.515097    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 29 17:59:46.515331 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.515316    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 29 17:59:46.516088 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.516075    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-sl5xm\""
May 29 17:59:46.516164 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.516134    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 29 17:59:46.516239 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.516219    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 29 17:59:46.516355 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.516337    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 29 17:59:46.524075 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.524055    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"]
May 29 17:59:46.633150 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.633115    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d98nh\" (UniqueName: \"kubernetes.io/projected/c77c105e-303d-4097-87e9-b0f719af3fcd-kube-api-access-d98nh\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.633336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.633167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.633336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.633226    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c77c105e-303d-4097-87e9-b0f719af3fcd-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.633336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.633275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.633336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.633303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.633336 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.633321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c77c105e-303d-4097-87e9-b0f719af3fcd-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.734515 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.734478    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d98nh\" (UniqueName: \"kubernetes.io/projected/c77c105e-303d-4097-87e9-b0f719af3fcd-kube-api-access-d98nh\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.734732 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.734531    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.734732 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.734715    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c77c105e-303d-4097-87e9-b0f719af3fcd-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.734905 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.734805    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.734905 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.734841    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.734905 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.734858    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c77c105e-303d-4097-87e9-b0f719af3fcd-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.735213 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.735195    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c77c105e-303d-4097-87e9-b0f719af3fcd-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.735367 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.735348    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c77c105e-303d-4097-87e9-b0f719af3fcd-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.737259 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.737237    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.737365 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.737311    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.737415 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.737359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.745161 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.745133    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d98nh\" (UniqueName: \"kubernetes.io/projected/c77c105e-303d-4097-87e9-b0f719af3fcd-kube-api-access-d98nh\") pod \"feast-simple-feast-remote-setup-5cff94746b-xs9h6\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.822039 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.821942    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 17:59:46.966071 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:46.966037    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"]
May 29 17:59:46.969481 ip-10-0-138-69 kubenswrapper[2558]: W0529 17:59:46.969453    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc77c105e_303d_4097_87e9_b0f719af3fcd.slice/crio-70991b31ebd19e95cb20ebb89d3d2df3d566bb7f0c26e4ec291cf266aa9eb5c7 WatchSource:0}: Error finding container 70991b31ebd19e95cb20ebb89d3d2df3d566bb7f0c26e4ec291cf266aa9eb5c7: Status 404 returned error can't find the container with id 70991b31ebd19e95cb20ebb89d3d2df3d566bb7f0c26e4ec291cf266aa9eb5c7
May 29 17:59:47.047738 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:47.047701    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerStarted","Data":"1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42"}
May 29 17:59:47.047738 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:47.047744    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerStarted","Data":"70991b31ebd19e95cb20ebb89d3d2df3d566bb7f0c26e4ec291cf266aa9eb5c7"}
May 29 17:59:53.071128 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:53.071092    2558 generic.go:358] "Generic (PLEG): container finished" podID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerID="1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42" exitCode=0
May 29 17:59:53.071618 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:53.071169    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerDied","Data":"1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42"}
May 29 17:59:54.075690 ip-10-0-138-69 kubenswrapper[2558]: I0529 17:59:54.075654    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerStarted","Data":"fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8"}
May 29 18:00:00.097221 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:00.097179    2558 generic.go:358] "Generic (PLEG): container finished" podID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerID="fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8" exitCode=0
May 29 18:00:00.097667 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:00.097248    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerDied","Data":"fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8"}
May 29 18:00:01.104810 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.104774    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerStarted","Data":"6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202"}
May 29 18:00:01.104810 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.104811    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerStarted","Data":"2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca"}
May 29 18:00:01.104810 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.104821    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerStarted","Data":"30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f"}
May 29 18:00:01.128772 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.128674    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podStartSLOduration=15.128649557 podStartE2EDuration="15.128649557s" podCreationTimestamp="2026-05-29 17:59:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 18:00:01.125982401 +0000 UTC m=+1654.111804390" watchObservedRunningTime="2026-05-29 18:00:01.128649557 +0000 UTC m=+1654.114471547"
May 29 18:00:01.822731 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.822689    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:01.822731 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.822740    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:01.823033 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.822767    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:01.824621 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.824565    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.47:8443: connect: connection refused"
May 29 18:00:01.824621 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.824591    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.47:8816: connect: connection refused"
May 29 18:00:01.824621 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:01.824605    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.47:6567/health\": dial tcp 10.134.0.47:6567: connect: connection refused"
May 29 18:00:04.823278 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:04.823226    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.47:8443: connect: connection refused"
May 29 18:00:04.823769 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:04.823237    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.47:6567/health\": dial tcp 10.134.0.47:6567: connect: connection refused"
May 29 18:00:04.823769 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:04.823241    2558 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.47:8816: connect: connection refused"
May 29 18:00:06.822487 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:06.822443    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:06.822487 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:06.822490    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:06.822487 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:06.822500    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:07.823539 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:07.823510    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:07.824006 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:07.823618    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:07.824267 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:07.824248    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:07.824488 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:07.824473    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:07.827574 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:07.827556    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:00:08.133243 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:00:08.133155    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:01:09.467421 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.467386    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"]
May 29 18:01:09.467978 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.467814    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online" containerID="cri-o://30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f" gracePeriod=30
May 29 18:01:09.467978 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.467872    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="offline" containerID="cri-o://2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca" gracePeriod=30
May 29 18:01:09.467978 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.467896    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui" containerID="cri-o://6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202" gracePeriod=30
May 29 18:01:09.647909 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.647869    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"]
May 29 18:01:09.648357 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.648303    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="registry" containerID="cri-o://64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0" gracePeriod=30
May 29 18:01:09.648603 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.648546    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="offline" containerID="cri-o://d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84" gracePeriod=30
May 29 18:01:09.648724 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.648534    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui" containerID="cri-o://971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e" gracePeriod=30
May 29 18:01:09.648724 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:09.648551    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online" containerID="cri-o://80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2" gracePeriod=30
May 29 18:01:10.337679 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:10.337643    2558 generic.go:358] "Generic (PLEG): container finished" podID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerID="6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202" exitCode=0
May 29 18:01:10.337679 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:10.337668    2558 generic.go:358] "Generic (PLEG): container finished" podID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerID="30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f" exitCode=0
May 29 18:01:10.337858 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:10.337710    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerDied","Data":"6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202"}
May 29 18:01:10.337858 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:10.337746    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerDied","Data":"30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f"}
May 29 18:01:10.340047 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:10.340026    2558 generic.go:358] "Generic (PLEG): container finished" podID="37bed718-2f88-4484-b154-24cc6297a1d3" containerID="971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e" exitCode=0
May 29 18:01:10.340162 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:10.340059    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"}
May 29 18:01:11.344878 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:11.344845    2558 generic.go:358] "Generic (PLEG): container finished" podID="37bed718-2f88-4484-b154-24cc6297a1d3" containerID="80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2" exitCode=0
May 29 18:01:11.345252 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:11.344909    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"}
May 29 18:01:13.322463 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:13.322417    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.46:8443: connect: connection refused"
May 29 18:01:13.852800 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:13.852727    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.46:6567/health\": dial tcp 10.134.0.46:6567: connect: connection refused"
May 29 18:01:17.824631 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:17.824590    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.47:8443: connect: connection refused"
May 29 18:01:18.131301 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:18.131208    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.47:6567/health\": dial tcp 10.134.0.47:6567: connect: connection refused"
May 29 18:01:23.322518 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:23.322459    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.46:8443: connect: connection refused"
May 29 18:01:23.852659 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:23.852619    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.46:6567/health\": dial tcp 10.134.0.46:6567: connect: connection refused"
May 29 18:01:27.824206 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:27.824162    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.47:8443: connect: connection refused"
May 29 18:01:28.131080 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:28.130988    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.47:6567/health\": dial tcp 10.134.0.47:6567: connect: connection refused"
May 29 18:01:33.322604 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:33.322559    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.46:8443: connect: connection refused"
May 29 18:01:33.323056 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:33.322681    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 18:01:33.852359 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:33.852321    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online" probeResult="failure" output="Get \"https://10.134.0.46:6567/health\": dial tcp 10.134.0.46:6567: connect: connection refused"
May 29 18:01:33.852547 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:33.852445    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 18:01:37.824415 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:37.824365    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.47:8443: connect: connection refused"
May 29 18:01:37.824832 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:37.824502    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:01:38.130980 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:38.130886    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.47:6567/health\": dial tcp 10.134.0.47:6567: connect: connection refused"
May 29 18:01:38.131140 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:38.131014    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:01:40.118014 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.117989    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:01:40.143543 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.143513    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d98nh\" (UniqueName: \"kubernetes.io/projected/c77c105e-303d-4097-87e9-b0f719af3fcd-kube-api-access-d98nh\") pod \"c77c105e-303d-4097-87e9-b0f719af3fcd\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") "
May 29 18:01:40.143727 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.143577    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c77c105e-303d-4097-87e9-b0f719af3fcd-feast-data\") pod \"c77c105e-303d-4097-87e9-b0f719af3fcd\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") "
May 29 18:01:40.143727 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.143605    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-online-tls\") pod \"c77c105e-303d-4097-87e9-b0f719af3fcd\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") "
May 29 18:01:40.143727 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.143628    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-offline-tls\") pod \"c77c105e-303d-4097-87e9-b0f719af3fcd\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") "
May 29 18:01:40.143727 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.143679    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c77c105e-303d-4097-87e9-b0f719af3fcd-registry-tls\") pod \"c77c105e-303d-4097-87e9-b0f719af3fcd\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") "
May 29 18:01:40.143727 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.143725    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-ui-tls\") pod \"c77c105e-303d-4097-87e9-b0f719af3fcd\" (UID: \"c77c105e-303d-4097-87e9-b0f719af3fcd\") "
May 29 18:01:40.144467 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.144430    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c77c105e-303d-4097-87e9-b0f719af3fcd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c77c105e-303d-4097-87e9-b0f719af3fcd" (UID: "c77c105e-303d-4097-87e9-b0f719af3fcd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 18:01:40.144467 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.144430    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c77c105e-303d-4097-87e9-b0f719af3fcd-feast-data" (OuterVolumeSpecName: "feast-data") pod "c77c105e-303d-4097-87e9-b0f719af3fcd" (UID: "c77c105e-303d-4097-87e9-b0f719af3fcd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 18:01:40.146617 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.146576    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-online-tls" (OuterVolumeSpecName: "online-tls") pod "c77c105e-303d-4097-87e9-b0f719af3fcd" (UID: "c77c105e-303d-4097-87e9-b0f719af3fcd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.146786 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.146636    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c77c105e-303d-4097-87e9-b0f719af3fcd" (UID: "c77c105e-303d-4097-87e9-b0f719af3fcd"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.146786 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.146659    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c77c105e-303d-4097-87e9-b0f719af3fcd" (UID: "c77c105e-303d-4097-87e9-b0f719af3fcd"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.146930 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.146909    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c77c105e-303d-4097-87e9-b0f719af3fcd-kube-api-access-d98nh" (OuterVolumeSpecName: "kube-api-access-d98nh") pod "c77c105e-303d-4097-87e9-b0f719af3fcd" (UID: "c77c105e-303d-4097-87e9-b0f719af3fcd"). InnerVolumeSpecName "kube-api-access-d98nh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 18:01:40.245025 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.244955    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d98nh\" (UniqueName: \"kubernetes.io/projected/c77c105e-303d-4097-87e9-b0f719af3fcd-kube-api-access-d98nh\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.245025 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.244984    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c77c105e-303d-4097-87e9-b0f719af3fcd-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.245025 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.244996    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.245025 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.245004    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.245025 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.245013    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c77c105e-303d-4097-87e9-b0f719af3fcd-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.245025 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.245021    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c77c105e-303d-4097-87e9-b0f719af3fcd-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.296555 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.296530    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 18:01:40.345472 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.345433    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-registry-tls\") pod \"37bed718-2f88-4484-b154-24cc6297a1d3\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") "
May 29 18:01:40.345678 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.345492    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37bed718-2f88-4484-b154-24cc6297a1d3-feast-data\") pod \"37bed718-2f88-4484-b154-24cc6297a1d3\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") "
May 29 18:01:40.345678 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.345528    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-offline-tls\") pod \"37bed718-2f88-4484-b154-24cc6297a1d3\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") "
May 29 18:01:40.345678 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.345570    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-online-tls\") pod \"37bed718-2f88-4484-b154-24cc6297a1d3\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") "
May 29 18:01:40.345678 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.345600    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdzfv\" (UniqueName: \"kubernetes.io/projected/37bed718-2f88-4484-b154-24cc6297a1d3-kube-api-access-hdzfv\") pod \"37bed718-2f88-4484-b154-24cc6297a1d3\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") "
May 29 18:01:40.345953 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.345677    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-ui-tls\") pod \"37bed718-2f88-4484-b154-24cc6297a1d3\" (UID: \"37bed718-2f88-4484-b154-24cc6297a1d3\") "
May 29 18:01:40.346070 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.346013    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37bed718-2f88-4484-b154-24cc6297a1d3-feast-data" (OuterVolumeSpecName: "feast-data") pod "37bed718-2f88-4484-b154-24cc6297a1d3" (UID: "37bed718-2f88-4484-b154-24cc6297a1d3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 18:01:40.347698 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.347670    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37bed718-2f88-4484-b154-24cc6297a1d3-kube-api-access-hdzfv" (OuterVolumeSpecName: "kube-api-access-hdzfv") pod "37bed718-2f88-4484-b154-24cc6297a1d3" (UID: "37bed718-2f88-4484-b154-24cc6297a1d3"). InnerVolumeSpecName "kube-api-access-hdzfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 18:01:40.348206 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.348182    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "37bed718-2f88-4484-b154-24cc6297a1d3" (UID: "37bed718-2f88-4484-b154-24cc6297a1d3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.348342 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.348304    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-online-tls" (OuterVolumeSpecName: "online-tls") pod "37bed718-2f88-4484-b154-24cc6297a1d3" (UID: "37bed718-2f88-4484-b154-24cc6297a1d3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.348444 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.348358    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "37bed718-2f88-4484-b154-24cc6297a1d3" (UID: "37bed718-2f88-4484-b154-24cc6297a1d3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.348444 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.348375    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "37bed718-2f88-4484-b154-24cc6297a1d3" (UID: "37bed718-2f88-4484-b154-24cc6297a1d3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 18:01:40.436291 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.436251    2558 generic.go:358] "Generic (PLEG): container finished" podID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerID="2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca" exitCode=137
May 29 18:01:40.436462 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.436318    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"
May 29 18:01:40.436462 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.436339    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerDied","Data":"2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca"}
May 29 18:01:40.436462 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.436374    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6" event={"ID":"c77c105e-303d-4097-87e9-b0f719af3fcd","Type":"ContainerDied","Data":"70991b31ebd19e95cb20ebb89d3d2df3d566bb7f0c26e4ec291cf266aa9eb5c7"}
May 29 18:01:40.436462 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.436392    2558 scope.go:117] "RemoveContainer" containerID="6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202"
May 29 18:01:40.439144 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.439110    2558 generic.go:358] "Generic (PLEG): container finished" podID="37bed718-2f88-4484-b154-24cc6297a1d3" containerID="d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84" exitCode=137
May 29 18:01:40.439144 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.439144    2558 generic.go:358] "Generic (PLEG): container finished" podID="37bed718-2f88-4484-b154-24cc6297a1d3" containerID="64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0" exitCode=137
May 29 18:01:40.439292 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.439180    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"
May 29 18:01:40.439292 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.439194    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"}
May 29 18:01:40.439292 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.439228    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"}
May 29 18:01:40.439292 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.439244    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg" event={"ID":"37bed718-2f88-4484-b154-24cc6297a1d3","Type":"ContainerDied","Data":"f955dfa340f412b84e163df843661f64a08aa6f0a0477328bd79877f4b28b67d"}
May 29 18:01:40.445716 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.445694    2558 scope.go:117] "RemoveContainer" containerID="2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca"
May 29 18:01:40.446291 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.446269    2558 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/37bed718-2f88-4484-b154-24cc6297a1d3-feast-data\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.446383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.446297    2558 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-offline-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.446383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.446310    2558 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-online-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.446383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.446319    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdzfv\" (UniqueName: \"kubernetes.io/projected/37bed718-2f88-4484-b154-24cc6297a1d3-kube-api-access-hdzfv\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.446383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.446328    2558 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-ui-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.446383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.446337    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/37bed718-2f88-4484-b154-24cc6297a1d3-registry-tls\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:01:40.453817 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.453800    2558 scope.go:117] "RemoveContainer" containerID="30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f"
May 29 18:01:40.459931 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.459906    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"]
May 29 18:01:40.461654 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.461640    2558 scope.go:117] "RemoveContainer" containerID="fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8"
May 29 18:01:40.464393 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.464369    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-xs9h6"]
May 29 18:01:40.471776 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.471554    2558 scope.go:117] "RemoveContainer" containerID="1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42"
May 29 18:01:40.476636 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.476611    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"]
May 29 18:01:40.480709 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.480620    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-z87cg"]
May 29 18:01:40.491702 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.491683    2558 scope.go:117] "RemoveContainer" containerID="6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202"
May 29 18:01:40.492054 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.492032    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202\": container with ID starting with 6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202 not found: ID does not exist" containerID="6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202"
May 29 18:01:40.492108 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492065    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202"} err="failed to get container status \"6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202\": rpc error: code = NotFound desc = could not find container \"6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202\": container with ID starting with 6bd9356213bc7bfd6b34ebdc6a07c9a0d1a7c8073afca6c7c4f548bd7f980202 not found: ID does not exist"
May 29 18:01:40.492108 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492087    2558 scope.go:117] "RemoveContainer" containerID="2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca"
May 29 18:01:40.492343 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.492324    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca\": container with ID starting with 2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca not found: ID does not exist" containerID="2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca"
May 29 18:01:40.492383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492350    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca"} err="failed to get container status \"2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca\": rpc error: code = NotFound desc = could not find container \"2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca\": container with ID starting with 2dcad8ce1a4fd697af23a055c6a9d991ff8e59b06c9e5c20234bea2d59b4b9ca not found: ID does not exist"
May 29 18:01:40.492383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492372    2558 scope.go:117] "RemoveContainer" containerID="30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f"
May 29 18:01:40.492581 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.492566    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f\": container with ID starting with 30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f not found: ID does not exist" containerID="30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f"
May 29 18:01:40.492622 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492585    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f"} err="failed to get container status \"30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f\": rpc error: code = NotFound desc = could not find container \"30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f\": container with ID starting with 30e3e41fde2041099a2b9e141bf1d6f60b7a5b7975c0fe22fac61b1f5893af4f not found: ID does not exist"
May 29 18:01:40.492622 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492600    2558 scope.go:117] "RemoveContainer" containerID="fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8"
May 29 18:01:40.492856 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.492841    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8\": container with ID starting with fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8 not found: ID does not exist" containerID="fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8"
May 29 18:01:40.492920 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492857    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8"} err="failed to get container status \"fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8\": rpc error: code = NotFound desc = could not find container \"fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8\": container with ID starting with fe99023db6d28b0c52ae0a71122de4d684de5560f2cbacaffaf8195d9311cfe8 not found: ID does not exist"
May 29 18:01:40.492920 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.492869    2558 scope.go:117] "RemoveContainer" containerID="1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42"
May 29 18:01:40.493081 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.493067    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42\": container with ID starting with 1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42 not found: ID does not exist" containerID="1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42"
May 29 18:01:40.493124 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.493085    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42"} err="failed to get container status \"1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42\": rpc error: code = NotFound desc = could not find container \"1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42\": container with ID starting with 1a348270a5db99b2c18f5313f1169141b0fd663861ed96c31f1f6102da410e42 not found: ID does not exist"
May 29 18:01:40.493124 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.493097    2558 scope.go:117] "RemoveContainer" containerID="971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"
May 29 18:01:40.501157 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.501139    2558 scope.go:117] "RemoveContainer" containerID="d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"
May 29 18:01:40.514726 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.514699    2558 scope.go:117] "RemoveContainer" containerID="80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"
May 29 18:01:40.522534 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.522512    2558 scope.go:117] "RemoveContainer" containerID="64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"
May 29 18:01:40.530009 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.529983    2558 scope.go:117] "RemoveContainer" containerID="bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"
May 29 18:01:40.537326 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.537290    2558 scope.go:117] "RemoveContainer" containerID="c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"
May 29 18:01:40.544651 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.544624    2558 scope.go:117] "RemoveContainer" containerID="971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"
May 29 18:01:40.544953 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.544930    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e\": container with ID starting with 971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e not found: ID does not exist" containerID="971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"
May 29 18:01:40.545015 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.544962    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"} err="failed to get container status \"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e\": rpc error: code = NotFound desc = could not find container \"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e\": container with ID starting with 971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e not found: ID does not exist"
May 29 18:01:40.545015 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.544983    2558 scope.go:117] "RemoveContainer" containerID="d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"
May 29 18:01:40.545252 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.545230    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84\": container with ID starting with d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84 not found: ID does not exist" containerID="d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"
May 29 18:01:40.545303 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545260    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"} err="failed to get container status \"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84\": rpc error: code = NotFound desc = could not find container \"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84\": container with ID starting with d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84 not found: ID does not exist"
May 29 18:01:40.545303 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545279    2558 scope.go:117] "RemoveContainer" containerID="80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"
May 29 18:01:40.545489 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.545473    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2\": container with ID starting with 80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2 not found: ID does not exist" containerID="80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"
May 29 18:01:40.545526 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545494    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"} err="failed to get container status \"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2\": rpc error: code = NotFound desc = could not find container \"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2\": container with ID starting with 80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2 not found: ID does not exist"
May 29 18:01:40.545526 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545509    2558 scope.go:117] "RemoveContainer" containerID="64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"
May 29 18:01:40.545732 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.545716    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0\": container with ID starting with 64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0 not found: ID does not exist" containerID="64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"
May 29 18:01:40.545846 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545737    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"} err="failed to get container status \"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0\": rpc error: code = NotFound desc = could not find container \"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0\": container with ID starting with 64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0 not found: ID does not exist"
May 29 18:01:40.545846 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545761    2558 scope.go:117] "RemoveContainer" containerID="bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"
May 29 18:01:40.545991 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.545975    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745\": container with ID starting with bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745 not found: ID does not exist" containerID="bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"
May 29 18:01:40.546032 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.545995    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"} err="failed to get container status \"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745\": rpc error: code = NotFound desc = could not find container \"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745\": container with ID starting with bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745 not found: ID does not exist"
May 29 18:01:40.546032 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546008    2558 scope.go:117] "RemoveContainer" containerID="c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"
May 29 18:01:40.546231 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:01:40.546213    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066\": container with ID starting with c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066 not found: ID does not exist" containerID="c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"
May 29 18:01:40.546277 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546238    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"} err="failed to get container status \"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066\": rpc error: code = NotFound desc = could not find container \"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066\": container with ID starting with c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066 not found: ID does not exist"
May 29 18:01:40.546277 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546253    2558 scope.go:117] "RemoveContainer" containerID="971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"
May 29 18:01:40.546507 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546482    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e"} err="failed to get container status \"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e\": rpc error: code = NotFound desc = could not find container \"971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e\": container with ID starting with 971ac593a86850b0ea4f5633ab57b2813a7cba68b6039e69fe7580632ccc908e not found: ID does not exist"
May 29 18:01:40.546507 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546503    2558 scope.go:117] "RemoveContainer" containerID="d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"
May 29 18:01:40.546735 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546711    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84"} err="failed to get container status \"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84\": rpc error: code = NotFound desc = could not find container \"d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84\": container with ID starting with d9107643fc2de5726d6ab1dd6b47ba734a770a733dfb3b74bfdc37ca4ffd0a84 not found: ID does not exist"
May 29 18:01:40.546735 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546735    2558 scope.go:117] "RemoveContainer" containerID="80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"
May 29 18:01:40.546988 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546970    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2"} err="failed to get container status \"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2\": rpc error: code = NotFound desc = could not find container \"80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2\": container with ID starting with 80f13e5b18da5ac04ec7ff4f89d8fbf83a3dcd2172bed1c884a9513dbf4bdef2 not found: ID does not exist"
May 29 18:01:40.547043 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.546989    2558 scope.go:117] "RemoveContainer" containerID="64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"
May 29 18:01:40.547200 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.547182    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0"} err="failed to get container status \"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0\": rpc error: code = NotFound desc = could not find container \"64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0\": container with ID starting with 64eb2d8e05d368d860ef65e66510b5efc6da54a4411c5015d1ef858ff862b8c0 not found: ID does not exist"
May 29 18:01:40.547251 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.547200    2558 scope.go:117] "RemoveContainer" containerID="bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"
May 29 18:01:40.547415 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.547399    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745"} err="failed to get container status \"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745\": rpc error: code = NotFound desc = could not find container \"bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745\": container with ID starting with bb40b352912ccc16bcae921d980bf032b20afad25462d765f0d2dca28b2ab745 not found: ID does not exist"
May 29 18:01:40.547466 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.547416    2558 scope.go:117] "RemoveContainer" containerID="c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"
May 29 18:01:40.547624 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:40.547608    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066"} err="failed to get container status \"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066\": rpc error: code = NotFound desc = could not find container \"c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066\": container with ID starting with c64b39cafad46a979c52c76f0c5b4f017495a312bc3d91241130f7b5625fd066 not found: ID does not exist"
May 29 18:01:41.510615 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:41.510583    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" path="/var/lib/kubelet/pods/37bed718-2f88-4484-b154-24cc6297a1d3/volumes"
May 29 18:01:41.511202 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:41.511188    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" path="/var/lib/kubelet/pods/c77c105e-303d-4097-87e9-b0f719af3fcd/volumes"
May 29 18:01:58.942950 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.942915    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gfld2/must-gather-hj4fx"]
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943239    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="feast-init"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943252    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="feast-init"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943264    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="registry"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943271    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="registry"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943279    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="offline"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943283    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="offline"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943295    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943301    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943307    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="feast-init"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943312    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="feast-init"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943318    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="offline"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943323    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="offline"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943332    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943337    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943346    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="feast-apply"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943351    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="feast-apply"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943357    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943363    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943369    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="feast-apply"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943374    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="feast-apply"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943381    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online"
May 29 18:01:58.943411 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943386    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943430    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="offline"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943439    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="ui"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943447    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="online"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943453    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="offline"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943460    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="online"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943466    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c77c105e-303d-4097-87e9-b0f719af3fcd" containerName="ui"
May 29 18:01:58.944237 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.943473    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="37bed718-2f88-4484-b154-24cc6297a1d3" containerName="registry"
May 29 18:01:58.946139 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.946122    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:58.948653 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.948627    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gfld2\"/\"openshift-service-ca.crt\""
May 29 18:01:58.948653 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.948650    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gfld2\"/\"kube-root-ca.crt\""
May 29 18:01:58.949462 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.949445    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gfld2\"/\"default-dockercfg-pg9ks\""
May 29 18:01:58.955409 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.955382    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gfld2/must-gather-hj4fx"]
May 29 18:01:59.000006 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:58.999968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91b681e1-2b22-46b4-ae43-057f58ed2520-must-gather-output\") pod \"must-gather-hj4fx\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") " pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.000203 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.000058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmfs7\" (UniqueName: \"kubernetes.io/projected/91b681e1-2b22-46b4-ae43-057f58ed2520-kube-api-access-hmfs7\") pod \"must-gather-hj4fx\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") " pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.101019 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.100979    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91b681e1-2b22-46b4-ae43-057f58ed2520-must-gather-output\") pod \"must-gather-hj4fx\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") " pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.101196 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.101070    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmfs7\" (UniqueName: \"kubernetes.io/projected/91b681e1-2b22-46b4-ae43-057f58ed2520-kube-api-access-hmfs7\") pod \"must-gather-hj4fx\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") " pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.101340 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.101318    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91b681e1-2b22-46b4-ae43-057f58ed2520-must-gather-output\") pod \"must-gather-hj4fx\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") " pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.109507 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.109468    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmfs7\" (UniqueName: \"kubernetes.io/projected/91b681e1-2b22-46b4-ae43-057f58ed2520-kube-api-access-hmfs7\") pod \"must-gather-hj4fx\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") " pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.267204 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.267112    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:01:59.403616 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.403588    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gfld2/must-gather-hj4fx"]
May 29 18:01:59.406212 ip-10-0-138-69 kubenswrapper[2558]: W0529 18:01:59.406178    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91b681e1_2b22_46b4_ae43_057f58ed2520.slice/crio-e1e8f5895b1e79c1e1a2e1e475b6718640114c156723d7fc2b29c8199f7430a0 WatchSource:0}: Error finding container e1e8f5895b1e79c1e1a2e1e475b6718640114c156723d7fc2b29c8199f7430a0: Status 404 returned error can't find the container with id e1e8f5895b1e79c1e1a2e1e475b6718640114c156723d7fc2b29c8199f7430a0
May 29 18:01:59.501245 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:01:59.501210    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfld2/must-gather-hj4fx" event={"ID":"91b681e1-2b22-46b4-ae43-057f58ed2520","Type":"ContainerStarted","Data":"e1e8f5895b1e79c1e1a2e1e475b6718640114c156723d7fc2b29c8199f7430a0"}
May 29 18:02:05.671250 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:05.671222    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 18:02:06.530917 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:06.530868    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfld2/must-gather-hj4fx" event={"ID":"91b681e1-2b22-46b4-ae43-057f58ed2520","Type":"ContainerStarted","Data":"342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380"}
May 29 18:02:06.530917 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:06.530926    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfld2/must-gather-hj4fx" event={"ID":"91b681e1-2b22-46b4-ae43-057f58ed2520","Type":"ContainerStarted","Data":"0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"}
May 29 18:02:06.547200 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:06.547099    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gfld2/must-gather-hj4fx" podStartSLOduration=2.415378235 podStartE2EDuration="8.547080578s" podCreationTimestamp="2026-05-29 18:01:58 +0000 UTC" firstStartedPulling="2026-05-29 18:01:59.407903107 +0000 UTC m=+1772.393725087" lastFinishedPulling="2026-05-29 18:02:05.539605448 +0000 UTC m=+1778.525427430" observedRunningTime="2026-05-29 18:02:06.546203965 +0000 UTC m=+1779.532025956" watchObservedRunningTime="2026-05-29 18:02:06.547080578 +0000 UTC m=+1779.532902564"
May 29 18:02:15.563086 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:15.563040    2558 generic.go:358] "Generic (PLEG): container finished" podID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerID="0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a" exitCode=0
May 29 18:02:15.563518 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:15.563114    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gfld2/must-gather-hj4fx" event={"ID":"91b681e1-2b22-46b4-ae43-057f58ed2520","Type":"ContainerDied","Data":"0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"}
May 29 18:02:15.563518 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:15.563460    2558 scope.go:117] "RemoveContainer" containerID="0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"
May 29 18:02:16.554291 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:16.554254    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gfld2_must-gather-hj4fx_91b681e1-2b22-46b4-ae43-057f58ed2520/gather/0.log"
May 29 18:02:17.061156 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.061115    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2jk7/must-gather-njz6h"]
May 29 18:02:17.063649 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.063623    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.067504 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.067479    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2jk7\"/\"kube-root-ca.crt\""
May 29 18:02:17.068169 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.068151    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2jk7\"/\"openshift-service-ca.crt\""
May 29 18:02:17.068503 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.068489    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h2jk7\"/\"default-dockercfg-8mglv\""
May 29 18:02:17.075627 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.075595    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2jk7/must-gather-njz6h"]
May 29 18:02:17.176038 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.175995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbzgh\" (UniqueName: \"kubernetes.io/projected/2c80457f-cecf-4436-a469-a380f08f6115-kube-api-access-mbzgh\") pod \"must-gather-njz6h\" (UID: \"2c80457f-cecf-4436-a469-a380f08f6115\") " pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.176038 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.176035    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c80457f-cecf-4436-a469-a380f08f6115-must-gather-output\") pod \"must-gather-njz6h\" (UID: \"2c80457f-cecf-4436-a469-a380f08f6115\") " pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.277511 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.277465    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbzgh\" (UniqueName: \"kubernetes.io/projected/2c80457f-cecf-4436-a469-a380f08f6115-kube-api-access-mbzgh\") pod \"must-gather-njz6h\" (UID: \"2c80457f-cecf-4436-a469-a380f08f6115\") " pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.277511 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.277515    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c80457f-cecf-4436-a469-a380f08f6115-must-gather-output\") pod \"must-gather-njz6h\" (UID: \"2c80457f-cecf-4436-a469-a380f08f6115\") " pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.277930 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.277913    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c80457f-cecf-4436-a469-a380f08f6115-must-gather-output\") pod \"must-gather-njz6h\" (UID: \"2c80457f-cecf-4436-a469-a380f08f6115\") " pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.286144 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.286111    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbzgh\" (UniqueName: \"kubernetes.io/projected/2c80457f-cecf-4436-a469-a380f08f6115-kube-api-access-mbzgh\") pod \"must-gather-njz6h\" (UID: \"2c80457f-cecf-4436-a469-a380f08f6115\") " pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.374371 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.374276    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2jk7/must-gather-njz6h"
May 29 18:02:17.513906 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.513872    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2jk7/must-gather-njz6h"]
May 29 18:02:17.517507 ip-10-0-138-69 kubenswrapper[2558]: W0529 18:02:17.517475    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c80457f_cecf_4436_a469_a380f08f6115.slice/crio-22d74d95a023b2cebd8d931ce1a76ac7d299916098533fc8834bb8428528be70 WatchSource:0}: Error finding container 22d74d95a023b2cebd8d931ce1a76ac7d299916098533fc8834bb8428528be70: Status 404 returned error can't find the container with id 22d74d95a023b2cebd8d931ce1a76ac7d299916098533fc8834bb8428528be70
May 29 18:02:17.571822 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:17.571789    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/must-gather-njz6h" event={"ID":"2c80457f-cecf-4436-a469-a380f08f6115","Type":"ContainerStarted","Data":"22d74d95a023b2cebd8d931ce1a76ac7d299916098533fc8834bb8428528be70"}
May 29 18:02:18.577155 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:18.577067    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/must-gather-njz6h" event={"ID":"2c80457f-cecf-4436-a469-a380f08f6115","Type":"ContainerStarted","Data":"c8c05f5df256f7270ca191354bedb3cdfaeb39c3131b0d16e353cb4203c25ebd"}
May 29 18:02:18.577155 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:18.577107    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/must-gather-njz6h" event={"ID":"2c80457f-cecf-4436-a469-a380f08f6115","Type":"ContainerStarted","Data":"95cd039243c3d7e3f65172d5b4ee0b2c44d0e724854f53bb87c8fac3d8c97024"}
May 29 18:02:18.594160 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:18.594101    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-h2jk7/must-gather-njz6h" podStartSLOduration=0.794951234 podStartE2EDuration="1.594083291s" podCreationTimestamp="2026-05-29 18:02:17 +0000 UTC" firstStartedPulling="2026-05-29 18:02:17.519735054 +0000 UTC m=+1790.505557021" lastFinishedPulling="2026-05-29 18:02:18.318867106 +0000 UTC m=+1791.304689078" observedRunningTime="2026-05-29 18:02:18.591716993 +0000 UTC m=+1791.577538983" watchObservedRunningTime="2026-05-29 18:02:18.594083291 +0000 UTC m=+1791.579905279"
May 29 18:02:19.767981 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:19.767936    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zpvd7_c4e6ae96-80a2-42da-aa01-c205a25ef616/global-pull-secret-syncer/0.log"
May 29 18:02:19.824276 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:19.824243    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gtnl4_5d26816d-e3f1-4d7d-805e-795e7c551506/konnectivity-agent/0.log"
May 29 18:02:19.954414 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:19.954381    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-69.ec2.internal_1330ceee6fcbb89d1606f2672ec11098/haproxy/0.log"
May 29 18:02:21.886231 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:21.886183    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-gfld2/must-gather-hj4fx"]
May 29 18:02:21.886837 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:21.886629    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-gfld2/must-gather-hj4fx" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="copy" containerID="cri-o://342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380" gracePeriod=2
May 29 18:02:21.889006 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:21.888968    2558 status_manager.go:895] "Failed to get status for pod" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" pod="openshift-must-gather-gfld2/must-gather-hj4fx" err="pods \"must-gather-hj4fx\" is forbidden: User \"system:node:ip-10-0-138-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gfld2\": no relationship found between node 'ip-10-0-138-69.ec2.internal' and this object"
May 29 18:02:21.891050 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:21.891019    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-gfld2/must-gather-hj4fx"]
May 29 18:02:22.290774 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.285005    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gfld2_must-gather-hj4fx_91b681e1-2b22-46b4-ae43-057f58ed2520/copy/0.log"
May 29 18:02:22.290774 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.285425    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:02:22.290774 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.287399    2558 status_manager.go:895] "Failed to get status for pod" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" pod="openshift-must-gather-gfld2/must-gather-hj4fx" err="pods \"must-gather-hj4fx\" is forbidden: User \"system:node:ip-10-0-138-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gfld2\": no relationship found between node 'ip-10-0-138-69.ec2.internal' and this object"
May 29 18:02:22.431783 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.431723    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91b681e1-2b22-46b4-ae43-057f58ed2520-must-gather-output\") pod \"91b681e1-2b22-46b4-ae43-057f58ed2520\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") "
May 29 18:02:22.431998 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.431837    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmfs7\" (UniqueName: \"kubernetes.io/projected/91b681e1-2b22-46b4-ae43-057f58ed2520-kube-api-access-hmfs7\") pod \"91b681e1-2b22-46b4-ae43-057f58ed2520\" (UID: \"91b681e1-2b22-46b4-ae43-057f58ed2520\") "
May 29 18:02:22.432883 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.432846    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91b681e1-2b22-46b4-ae43-057f58ed2520-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "91b681e1-2b22-46b4-ae43-057f58ed2520" (UID: "91b681e1-2b22-46b4-ae43-057f58ed2520"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 18:02:22.442398 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.442345    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b681e1-2b22-46b4-ae43-057f58ed2520-kube-api-access-hmfs7" (OuterVolumeSpecName: "kube-api-access-hmfs7") pod "91b681e1-2b22-46b4-ae43-057f58ed2520" (UID: "91b681e1-2b22-46b4-ae43-057f58ed2520"). InnerVolumeSpecName "kube-api-access-hmfs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 18:02:22.533285 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.533232    2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/91b681e1-2b22-46b4-ae43-057f58ed2520-must-gather-output\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:02:22.533285 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.533281    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmfs7\" (UniqueName: \"kubernetes.io/projected/91b681e1-2b22-46b4-ae43-057f58ed2520-kube-api-access-hmfs7\") on node \"ip-10-0-138-69.ec2.internal\" DevicePath \"\""
May 29 18:02:22.612198 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.612167    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-gfld2_must-gather-hj4fx_91b681e1-2b22-46b4-ae43-057f58ed2520/copy/0.log"
May 29 18:02:22.613007 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.612975    2558 generic.go:358] "Generic (PLEG): container finished" podID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerID="342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380" exitCode=143
May 29 18:02:22.613323 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.613307    2558 scope.go:117] "RemoveContainer" containerID="342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380"
May 29 18:02:22.613569 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.613552    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gfld2/must-gather-hj4fx"
May 29 18:02:22.625023 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.624990    2558 status_manager.go:895] "Failed to get status for pod" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" pod="openshift-must-gather-gfld2/must-gather-hj4fx" err="pods \"must-gather-hj4fx\" is forbidden: User \"system:node:ip-10-0-138-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gfld2\": no relationship found between node 'ip-10-0-138-69.ec2.internal' and this object"
May 29 18:02:22.633403 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.633363    2558 status_manager.go:895] "Failed to get status for pod" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" pod="openshift-must-gather-gfld2/must-gather-hj4fx" err="pods \"must-gather-hj4fx\" is forbidden: User \"system:node:ip-10-0-138-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-gfld2\": no relationship found between node 'ip-10-0-138-69.ec2.internal' and this object"
May 29 18:02:22.640698 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.640555    2558 scope.go:117] "RemoveContainer" containerID="0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"
May 29 18:02:22.670383 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.669919    2558 scope.go:117] "RemoveContainer" containerID="342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380"
May 29 18:02:22.670991 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:02:22.670628    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380\": container with ID starting with 342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380 not found: ID does not exist" containerID="342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380"
May 29 18:02:22.670991 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.670673    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380"} err="failed to get container status \"342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380\": rpc error: code = NotFound desc = could not find container \"342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380\": container with ID starting with 342f8d9973b8040ed073a626d3020873dde1bf48f6acea73e0b483014062e380 not found: ID does not exist"
May 29 18:02:22.670991 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.670704    2558 scope.go:117] "RemoveContainer" containerID="0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"
May 29 18:02:22.671377 ip-10-0-138-69 kubenswrapper[2558]: E0529 18:02:22.671295    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a\": container with ID starting with 0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a not found: ID does not exist" containerID="0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"
May 29 18:02:22.671377 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:22.671325    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a"} err="failed to get container status \"0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a\": rpc error: code = NotFound desc = could not find container \"0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a\": container with ID starting with 0d3a5cb5ffbbd5be9a62415586c669bbd5fcdf67f39a8d7ab38dd178498eee9a not found: ID does not exist"
May 29 18:02:23.447266 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.447236    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/alertmanager/0.log"
May 29 18:02:23.481219 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.481190    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/config-reloader/0.log"
May 29 18:02:23.509231 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.509200    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/kube-rbac-proxy-web/0.log"
May 29 18:02:23.512727 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.512694    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" path="/var/lib/kubelet/pods/91b681e1-2b22-46b4-ae43-057f58ed2520/volumes"
May 29 18:02:23.542996 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.542970    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/kube-rbac-proxy/0.log"
May 29 18:02:23.574195 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.574161    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/kube-rbac-proxy-metric/0.log"
May 29 18:02:23.600635 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.600604    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/prom-label-proxy/0.log"
May 29 18:02:23.627110 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.627071    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63d1e22d-e05b-4c10-a51b-7ceefe8d3706/init-config-reloader/0.log"
May 29 18:02:23.671484 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.671448    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-qbgd9_e6643768-efe8-4adc-baeb-ee0dbf5c2d2d/cluster-monitoring-operator/0.log"
May 29 18:02:23.796692 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.796606    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-kl5db_51f71c8d-a41a-4c45-8ce6-1750e6370503/monitoring-plugin/0.log"
May 29 18:02:23.940303 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.940264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpscf_231cda52-5939-4f2e-a4b0-c520fd65621e/node-exporter/0.log"
May 29 18:02:23.969258 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.969226    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpscf_231cda52-5939-4f2e-a4b0-c520fd65621e/kube-rbac-proxy/0.log"
May 29 18:02:23.993004 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:23.992976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpscf_231cda52-5939-4f2e-a4b0-c520fd65621e/init-textfile/0.log"
May 29 18:02:24.382648 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.382620    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-9hfgg_972c503a-5834-4955-97fa-2a2db6af096d/prometheus-operator-admission-webhook/0.log"
May 29 18:02:24.446215 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.446181    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5886fb5559-4ss42_db9c3a7d-60be-4af2-b69f-cac1ba61c4e0/telemeter-client/0.log"
May 29 18:02:24.491597 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.491571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5886fb5559-4ss42_db9c3a7d-60be-4af2-b69f-cac1ba61c4e0/reload/0.log"
May 29 18:02:24.533988 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.533960    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5886fb5559-4ss42_db9c3a7d-60be-4af2-b69f-cac1ba61c4e0/kube-rbac-proxy/0.log"
May 29 18:02:24.569554 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.569519    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86c6c6696b-spzkw_6dca3759-1d8b-4e20-93f7-2636fe4e30eb/thanos-query/0.log"
May 29 18:02:24.593711 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.593651    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86c6c6696b-spzkw_6dca3759-1d8b-4e20-93f7-2636fe4e30eb/kube-rbac-proxy-web/0.log"
May 29 18:02:24.622348 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.622062    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86c6c6696b-spzkw_6dca3759-1d8b-4e20-93f7-2636fe4e30eb/kube-rbac-proxy/0.log"
May 29 18:02:24.656585 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.656503    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86c6c6696b-spzkw_6dca3759-1d8b-4e20-93f7-2636fe4e30eb/prom-label-proxy/0.log"
May 29 18:02:24.681664 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.681631    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86c6c6696b-spzkw_6dca3759-1d8b-4e20-93f7-2636fe4e30eb/kube-rbac-proxy-rules/0.log"
May 29 18:02:24.705685 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:24.705654    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86c6c6696b-spzkw_6dca3759-1d8b-4e20-93f7-2636fe4e30eb/kube-rbac-proxy-metrics/0.log"
May 29 18:02:25.678157 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:25.678129    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-sjfdn_94b7d036-5411-4c5b-a003-f446dd2a2ced/networking-console-plugin/0.log"
May 29 18:02:26.360032 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.360005    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7457f764c6-5n2fd_c4659256-ccbb-4a68-a689-cf95b796bc57/console/0.log"
May 29 18:02:26.692365 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.692331    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"]
May 29 18:02:26.692890 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.692868    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="copy"
May 29 18:02:26.692971 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.692894    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="copy"
May 29 18:02:26.692971 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.692928    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="gather"
May 29 18:02:26.692971 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.692937    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="gather"
May 29 18:02:26.693131 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.693014    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="gather"
May 29 18:02:26.693131 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.693030    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="91b681e1-2b22-46b4-ae43-057f58ed2520" containerName="copy"
May 29 18:02:26.696041 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.696012    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.705224 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.705195    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"]
May 29 18:02:26.770653 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.770614    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-lib-modules\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.770878 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.770673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnzk5\" (UniqueName: \"kubernetes.io/projected/8a257080-30a8-4980-9dd6-3541d9369e2e-kube-api-access-mnzk5\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.770878 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.770736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-sys\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.770878 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.770868    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-proc\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.771062 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.770947    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-podres\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.816595 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.816559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-9558b_bca14924-8315-4246-9226-7e50009d9f64/volume-data-source-validator/0.log"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.873549    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-proc\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.873626    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-podres\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.873678    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-lib-modules\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.873720    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnzk5\" (UniqueName: \"kubernetes.io/projected/8a257080-30a8-4980-9dd6-3541d9369e2e-kube-api-access-mnzk5\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.873807    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-sys\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.873930    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-sys\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.874061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-proc\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.874180    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-podres\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.874821 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.874268    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a257080-30a8-4980-9dd6-3541d9369e2e-lib-modules\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:26.884502 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:26.884432    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnzk5\" (UniqueName: \"kubernetes.io/projected/8a257080-30a8-4980-9dd6-3541d9369e2e-kube-api-access-mnzk5\") pod \"perf-node-gather-daemonset-s8w9q\" (UID: \"8a257080-30a8-4980-9dd6-3541d9369e2e\") " pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:27.009680 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.009558    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:27.174141 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.174103    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"]
May 29 18:02:27.180110 ip-10-0-138-69 kubenswrapper[2558]: W0529 18:02:27.179036    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a257080_30a8_4980_9dd6_3541d9369e2e.slice/crio-690ad787e09dddb4b7c5a1447699ff4fad2a73ba6a54c420825b17fb1dd2d359 WatchSource:0}: Error finding container 690ad787e09dddb4b7c5a1447699ff4fad2a73ba6a54c420825b17fb1dd2d359: Status 404 returned error can't find the container with id 690ad787e09dddb4b7c5a1447699ff4fad2a73ba6a54c420825b17fb1dd2d359
May 29 18:02:27.515328 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.515298    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 18:02:27.517106 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.517081    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 18:02:27.591327 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.591308    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nv548_4f0113ab-ed45-42fa-be67-ab6406ec6525/dns/0.log"
May 29 18:02:27.611472 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.611445    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nv548_4f0113ab-ed45-42fa-be67-ab6406ec6525/kube-rbac-proxy/0.log"
May 29 18:02:27.637357 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.637323    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q" event={"ID":"8a257080-30a8-4980-9dd6-3541d9369e2e","Type":"ContainerStarted","Data":"492b5adb8f4445a7786de535661ddac17286e8ad4e421ddfa4e4aa3173fcb8e0"}
May 29 18:02:27.637357 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.637360    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q" event={"ID":"8a257080-30a8-4980-9dd6-3541d9369e2e","Type":"ContainerStarted","Data":"690ad787e09dddb4b7c5a1447699ff4fad2a73ba6a54c420825b17fb1dd2d359"}
May 29 18:02:27.637595 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.637397    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:27.654731 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.654682    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q" podStartSLOduration=1.654665131 podStartE2EDuration="1.654665131s" podCreationTimestamp="2026-05-29 18:02:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 18:02:27.652977633 +0000 UTC m=+1800.638799623" watchObservedRunningTime="2026-05-29 18:02:27.654665131 +0000 UTC m=+1800.640487123"
May 29 18:02:27.686462 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:27.686434    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nq698_ee4c0957-aa37-4727-b9b1-de41023a6e13/dns-node-resolver/0.log"
May 29 18:02:28.124305 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:28.124274    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8224g_c7c4bbc0-d6bb-4fc2-90aa-0e34e2bdaeb8/node-ca/0.log"
May 29 18:02:29.158982 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:29.158943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h9972_c09e52f2-310d-4da7-abee-295e3689f5bf/serve-healthcheck-canary/0.log"
May 29 18:02:29.497105 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:29.497051    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-2rnqk_f2cb3617-4b6a-43f2-a7df-076041e3e852/insights-operator/1.log"
May 29 18:02:29.497105 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:29.497104    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-2rnqk_f2cb3617-4b6a-43f2-a7df-076041e3e852/insights-operator/0.log"
May 29 18:02:29.584685 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:29.584656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqsgj_769590da-bfc7-4a2b-bbd7-6172a5417c10/kube-rbac-proxy/0.log"
May 29 18:02:29.605459 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:29.605421    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqsgj_769590da-bfc7-4a2b-bbd7-6172a5417c10/exporter/0.log"
May 29 18:02:29.627003 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:29.626968    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fqsgj_769590da-bfc7-4a2b-bbd7-6172a5417c10/extractor/0.log"
May 29 18:02:33.645008 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:33.644971    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-59lw4_ceb8c94a-f325-40b8-a1ad-74315284ed55/migrator/0.log"
May 29 18:02:33.653140 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:33.653114    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h2jk7/perf-node-gather-daemonset-s8w9q"
May 29 18:02:33.668787 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:33.668737    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-59lw4_ceb8c94a-f325-40b8-a1ad-74315284ed55/graceful-termination/0.log"
May 29 18:02:33.944408 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:33.944371    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-lldmh_f0e29cd3-95aa-4984-b756-521622bc81be/kube-storage-version-migrator-operator/1.log"
May 29 18:02:33.946102 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:33.946069    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-lldmh_f0e29cd3-95aa-4984-b756-521622bc81be/kube-storage-version-migrator-operator/0.log"
May 29 18:02:34.733888 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.733858    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/kube-multus-additional-cni-plugins/0.log"
May 29 18:02:34.756290 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.756261    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/egress-router-binary-copy/0.log"
May 29 18:02:34.777641 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.777614    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/cni-plugins/0.log"
May 29 18:02:34.798442 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.798401    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/bond-cni-plugin/0.log"
May 29 18:02:34.818599 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.818567    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/routeoverride-cni/0.log"
May 29 18:02:34.841182 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.841154    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/whereabouts-cni-bincopy/0.log"
May 29 18:02:34.862949 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:34.862924    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6z2vs_41263631-aeb1-4e4a-b74d-81ebab5a3046/whereabouts-cni/0.log"
May 29 18:02:35.296469 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:35.296386    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z6g7s_051a81d9-5332-4e43-93fa-76a9d9b0c540/kube-multus/0.log"
May 29 18:02:35.413179 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:35.413147    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x8rpq_6ecfb99b-8aa4-472e-a985-06c40f2b3089/network-metrics-daemon/0.log"
May 29 18:02:35.435475 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:35.435440    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x8rpq_6ecfb99b-8aa4-472e-a985-06c40f2b3089/kube-rbac-proxy/0.log"
May 29 18:02:36.870895 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.870862    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-controller/0.log"
May 29 18:02:36.887658 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.887625    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/0.log"
May 29 18:02:36.905035 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.905004    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovn-acl-logging/1.log"
May 29 18:02:36.926101 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.926060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/kube-rbac-proxy-node/0.log"
May 29 18:02:36.949567 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.949535    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/kube-rbac-proxy-ovn-metrics/0.log"
May 29 18:02:36.969607 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.969575    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/northd/0.log"
May 29 18:02:36.992111 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:36.992086    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/nbdb/0.log"
May 29 18:02:37.013073 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:37.013039    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/sbdb/0.log"
May 29 18:02:37.195844 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:37.195806    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xc8s7_1afc6f59-e725-4558-8cd4-975d4ed8ba37/ovnkube-controller/0.log"
May 29 18:02:38.319297 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:38.319265    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cqgl2_49f341be-bb0c-40ba-8c5d-74c694497c9d/network-check-target-container/0.log"
May 29 18:02:39.155346 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:39.155319    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q4mgf_cdda3bd2-9418-450f-93ba-732c8fedd587/iptables-alerter/0.log"
May 29 18:02:39.881855 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:39.881819    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-njvdv_645d24d3-06ba-4b59-95ca-3c06dab54c1f/tuned/0.log"
May 29 18:02:41.621530 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:41.621495    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-d7hcz_6808d8c8-3dda-4ebf-99d8-beb99706ecd2/cluster-samples-operator/0.log"
May 29 18:02:41.640160 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:41.640127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-d7hcz_6808d8c8-3dda-4ebf-99d8-beb99706ecd2/cluster-samples-operator-watch/0.log"
May 29 18:02:42.544572 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:42.544540    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-mjxdl_c7ebb11b-8ee7-4313-9ae1-01629b5129cf/service-ca-operator/1.log"
May 29 18:02:42.546351 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:42.546327    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-69877444c-mjxdl_c7ebb11b-8ee7-4313-9ae1-01629b5129cf/service-ca-operator/0.log"
May 29 18:02:42.851501 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:42.851426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-685df94d57-cfnld_94272f70-fd9e-4cfa-ab3d-5813ec155619/service-ca-controller/0.log"
May 29 18:02:43.260802 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:43.260746    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kzldb_d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67/csi-driver/0.log"
May 29 18:02:43.280531 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:43.280506    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kzldb_d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67/csi-node-driver-registrar/0.log"
May 29 18:02:43.299800 ip-10-0-138-69 kubenswrapper[2558]: I0529 18:02:43.299776    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-kzldb_d4c89cd1-5615-46a3-97a6-ea4c0f7c9e67/csi-liveness-probe/0.log"