May 25 05:54:49.724546 ip-10-0-128-119 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 05:54:49.724558 ip-10-0-128-119 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 05:54:49.724565 ip-10-0-128-119 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 05:54:49.724820 ip-10-0-128-119 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 05:55:01.083415 ip-10-0-128-119 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 05:55:01.083434 ip-10-0-128-119 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 08cdc3f85b8a4d3088cf5fa76be83739 --
May 25 05:57:14.958104 ip-10-0-128-119 systemd[1]: Starting Kubernetes Kubelet...
May 25 05:57:15.440507 ip-10-0-128-119 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 05:57:15.440507 ip-10-0-128-119 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 05:57:15.440507 ip-10-0-128-119 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 05:57:15.440507 ip-10-0-128-119 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 05:57:15.440507 ip-10-0-128-119 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 05:57:15.443726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.443618    2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 05:57:15.449729 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449714    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:57:15.449729 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449729    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449732    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449736    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449739    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449742    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449745    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449748    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449751    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449756    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449761    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449764    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449767    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449771    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449782    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449785    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449788    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449791    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449793    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449796    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:57:15.449795 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449799    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449802    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449805    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449808    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449811    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449813    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449816    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449818    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449821    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449823    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449826    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449829    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449831    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449834    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449836    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449839    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449841    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449843    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449846    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449848    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:57:15.450250 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449851    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449853    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449856    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449858    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449861    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449863    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449866    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449874    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449877    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449879    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449882    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449884    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449886    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449889    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449892    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449895    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449899    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449901    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449904    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449907    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:57:15.450792 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449909    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449915    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449918    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449920    2556 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449923    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449926    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449928    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449931    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449933    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449936    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449939    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449942    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449944    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449947    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449950    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449952    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449955    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449957    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449959    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449962    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:57:15.451277 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449970    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449973    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449975    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449978    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449980    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.449983    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450459    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450465    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450468    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450472    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450476    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450479    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450481    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450484    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450486    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450489    2556 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450491    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450494    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450496    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450499    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:57:15.451766 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450501    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450504    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450507    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450509    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450512    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450515    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450518    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450520    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450522    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450525    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450527    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450530    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450536    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450538    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450541    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450544    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450546    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450549    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450552    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:57:15.452245 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450555    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450558    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450560    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450563    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450565    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450568    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450570    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450573    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450575    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450578    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450580    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450583    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450585    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450588    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450590    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450594    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450598    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450600    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450602    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:57:15.452726 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450607    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450611    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450614    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450617    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450621    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450624    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450627    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450630    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450633    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450636    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450638    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450641    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450643    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450646    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450648    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450651    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450653    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450656    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450658    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450661    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:57:15.453197 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450663    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450674    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450677    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450680    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450682    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450685    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450688    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450690    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450693    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450696    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450699    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450717    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450720    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.450722    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451875    2556 flags.go:64] FLAG: --address="0.0.0.0"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451884    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451894    2556 flags.go:64] FLAG: --anonymous-auth="true"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451898    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451907    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451910    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451917    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 05:57:15.453679 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451922    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451925    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451928    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451932    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451935    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451938    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451942    2556 flags.go:64] FLAG: --cgroup-root=""
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451945    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451948    2556 flags.go:64] FLAG: --client-ca-file=""
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451951    2556 flags.go:64] FLAG: --cloud-config=""
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451954    2556 flags.go:64] FLAG: --cloud-provider="external"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451957    2556 flags.go:64] FLAG: --cluster-dns="[]"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451961    2556 flags.go:64] FLAG: --cluster-domain=""
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451964    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451967    2556 flags.go:64] FLAG: --config-dir=""
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451970    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451973    2556 flags.go:64] FLAG: --container-log-max-files="5"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451977    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451981    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451984    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451987    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451990    2556 flags.go:64] FLAG: --contention-profiling="false"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451993    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.451996    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452000    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 05:57:15.454291 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452002    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452007    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452010    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452012    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452017    2556 flags.go:64] FLAG: --enable-load-reader="false"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452020    2556 flags.go:64] FLAG: --enable-server="true"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452023    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452029    2556 flags.go:64] FLAG: --event-burst="100"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452032    2556 flags.go:64] FLAG: --event-qps="50"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452035    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452038    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452041    2556 flags.go:64] FLAG: --eviction-hard=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452045    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452047    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452050    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452053    2556 flags.go:64] FLAG: --eviction-soft=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452058    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452061    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452064    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452067    2556 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452070    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452073    2556 flags.go:64] FLAG: --fail-swap-on="true"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452076    2556 flags.go:64] FLAG: --feature-gates=""
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452080    2556 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452083    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 05:57:15.454938 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452086    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452089    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452092    2556 flags.go:64] FLAG: --healthz-port="10248"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452095    2556 flags.go:64] FLAG: --help="false"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452097    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-128-119.ec2.internal"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452100    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452103    2556 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452107    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452110    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452114    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452116    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452120    2556 flags.go:64] FLAG: --image-service-endpoint=""
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452123    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452126    2556 flags.go:64] FLAG: --kube-api-burst="100"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452129    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452133    2556 flags.go:64] FLAG: --kube-api-qps="50"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452136    2556 flags.go:64] FLAG: --kube-reserved=""
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452139    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452142    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452145    2556 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452148    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452151    2556 flags.go:64] FLAG: --lock-file=""
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452154    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452158    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 05:57:15.455554 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452161    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452166    2556 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452169    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452172    2556 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452175    2556 flags.go:64] FLAG: --logging-format="text"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452178    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452181    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452184    2556 flags.go:64] FLAG: --manifest-url=""
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452187    2556 flags.go:64] FLAG: --manifest-url-header=""
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452191    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452194    2556 flags.go:64] FLAG: --max-open-files="1000000"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452199    2556 flags.go:64] FLAG: --max-pods="110"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452202    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452205    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452208    2556 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452211    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452214    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452217    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452220    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452228    2556 flags.go:64] FLAG: --node-status-max-images="50"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452231    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452234    2556 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452237    2556 flags.go:64] FLAG: --pod-cidr=""
May 25 05:57:15.456182 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452240    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452246    2556 flags.go:64] FLAG: --pod-manifest-path=""
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452249    2556 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452253    2556 flags.go:64] FLAG: --pods-per-core="0"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452256    2556 flags.go:64] FLAG: --port="10250"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452259    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452262    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b741d1f7c483f71"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452265    2556 flags.go:64] FLAG: --qos-reserved=""
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452269    2556 flags.go:64] FLAG: --read-only-port="10255"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452272    2556 flags.go:64] FLAG: --register-node="true"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452275    2556 flags.go:64] FLAG: --register-schedulable="true"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452278    2556 flags.go:64] FLAG: --register-with-taints=""
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452282    2556 flags.go:64] FLAG: --registry-burst="10"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452285    2556 flags.go:64] FLAG: --registry-qps="5"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452287    2556 flags.go:64] FLAG: --reserved-cpus=""
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452290    2556 flags.go:64] FLAG: --reserved-memory=""
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452294    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452296    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452300    2556 flags.go:64] FLAG: --rotate-certificates="false"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452302    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452305    2556 flags.go:64] FLAG: --runonce="false"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452308    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452311    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452314    2556 flags.go:64] FLAG: --seccomp-default="false"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452316    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452319    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 05:57:15.456753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452322    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452325    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452328    2556 flags.go:64] FLAG: --storage-driver-password="root"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452332    2556 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452335    2556 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452338    2556 flags.go:64] FLAG: --storage-driver-user="root"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452341    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452344    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452347    2556 flags.go:64] FLAG: --system-cgroups=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452350    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452355    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452358    2556 flags.go:64] FLAG: --tls-cert-file=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452361    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452365    2556 flags.go:64] FLAG: --tls-min-version=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452372    2556 flags.go:64] FLAG: --tls-private-key-file=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452375    2556 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452378    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452381    2556 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452384    2556 flags.go:64] FLAG: --v="2"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452388    2556 flags.go:64] FLAG: --version="false"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452392    2556 flags.go:64] FLAG: --vmodule=""
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452397    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.452400    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452513    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452517    2556 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:57:15.457386 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452520    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452524    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452527    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452530    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452532    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452535    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452538    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452540    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452543    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452546    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452549    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452552    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452555    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452557    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452560    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452562    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452565    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452568    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452570    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452573    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:57:15.458032 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452575    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452579    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452582    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452584    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452587    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452590    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452592    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452595    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452598    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452600    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452603    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452605    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452608    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452611    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452614    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452618    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452621    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452624    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452626    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:57:15.458570 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452629    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452632    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452635    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452639    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452642    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452644    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452647    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452650    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452652    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452655    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452658    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452660    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452662    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452665    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452669    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452671    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452674    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452676    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452679    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452682    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:57:15.459375 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452684    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452687    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452689    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452692    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452695    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452699    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452713    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452715    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452718    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452720    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452723    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452726    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452728    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452731    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452734    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452738    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452741    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452743    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452746    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:57:15.460187 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452748    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:57:15.460651 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452751    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:57:15.460651 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452754    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:57:15.460651 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452757    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:57:15.460651 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452760    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:57:15.460651 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.452763    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:57:15.460651 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.453604    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 05:57:15.461029 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.461010    2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 05:57:15.461059 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.461029    2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 05:57:15.461088 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461079    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:57:15.461088 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461085    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:57:15.461088 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461089    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461092    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461095    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461098    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461101    2556 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461104    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461106    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461109    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461112    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461115    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461117    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461120    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461123    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461125    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461128    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461130    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461133    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461135    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461138    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461141    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:57:15.461169 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461144    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461147    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461151    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461154    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461156    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461159    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461162    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461164    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461167    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461170    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461173    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461176    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461179    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461182    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461185    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461187    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461190    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461192    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461195    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:57:15.461659 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461197    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461200    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461202    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461205    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461207    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461210    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461212    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461215    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461218    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461222    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461224    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461227    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461229    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461232    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461235    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461238    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461240    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461243    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461246    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461249    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:57:15.462179 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461251    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461254    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461257    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461259    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461262    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461266    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461270    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461273    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461276    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461279    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461282    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461285    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461287    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461290    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461293    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461297    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461299    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461302    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461305    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:57:15.462686 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461307    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461310    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461313    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461316    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461319    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461321    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.461326    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461430    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461435    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461439    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461442    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461445    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461450    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461453    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461455    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 05:57:15.463154 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461458    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461461    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461463    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461466    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461468    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461471    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461475    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461477    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461480    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461483    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461485    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461488    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461490    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461493    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461496    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461499    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461501    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461504    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461506    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461509    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 05:57:15.463528 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461511    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461514    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461517    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461519    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461522    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461524    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461528    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461530    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461533    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461536    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461539    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461541    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461544    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461547    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461549    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461552    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461554    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461557    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461560    2556 feature_gate.go:328] unrecognized feature gate: Example
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461562    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461565    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 05:57:15.464026 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461568    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461570    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461573    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461575    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461578    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461580    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461584    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461586    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461589    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461592    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461594    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461597    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461599    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461601    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461604    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461607    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461609    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461612    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461615    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461617    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 05:57:15.464524 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461620    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461622    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461625    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461627    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461630    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461633    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461635    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461638    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461640    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461643    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461645    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461647    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461650    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461654    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461657    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461660    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 05:57:15.465035 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:15.461663    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 05:57:15.465463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.461669    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 05:57:15.465463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.462419    2556 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 05:57:15.466017 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.466003    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 05:57:15.466913 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.466902    2556 server.go:1019] "Starting client certificate rotation"
May 25 05:57:15.467024 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.467009    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 05:57:15.467059 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.467041    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 05:57:15.492181 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.492162    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 05:57:15.494166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.494147    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 05:57:15.508989 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.508850    2556 log.go:25] "Validated CRI v1 runtime API"
May 25 05:57:15.515138 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.515124    2556 log.go:25] "Validated CRI v1 image API"
May 25 05:57:15.517111 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.517098    2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 05:57:15.520126 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.520100    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7cbe5b31-5f84-4b8e-9c08-9d89684441c9:/dev/nvme0n1p3 e9bfb107-9491-47bd-a997-2a4e9af665f8:/dev/nvme0n1p4]
May 25 05:57:15.520206 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.520126    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 05:57:15.526101 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.526082    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 05:57:15.526281 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.526172    2556 manager.go:217] Machine: {Timestamp:2026-05-25 05:57:15.525618294 +0000 UTC m=+0.431386337 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091792 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23fc0dcc86879a59f05246dc2fc3c9 SystemUUID:ec23fc0d-cc86-879a-59f0-5246dc2fc3c9 BootID:08cdc3f8-5b8a-4d30-88cf-5fa76be83739 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a3:47:62:1c:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a3:47:62:1c:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:d6:16:f0:ae:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 05:57:15.527050 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.527038    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 05:57:15.527140 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.527128    2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 05:57:15.531059 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.531035    2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 05:57:15.531192 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.531061    2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-119.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 05:57:15.531243 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.531201    2556 topology_manager.go:138] "Creating topology manager with none policy"
May 25 05:57:15.531243 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.531209    2556 container_manager_linux.go:306] "Creating device plugin manager"
May 25 05:57:15.531243 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.531217    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 05:57:15.532042 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.532032    2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 05:57:15.533481 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.533471    2556 state_mem.go:36] "Initialized new in-memory state store"
May 25 05:57:15.533599 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.533590    2556 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 05:57:15.536078 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.536068    2556 kubelet.go:491] "Attempting to sync node with API server"
May 25 05:57:15.536117 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.536085    2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 05:57:15.536117 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.536097    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 05:57:15.536117 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.536106    2556 kubelet.go:397] "Adding apiserver pod source"
May 25 05:57:15.536117 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.536114    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 05:57:15.537200 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.537188    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 05:57:15.537252 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.537207    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 05:57:15.540310 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.540295    2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 05:57:15.542165 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.542149    2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 05:57:15.544237 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544224    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 05:57:15.544308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544245    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 05:57:15.544308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544256    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 05:57:15.544308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544264    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 05:57:15.544308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544278    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 05:57:15.544308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544287    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 05:57:15.544308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544304    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 05:57:15.544516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544313    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 05:57:15.544516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544324    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 05:57:15.544516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544333    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 05:57:15.544516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544346    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 05:57:15.544516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.544355    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 05:57:15.545416 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.545404    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 05:57:15.545464 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.545421    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 05:57:15.547651 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.547632    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvtjx"
May 25 05:57:15.548782 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.548767    2556 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 05:57:15.548865 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.548807    2556 server.go:1295] "Started kubelet"
May 25 05:57:15.548865 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.548834    2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-119.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 05:57:15.548953 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.548898    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 05:57:15.548989 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.548926    2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 05:57:15.549043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.549031    2556 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 05:57:15.549162 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.549146    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-119.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 05:57:15.549162 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.549147    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 05:57:15.549695 ip-10-0-128-119 systemd[1]: Started Kubernetes Kubelet.
May 25 05:57:15.550487 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.550412    2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 05:57:15.551430 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.551417    2556 server.go:317] "Adding debug handlers to kubelet server"
May 25 05:57:15.556009 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.555989    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jvtjx"
May 25 05:57:15.556172 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.556148    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 05:57:15.556744 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.556699    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 05:57:15.556971 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.556954    2556 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 05:57:15.556971 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.556972    2556 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 05:57:15.557120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.557103    2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 05:57:15.557175 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.557169    2556 reconstruct.go:97] "Volume reconstruction finished"
May 25 05:57:15.557228 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.557178    2556 reconciler.go:26] "Reconciler: start to sync state"
May 25 05:57:15.558172 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.558153    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:15.558328 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.556932    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-119.ec2.internal.18b2b96284af446a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-119.ec2.internal,UID:ip-10-0-128-119.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-119.ec2.internal,},FirstTimestamp:2026-05-25 05:57:15.548779626 +0000 UTC m=+0.454547672,LastTimestamp:2026-05-25 05:57:15.548779626 +0000 UTC m=+0.454547672,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-119.ec2.internal,}"
May 25 05:57:15.558892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.558875    2556 factory.go:55] Registering systemd factory
May 25 05:57:15.558892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.558894    2556 factory.go:223] Registration of the systemd container factory successfully
May 25 05:57:15.560458 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.560412    2556 factory.go:153] Registering CRI-O factory
May 25 05:57:15.560458 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.560443    2556 factory.go:223] Registration of the crio container factory successfully
May 25 05:57:15.560590 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.560507    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 05:57:15.560590 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.560521    2556 factory.go:103] Registering Raw factory
May 25 05:57:15.560590 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.560534    2556 manager.go:1196] Started watching for new ooms in manager
May 25 05:57:15.560951 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.560935    2556 manager.go:319] Starting recovery of all containers
May 25 05:57:15.562161 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.562127    2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 05:57:15.569336 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.569313    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:15.572822 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.572802    2556 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-119.ec2.internal\" not found" node="ip-10-0-128-119.ec2.internal"
May 25 05:57:15.573384 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.573369    2556 manager.go:324] Recovery completed
May 25 05:57:15.574554 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.574531    2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 25 05:57:15.577302 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.577290    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:57:15.579081 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.579063    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:57:15.579139 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.579097    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:57:15.579139 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.579115    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientPID"
May 25 05:57:15.579549 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.579534    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 05:57:15.579606 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.579550    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 05:57:15.579606 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.579565    2556 state_mem.go:36] "Initialized new in-memory state store"
May 25 05:57:15.581979 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.581967    2556 policy_none.go:49] "None policy: Start"
May 25 05:57:15.582027 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.581984    2556 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 05:57:15.582027 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.581994    2556 state_mem.go:35] "Initializing new in-memory state store"
May 25 05:57:15.628280 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628262    2556 manager.go:341] "Starting Device Plugin manager"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.628321    2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628331    2556 server.go:85] "Starting device plugin registration server"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628559    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628573    2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628671    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628770    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.628778    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.629551    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 05:57:15.646300 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.629588    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:15.697147 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.697064    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 05:57:15.698201 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.698178    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 05:57:15.698201 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.698205    2556 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 05:57:15.698330 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.698224    2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 05:57:15.698330 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.698230    2556 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 05:57:15.698330 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.698270    2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 05:57:15.701213 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.701194    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:15.729397 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.729369    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:57:15.731755 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.731739    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:57:15.731835 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.731772    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:57:15.731835 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.731785    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientPID"
May 25 05:57:15.731835 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.731808    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-119.ec2.internal"
May 25 05:57:15.740642 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.740626    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-119.ec2.internal"
May 25 05:57:15.740727 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.740649    2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-119.ec2.internal\": node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:15.793658 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.793637    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:15.798726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.798684    2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"]
May 25 05:57:15.798777 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.798766    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:57:15.800255 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.800240    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:57:15.800329 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.800268    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:57:15.800329 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.800283    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientPID"
May 25 05:57:15.802521 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.802508    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:57:15.802685 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.802670    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.802744 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.802716    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:57:15.803515 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.803498    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:57:15.803589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.803527    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:57:15.803589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.803536    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:57:15.803589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.803557    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:57:15.803589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.803567    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientPID"
May 25 05:57:15.803589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.803539    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientPID"
May 25 05:57:15.805772 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.805758    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.805825 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.805785    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 05:57:15.807142 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.807102    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientMemory"
May 25 05:57:15.807213 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.807157    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasNoDiskPressure"
May 25 05:57:15.807213 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.807172    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeHasSufficientPID"
May 25 05:57:15.828266 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.828242    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-119.ec2.internal\" not found" node="ip-10-0-128-119.ec2.internal"
May 25 05:57:15.832400 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.832386    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-119.ec2.internal\" not found" node="ip-10-0-128-119.ec2.internal"
May 25 05:57:15.858818 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.858793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/270f22191bc5f8508885ec004f783c05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal\" (UID: \"270f22191bc5f8508885ec004f783c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.858904 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.858824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/270f22191bc5f8508885ec004f783c05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal\" (UID: \"270f22191bc5f8508885ec004f783c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.858904 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.858847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d83abb9bcd1d3d50106c4ed78bb9e511-config\") pod \"kube-apiserver-proxy-ip-10-0-128-119.ec2.internal\" (UID: \"d83abb9bcd1d3d50106c4ed78bb9e511\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.893770 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.893730    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:15.959428 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.959366    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/270f22191bc5f8508885ec004f783c05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal\" (UID: \"270f22191bc5f8508885ec004f783c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.959428 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.959397    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/270f22191bc5f8508885ec004f783c05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal\" (UID: \"270f22191bc5f8508885ec004f783c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.959428 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.959413    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d83abb9bcd1d3d50106c4ed78bb9e511-config\") pod \"kube-apiserver-proxy-ip-10-0-128-119.ec2.internal\" (UID: \"d83abb9bcd1d3d50106c4ed78bb9e511\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.959569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.959465    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d83abb9bcd1d3d50106c4ed78bb9e511-config\") pod \"kube-apiserver-proxy-ip-10-0-128-119.ec2.internal\" (UID: \"d83abb9bcd1d3d50106c4ed78bb9e511\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.959569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.959477    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/270f22191bc5f8508885ec004f783c05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal\" (UID: \"270f22191bc5f8508885ec004f783c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.959569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:15.959469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/270f22191bc5f8508885ec004f783c05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal\" (UID: \"270f22191bc5f8508885ec004f783c05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:15.994222 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:15.994191    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.094577 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.094547    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.130732 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.130697    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:16.135393 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.135379    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"
May 25 05:57:16.195269 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.195238    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.295747 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.295671    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.396640 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.396615    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.400417 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.400390    2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:16.466312 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.466277    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 05:57:16.466991 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.466420    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 05:57:16.466991 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.466460    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 05:57:16.466991 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.466462    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 05:57:16.497608 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.497578    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.556737 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.556658    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 05:57:16.558511 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.558474    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 05:52:15 +0000 UTC" deadline="2027-10-25 03:38:17.665373509 +0000 UTC"
May 25 05:57:16.558511 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.558504    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12429h41m1.106872359s"
May 25 05:57:16.569743 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.569719    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 05:57:16.595683 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.595654    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fjpd4"
May 25 05:57:16.597700 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.597683    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.605024 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.605004    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fjpd4"
May 25 05:57:16.698662 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.698640    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.707717 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:16.707615    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270f22191bc5f8508885ec004f783c05.slice/crio-a75c9b346437c33b4405e432d058292102abfb14326d0b19fcc2764ac3183c0c WatchSource:0}: Error finding container a75c9b346437c33b4405e432d058292102abfb14326d0b19fcc2764ac3183c0c: Status 404 returned error can't find the container with id a75c9b346437c33b4405e432d058292102abfb14326d0b19fcc2764ac3183c0c
May 25 05:57:16.707921 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:16.707900    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83abb9bcd1d3d50106c4ed78bb9e511.slice/crio-edc742713a2182ceced22cd8104ad982c327d4c4b1a51eeae64b6281ec4e7b13 WatchSource:0}: Error finding container edc742713a2182ceced22cd8104ad982c327d4c4b1a51eeae64b6281ec4e7b13: Status 404 returned error can't find the container with id edc742713a2182ceced22cd8104ad982c327d4c4b1a51eeae64b6281ec4e7b13
May 25 05:57:16.711140 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.711125    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 05:57:16.798961 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:16.798910    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-119.ec2.internal\" not found"
May 25 05:57:16.870363 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.870342    2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:16.958296 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.958268    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal"
May 25 05:57:16.966543 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.966524    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 05:57:16.967517 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.967504    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal"
May 25 05:57:16.977739 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:16.977722    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 05:57:17.468814 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.468597    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:17.537792 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.537763    2556 apiserver.go:52] "Watching apiserver"
May 25 05:57:17.543791 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.543766    2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 05:57:17.545921 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.545898    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-2mhq5","openshift-dns/node-resolver-ls4sm","openshift-image-registry/node-ca-2j2ks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal","openshift-multus/multus-ncsps","openshift-network-diagnostics/network-check-target-q4tlp","openshift-network-operator/iptables-alerter-5cffg","openshift-ovn-kubernetes/ovnkube-node-pk6gn","kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v","openshift-cluster-node-tuning-operator/tuned-9qv84","openshift-multus/multus-additional-cni-plugins-4cc5d","openshift-multus/network-metrics-daemon-tcxw8"]
May 25 05:57:17.549150 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.549128    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.551315 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.551101    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 05:57:17.551315 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.551131    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 05:57:17.551315 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.551225    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qndq4\""
May 25 05:57:17.551315 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.551107    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 05:57:17.553512 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.553484    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.555070 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.555031    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 05:57:17.555070 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.555067    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5d6r7\""
May 25 05:57:17.555410 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.555394    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 05:57:17.555672 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.555655    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ncsps"
May 25 05:57:17.557255 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.557203    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 05:57:17.557406 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.557388    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kp8bf\""
May 25 05:57:17.557774 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.557579    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 05:57:17.558001 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.557952    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 05:57:17.558001 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.557990    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 05:57:17.558355 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.558333    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:17.558433 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.558400    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:17.558492 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.558429    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.560019 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.559997    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 05:57:17.560107 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.560029    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 05:57:17.560300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.560284    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-shs4n\""
May 25 05:57:17.560391 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.560376    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 05:57:17.560820 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.560802    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.562294 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.562276    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 05:57:17.562788 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.562753    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 05:57:17.563589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.563567    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 05:57:17.565141 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.563944    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tlk6x\""
May 25 05:57:17.565141 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.564180    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 05:57:17.565141 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.564574    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 05:57:17.565141 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.565025    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 05:57:17.567329 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567244    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.567329 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567283    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.567862 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567842    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e19a06ea-d401-4ebf-8145-7f362b31ee97-tmp-dir\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.567954 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-device-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.567954 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567901    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-cni-multus\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.567954 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567930    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-cni-bin\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rfng\" (UniqueName: \"kubernetes.io/projected/593f693a-e362-44a6-b492-2003cc4a489f-kube-api-access-2rfng\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.567997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e19a06ea-d401-4ebf-8145-7f362b31ee97-hosts-file\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568019    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-etc-kubernetes\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bea83059-ff15-484c-a69d-b98f584285cc-host-slash\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568066    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-etc-selinux\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568088    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-cni-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568110    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/593f693a-e362-44a6-b492-2003cc4a489f-cni-binary-copy\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568135    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568178    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-socket-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568238    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-hostroot\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2pnx\" (UniqueName: \"kubernetes.io/projected/428c9d01-c18d-4104-9039-b610d2d52a35-kube-api-access-r2pnx\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bea83059-ff15-484c-a69d-b98f584285cc-iptables-alerter-script\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568338    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clswg\" (UniqueName: \"kubernetes.io/projected/bea83059-ff15-484c-a69d-b98f584285cc-kube-api-access-clswg\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-kubelet\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-socket-dir-parent\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/593f693a-e362-44a6-b492-2003cc4a489f-multus-daemon-config\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568467    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-system-cni-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-cnibin\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.568569 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568540    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-k8s-cni-cncf-io\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-os-release\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568629    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-netns\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568667    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-multus-certs\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568729    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-sys-fs\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568758    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hhjq\" (UniqueName: \"kubernetes.io/projected/e19a06ea-d401-4ebf-8145-7f362b31ee97-kube-api-access-8hhjq\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-conf-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.568835    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-registration-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.569495 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.569292    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 05:57:17.570053 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.569564    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tld6h\""
May 25 05:57:17.570053 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.569592    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 05:57:17.570053 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.569675    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 05:57:17.570053 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.569925    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 05:57:17.570053 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.569972    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5mcs9\""
May 25 05:57:17.570315 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.570102    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.571838 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.571692    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 05:57:17.571933 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.571870    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hl5mx\""
May 25 05:57:17.571990 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.571944    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 05:57:17.572468 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.572449    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:17.572550 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.572519    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:17.574828 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.574811    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.576452 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.576433    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 05:57:17.576553 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.576534    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 05:57:17.576610 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.576592    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 05:57:17.576664 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.576637    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dhchm\""
May 25 05:57:17.605614 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.605585    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 05:52:16 +0000 UTC" deadline="2027-11-22 14:25:22.688576359 +0000 UTC"
May 25 05:57:17.605721 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.605615    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13112h28m5.082966784s"
May 25 05:57:17.657987 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.657958    2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 05:57:17.669882 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.669843    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bea83059-ff15-484c-a69d-b98f584285cc-iptables-alerter-script\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.670043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.669885    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-socket-dir-parent\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.669927    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/593f693a-e362-44a6-b492-2003cc4a489f-multus-daemon-config\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.669965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-host\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.670043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.669987    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-tmp\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.670043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.669999    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-socket-dir-parent\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670043 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670080    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-lib-modules\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-system-cni-dir\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670181    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-os-release\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-etc-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670248    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-cni-bin\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3272da78-8f57-42ec-97a7-50317f36f542-ovn-node-metrics-cert\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670292    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40486405-21ff-427b-b442-cbad172fc783-agent-certs\") pod \"konnectivity-agent-2mhq5\" (UID: \"40486405-21ff-427b-b442-cbad172fc783\") " pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670302    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-os-release\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670314    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-tuned\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.670337 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670336    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-cnibin\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670360    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670390    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-conf-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670430    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-registration-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670455    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-var-lib-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670479    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-device-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670487    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-conf-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670506    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-cni-bin\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670524    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-ovnkube-config\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-host\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670560    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bea83059-ff15-484c-a69d-b98f584285cc-iptables-alerter-script\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670566    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-registration-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670569    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-os-release\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670584    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/593f693a-e362-44a6-b492-2003cc4a489f-multus-daemon-config\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670601    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bea83059-ff15-484c-a69d-b98f584285cc-host-slash\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670625    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-cni-bin\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670672    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-etc-selinux\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.670726 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670679    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-device-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670718    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-run-netns\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670749    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bea83059-ff15-484c-a69d-b98f584285cc-host-slash\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-etc-selinux\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670818    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzvk\" (UniqueName: \"kubernetes.io/projected/3272da78-8f57-42ec-97a7-50317f36f542-kube-api-access-bmzvk\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670876    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-sys\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670903    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-cni-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670927    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670954    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670972    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-multus-cni-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.670980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-systemd-units\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671050    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671098    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-slash\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-serviceca\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671163    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-var-lib-kubelet\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.671429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-ovnkube-script-lib\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysconfig\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671315    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clswg\" (UniqueName: \"kubernetes.io/projected/bea83059-ff15-484c-a69d-b98f584285cc-kube-api-access-clswg\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671341    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-kubelet\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-systemd\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671385    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-log-socket\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671402    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-env-overrides\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40486405-21ff-427b-b442-cbad172fc783-konnectivity-ca\") pod \"konnectivity-agent-2mhq5\" (UID: \"40486405-21ff-427b-b442-cbad172fc783\") " pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-kubernetes\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671412    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-kubelet\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671516    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-system-cni-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671554    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-cnibin\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671581    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-k8s-cni-cncf-io\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671581    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-system-cni-dir\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671605    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-cnibin\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671637    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-k8s-cni-cncf-io\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671670    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sbs\" (UniqueName: \"kubernetes.io/projected/438670a2-3747-433b-8387-78a11257ee45-kube-api-access-t9sbs\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.672166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671699    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-netns\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671736    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-multus-certs\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671761    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-sys-fs\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671774    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-netns\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671787    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hhjq\" (UniqueName: \"kubernetes.io/projected/e19a06ea-d401-4ebf-8145-7f362b31ee97-kube-api-access-8hhjq\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671836    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-sys-fs\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671863    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-cni-netd\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671909    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysctl-conf\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671936    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-run-multus-certs\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671939    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e19a06ea-d401-4ebf-8145-7f362b31ee97-tmp-dir\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.671982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-kubelet\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672016    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-ovn\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672043    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672066    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-cni-multus\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672084    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rfng\" (UniqueName: \"kubernetes.io/projected/593f693a-e362-44a6-b492-2003cc4a489f-kube-api-access-2rfng\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672116    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e19a06ea-d401-4ebf-8145-7f362b31ee97-hosts-file\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672130    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-host-var-lib-cni-multus\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.672963 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672199    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-node-log\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672208    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e19a06ea-d401-4ebf-8145-7f362b31ee97-hosts-file\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672230    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-modprobe-d\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672247    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysctl-d\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-systemd\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672290    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-etc-kubernetes\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672326    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e19a06ea-d401-4ebf-8145-7f362b31ee97-tmp-dir\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672329    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-etc-kubernetes\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672333    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p6bn\" (UniqueName: \"kubernetes.io/projected/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-kube-api-access-8p6bn\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-run\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr55b\" (UniqueName: \"kubernetes.io/projected/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-kube-api-access-rr55b\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672480    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/593f693a-e362-44a6-b492-2003cc4a489f-cni-binary-copy\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672506    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-socket-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672534    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4grz\" (UniqueName: \"kubernetes.io/projected/cb9f7217-4ee1-4d73-a997-ee78a2570a46-kube-api-access-m4grz\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672586    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-hostroot\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672611    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2pnx\" (UniqueName: \"kubernetes.io/projected/428c9d01-c18d-4104-9039-b610d2d52a35-kube-api-access-r2pnx\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.673597 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672668    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/428c9d01-c18d-4104-9039-b610d2d52a35-socket-dir\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.674118 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672680    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/593f693a-e362-44a6-b492-2003cc4a489f-hostroot\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.674118 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.672750    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.674118 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.673081    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/593f693a-e362-44a6-b492-2003cc4a489f-cni-binary-copy\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.679378 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.679347    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:17.679378 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.679362    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 05:57:17.679538 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.679386    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:17.679538 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.679400    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:17.679653 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.679638    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:18.179577712 +0000 UTC m=+3.085345761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:17.682960 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.682934    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2pnx\" (UniqueName: \"kubernetes.io/projected/428c9d01-c18d-4104-9039-b610d2d52a35-kube-api-access-r2pnx\") pod \"aws-ebs-csi-driver-node-wnl2v\" (UID: \"428c9d01-c18d-4104-9039-b610d2d52a35\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.683052 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.682941    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clswg\" (UniqueName: \"kubernetes.io/projected/bea83059-ff15-484c-a69d-b98f584285cc-kube-api-access-clswg\") pod \"iptables-alerter-5cffg\" (UID: \"bea83059-ff15-484c-a69d-b98f584285cc\") " pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.683052 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.682941    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hhjq\" (UniqueName: \"kubernetes.io/projected/e19a06ea-d401-4ebf-8145-7f362b31ee97-kube-api-access-8hhjq\") pod \"node-resolver-ls4sm\" (UID: \"e19a06ea-d401-4ebf-8145-7f362b31ee97\") " pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.683460 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.683437    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rfng\" (UniqueName: \"kubernetes.io/projected/593f693a-e362-44a6-b492-2003cc4a489f-kube-api-access-2rfng\") pod \"multus-ncsps\" (UID: \"593f693a-e362-44a6-b492-2003cc4a489f\") " pod="openshift-multus/multus-ncsps"
May 25 05:57:17.704475 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.704431    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal" event={"ID":"d83abb9bcd1d3d50106c4ed78bb9e511","Type":"ContainerStarted","Data":"edc742713a2182ceced22cd8104ad982c327d4c4b1a51eeae64b6281ec4e7b13"}
May 25 05:57:17.705575 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.705549    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal" event={"ID":"270f22191bc5f8508885ec004f783c05","Type":"ContainerStarted","Data":"a75c9b346437c33b4405e432d058292102abfb14326d0b19fcc2764ac3183c0c"}
May 25 05:57:17.773327 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773253    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-systemd\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773327 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773286    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-log-socket\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773327 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773303    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-env-overrides\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773327 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773317    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40486405-21ff-427b-b442-cbad172fc783-konnectivity-ca\") pod \"konnectivity-agent-2mhq5\" (UID: \"40486405-21ff-427b-b442-cbad172fc783\") " pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773366    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-kubernetes\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773380    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-systemd\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773417    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sbs\" (UniqueName: \"kubernetes.io/projected/438670a2-3747-433b-8387-78a11257ee45-kube-api-access-t9sbs\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773434    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-kubernetes\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773441    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-log-socket\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773448    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-cni-netd\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773488    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-cni-netd\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773493    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysctl-conf\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773522    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-kubelet\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773541    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-ovn\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773575    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-kubelet\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773595    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773610    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-ovn\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.773628 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773626    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-node-log\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773659    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-modprobe-d\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773685    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysctl-d\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773722    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-systemd\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773722    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysctl-conf\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773749    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p6bn\" (UniqueName: \"kubernetes.io/projected/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-kube-api-access-8p6bn\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773767    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-env-overrides\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773787    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-node-log\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773772    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-run\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773827    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rr55b\" (UniqueName: \"kubernetes.io/projected/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-kube-api-access-rr55b\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773834    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-run\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773844    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-modprobe-d\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773859    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4grz\" (UniqueName: \"kubernetes.io/projected/cb9f7217-4ee1-4d73-a997-ee78a2570a46-kube-api-access-m4grz\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773878    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-systemd\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773883    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysctl-d\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773887    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773917    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-run-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773928    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.774273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773955    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-host\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773974    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/40486405-21ff-427b-b442-cbad172fc783-konnectivity-ca\") pod \"konnectivity-agent-2mhq5\" (UID: \"40486405-21ff-427b-b442-cbad172fc783\") " pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.773999    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-tmp\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774049    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774083    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774090    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-host\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774108    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-lib-modules\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774137    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-system-cni-dir\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774141    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774164    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-etc-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774188    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-cni-bin\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774214    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3272da78-8f57-42ec-97a7-50317f36f542-ovn-node-metrics-cert\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774220    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774225    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-system-cni-dir\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774239    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-lib-modules\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774239    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40486405-21ff-427b-b442-cbad172fc783-agent-certs\") pod \"konnectivity-agent-2mhq5\" (UID: \"40486405-21ff-427b-b442-cbad172fc783\") " pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.774188    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774273    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-cni-bin\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775071 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774315    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-etc-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:17.774325    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:18.274303641 +0000 UTC m=+3.180071687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774429    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-tuned\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774450    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-cni-binary-copy\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774457    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-cnibin\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-cnibin\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774504    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774536    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-var-lib-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774565    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-ovnkube-config\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774589    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-host\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774621    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-os-release\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774617    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-var-lib-openvswitch\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774665    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-run-netns\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774688    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/438670a2-3747-433b-8387-78a11257ee45-os-release\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774692    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774741    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-run-ovn-kubernetes\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.775879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774741    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzvk\" (UniqueName: \"kubernetes.io/projected/3272da78-8f57-42ec-97a7-50317f36f542-kube-api-access-bmzvk\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774777    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-sys\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774817    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-systemd-units\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774847    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-slash\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774873    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-serviceca\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774917    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-var-lib-kubelet\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774943    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774957    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-host\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774972    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-ovnkube-script-lib\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.774997    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysconfig\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775005    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-systemd-units\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775066    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775072    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-var-lib-kubelet\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775112    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-sys\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775140    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-ovnkube-config\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775157    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-slash\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775197    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-sysconfig\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3272da78-8f57-42ec-97a7-50317f36f542-host-run-netns\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.776613 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775539    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-serviceca\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.777516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775577    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3272da78-8f57-42ec-97a7-50317f36f542-ovnkube-script-lib\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.777516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.775635    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/438670a2-3747-433b-8387-78a11257ee45-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.777516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.776797    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-etc-tuned\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.777516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.777358    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-tmp\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.777516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.777484    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/40486405-21ff-427b-b442-cbad172fc783-agent-certs\") pod \"konnectivity-agent-2mhq5\" (UID: \"40486405-21ff-427b-b442-cbad172fc783\") " pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.777655 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.777638    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3272da78-8f57-42ec-97a7-50317f36f542-ovn-node-metrics-cert\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.787900 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.787869    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sbs\" (UniqueName: \"kubernetes.io/projected/438670a2-3747-433b-8387-78a11257ee45-kube-api-access-t9sbs\") pod \"multus-additional-cni-plugins-4cc5d\" (UID: \"438670a2-3747-433b-8387-78a11257ee45\") " pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.788032 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.788022    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr55b\" (UniqueName: \"kubernetes.io/projected/660fbf23-48e2-48d3-98f5-3c3ff4e9caed-kube-api-access-rr55b\") pod \"tuned-9qv84\" (UID: \"660fbf23-48e2-48d3-98f5-3c3ff4e9caed\") " pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.789206 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.789186    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p6bn\" (UniqueName: \"kubernetes.io/projected/ce1aa8a8-bacb-420d-af6b-e3335f2b4866-kube-api-access-8p6bn\") pod \"node-ca-2j2ks\" (UID: \"ce1aa8a8-bacb-420d-af6b-e3335f2b4866\") " pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:17.789523 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.789499    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzvk\" (UniqueName: \"kubernetes.io/projected/3272da78-8f57-42ec-97a7-50317f36f542-kube-api-access-bmzvk\") pod \"ovnkube-node-pk6gn\" (UID: \"3272da78-8f57-42ec-97a7-50317f36f542\") " pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.789738 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.789699    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4grz\" (UniqueName: \"kubernetes.io/projected/cb9f7217-4ee1-4d73-a997-ee78a2570a46-kube-api-access-m4grz\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:17.861819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.861784    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v"
May 25 05:57:17.868715 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.868684    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ls4sm"
May 25 05:57:17.879460 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.879439    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ncsps"
May 25 05:57:17.883940 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.883919    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:17.887283 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.887255    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5cffg"
May 25 05:57:17.892922 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.892907    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:17.899488 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.899470    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9qv84"
May 25 05:57:17.905035 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.905016    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:17.911556 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.911539    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4cc5d"
May 25 05:57:17.916715 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:17.916689    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2j2ks"
May 25 05:57:18.277927 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.277900    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:18.278057 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.277951    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:18.278135 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:18.278051    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:18.278135 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:18.278133    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:19.278113354 +0000 UTC m=+4.183881396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:18.278293 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:18.278062    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:18.278293 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:18.278160    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:18.278293 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:18.278174    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:18.278293 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:18.278214    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:19.278201231 +0000 UTC m=+4.183969274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:18.294128 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.294102    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod660fbf23_48e2_48d3_98f5_3c3ff4e9caed.slice/crio-d5f98d0056e0fa0d31bb94a4c5925308e2944201ab76483f885094d5d4069a64 WatchSource:0}: Error finding container d5f98d0056e0fa0d31bb94a4c5925308e2944201ab76483f885094d5d4069a64: Status 404 returned error can't find the container with id d5f98d0056e0fa0d31bb94a4c5925308e2944201ab76483f885094d5d4069a64
May 25 05:57:18.295366 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.295276    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode19a06ea_d401_4ebf_8145_7f362b31ee97.slice/crio-eae782256ab9f0b314b286ddc25d87dde3155fc9188d358cdbb68aaf288dba1c WatchSource:0}: Error finding container eae782256ab9f0b314b286ddc25d87dde3155fc9188d358cdbb68aaf288dba1c: Status 404 returned error can't find the container with id eae782256ab9f0b314b286ddc25d87dde3155fc9188d358cdbb68aaf288dba1c
May 25 05:57:18.299188 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.299168    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593f693a_e362_44a6_b492_2003cc4a489f.slice/crio-5c36dd97015db23f6953488a8922d6b3f1e99f755d7ac28cef74589f2030bc33 WatchSource:0}: Error finding container 5c36dd97015db23f6953488a8922d6b3f1e99f755d7ac28cef74589f2030bc33: Status 404 returned error can't find the container with id 5c36dd97015db23f6953488a8922d6b3f1e99f755d7ac28cef74589f2030bc33
May 25 05:57:18.299839 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.299811    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3272da78_8f57_42ec_97a7_50317f36f542.slice/crio-50d1f1301ce4cbb1f4124466ea8b4cc804ee696b2510a812d394152f3304b6c2 WatchSource:0}: Error finding container 50d1f1301ce4cbb1f4124466ea8b4cc804ee696b2510a812d394152f3304b6c2: Status 404 returned error can't find the container with id 50d1f1301ce4cbb1f4124466ea8b4cc804ee696b2510a812d394152f3304b6c2
May 25 05:57:18.300676 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.300659    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbea83059_ff15_484c_a69d_b98f584285cc.slice/crio-898028ea7df719d9ad52046e1428a9da0a949c25e9a81fb62e4d3adef4f3cfcb WatchSource:0}: Error finding container 898028ea7df719d9ad52046e1428a9da0a949c25e9a81fb62e4d3adef4f3cfcb: Status 404 returned error can't find the container with id 898028ea7df719d9ad52046e1428a9da0a949c25e9a81fb62e4d3adef4f3cfcb
May 25 05:57:18.302887 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.302698    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40486405_21ff_427b_b442_cbad172fc783.slice/crio-d7f0c95e469e274c84f9a12e770e16594648eb61c6a04c167b412a28d263d528 WatchSource:0}: Error finding container d7f0c95e469e274c84f9a12e770e16594648eb61c6a04c167b412a28d263d528: Status 404 returned error can't find the container with id d7f0c95e469e274c84f9a12e770e16594648eb61c6a04c167b412a28d263d528
May 25 05:57:18.303130 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.303107    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428c9d01_c18d_4104_9039_b610d2d52a35.slice/crio-d6e7c0e8554be962e11d67f25c513d8afad59a3bd8a9bbcf69be3acb79b5db00 WatchSource:0}: Error finding container d6e7c0e8554be962e11d67f25c513d8afad59a3bd8a9bbcf69be3acb79b5db00: Status 404 returned error can't find the container with id d6e7c0e8554be962e11d67f25c513d8afad59a3bd8a9bbcf69be3acb79b5db00
May 25 05:57:18.304062 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.304038    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1aa8a8_bacb_420d_af6b_e3335f2b4866.slice/crio-ba54a54d9ee23f3c21bcca2f0480c8ec14e5030b7c6990b6b1cec9e2ce8aa29e WatchSource:0}: Error finding container ba54a54d9ee23f3c21bcca2f0480c8ec14e5030b7c6990b6b1cec9e2ce8aa29e: Status 404 returned error can't find the container with id ba54a54d9ee23f3c21bcca2f0480c8ec14e5030b7c6990b6b1cec9e2ce8aa29e
May 25 05:57:18.305008 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:18.304987    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438670a2_3747_433b_8387_78a11257ee45.slice/crio-e2f099210f7763966fb47b5ebd8a82c4211e4a688deb0fbeb717d74a9a542654 WatchSource:0}: Error finding container e2f099210f7763966fb47b5ebd8a82c4211e4a688deb0fbeb717d74a9a542654: Status 404 returned error can't find the container with id e2f099210f7763966fb47b5ebd8a82c4211e4a688deb0fbeb717d74a9a542654
May 25 05:57:18.470239 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.468552    2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 05:57:18.606734 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.606687    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 05:52:16 +0000 UTC" deadline="2027-12-10 21:41:03.314891254 +0000 UTC"
May 25 05:57:18.606734 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.606726    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13551h43m44.708167294s"
May 25 05:57:18.721189 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.720795    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9qv84" event={"ID":"660fbf23-48e2-48d3-98f5-3c3ff4e9caed","Type":"ContainerStarted","Data":"d5f98d0056e0fa0d31bb94a4c5925308e2944201ab76483f885094d5d4069a64"}
May 25 05:57:18.727673 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.727638    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal" event={"ID":"d83abb9bcd1d3d50106c4ed78bb9e511","Type":"ContainerStarted","Data":"5d0012d17d11046146cd5732cf801f561634ecf10a3dc46aa239cf10504bc234"}
May 25 05:57:18.733041 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.732488    2556 generic.go:358] "Generic (PLEG): container finished" podID="270f22191bc5f8508885ec004f783c05" containerID="cf54a7c209b33a54eabec71a85bef46a98c5b4850c03937093d4b32d2a4278ff" exitCode=0
May 25 05:57:18.733041 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.732554    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal" event={"ID":"270f22191bc5f8508885ec004f783c05","Type":"ContainerDied","Data":"cf54a7c209b33a54eabec71a85bef46a98c5b4850c03937093d4b32d2a4278ff"}
May 25 05:57:18.745089 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.744792    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-119.ec2.internal" podStartSLOduration=2.7447751929999997 podStartE2EDuration="2.744775193s" podCreationTimestamp="2026-05-25 05:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:57:18.744043898 +0000 UTC m=+3.649811950" watchObservedRunningTime="2026-05-25 05:57:18.744775193 +0000 UTC m=+3.650543246"
May 25 05:57:18.746562 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.746391    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2j2ks" event={"ID":"ce1aa8a8-bacb-420d-af6b-e3335f2b4866","Type":"ContainerStarted","Data":"ba54a54d9ee23f3c21bcca2f0480c8ec14e5030b7c6990b6b1cec9e2ce8aa29e"}
May 25 05:57:18.751591 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.750607    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mhq5" event={"ID":"40486405-21ff-427b-b442-cbad172fc783","Type":"ContainerStarted","Data":"d7f0c95e469e274c84f9a12e770e16594648eb61c6a04c167b412a28d263d528"}
May 25 05:57:18.756008 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.755920    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5cffg" event={"ID":"bea83059-ff15-484c-a69d-b98f584285cc","Type":"ContainerStarted","Data":"898028ea7df719d9ad52046e1428a9da0a949c25e9a81fb62e4d3adef4f3cfcb"}
May 25 05:57:18.760266 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.760066    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ncsps" event={"ID":"593f693a-e362-44a6-b492-2003cc4a489f","Type":"ContainerStarted","Data":"5c36dd97015db23f6953488a8922d6b3f1e99f755d7ac28cef74589f2030bc33"}
May 25 05:57:18.762741 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.762718    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ls4sm" event={"ID":"e19a06ea-d401-4ebf-8145-7f362b31ee97","Type":"ContainerStarted","Data":"eae782256ab9f0b314b286ddc25d87dde3155fc9188d358cdbb68aaf288dba1c"}
May 25 05:57:18.768837 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.768782    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerStarted","Data":"e2f099210f7763966fb47b5ebd8a82c4211e4a688deb0fbeb717d74a9a542654"}
May 25 05:57:18.788312 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.788253    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v" event={"ID":"428c9d01-c18d-4104-9039-b610d2d52a35","Type":"ContainerStarted","Data":"d6e7c0e8554be962e11d67f25c513d8afad59a3bd8a9bbcf69be3acb79b5db00"}
May 25 05:57:18.791338 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:18.791287    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"50d1f1301ce4cbb1f4124466ea8b4cc804ee696b2510a812d394152f3304b6c2"}
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:19.283788    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:19.283846    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.283948    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.283986    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.284001    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.284014    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.284024    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:21.284001143 +0000 UTC m=+6.189769194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:19.284090 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.284061    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:21.284046224 +0000 UTC m=+6.189814267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:19.698923 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:19.698847    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:19.699431 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.698968    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:19.699431 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:19.699317    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:19.699431 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:19.699418    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:19.810633 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:19.810589    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal" event={"ID":"270f22191bc5f8508885ec004f783c05","Type":"ContainerStarted","Data":"492b7464a068e038d7b1c22730f709d49956ebd1437fee2abcceeacd18536e48"}
May 25 05:57:21.300942 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:21.300906    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:21.300984    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.301112    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.301175    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:25.301154938 +0000 UTC m=+10.206922970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.301227    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.301254    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.301270    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:21.301390 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.301333    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:25.301310695 +0000 UTC m=+10.207078750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:21.700010 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:21.699766    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:21.700010 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:21.699777    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:21.700010 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.699914    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:21.700010 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:21.699981    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:23.703429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:23.703395    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:23.703429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:23.703414    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:23.703941 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:23.703523    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:23.703941 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:23.703667    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:25.335469 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:25.335421    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:25.335513    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.335607    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.335634    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.335649    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.335658    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.335731    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:33.335695699 +0000 UTC m=+18.241463738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:25.335948 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.335755    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:33.335744569 +0000 UTC m=+18.241512601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:25.699386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:25.699027    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:25.699386 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.699171    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:25.700464 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:25.700440    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:25.700586 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:25.700538    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:27.699020 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:27.698988    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:27.699405 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:27.699026    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:27.699405 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:27.699104    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:27.699405 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:27.699220    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:29.698760 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:29.698724    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:29.699179 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:29.698726    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:29.699179 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:29.698879    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:29.699179 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:29.698938    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:31.698791 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:31.698753    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:31.698791 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:31.698780    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:31.699282 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:31.698910    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:31.699282 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:31.699015    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:33.398929 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.398897    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.399050    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.399086    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.399113    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.399126    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.399151    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.399195    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:49.399175489 +0000 UTC m=+34.304943534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:33.399447 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.399217    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:57:49.399206062 +0000 UTC m=+34.304974091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:33.468849 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.468790    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-119.ec2.internal" podStartSLOduration=17.468776394 podStartE2EDuration="17.468776394s" podCreationTimestamp="2026-05-25 05:57:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:57:19.826325619 +0000 UTC m=+4.732093671" watchObservedRunningTime="2026-05-25 05:57:33.468776394 +0000 UTC m=+18.374544445"
May 25 05:57:33.469332 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.469311    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d5ct2"]
May 25 05:57:33.524326 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.524296    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.524485 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.524378    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:33.600956 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.600925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.601137 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.600983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a7d6a71-9978-4998-b703-176132d5c7ac-dbus\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.601137 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.601052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a7d6a71-9978-4998-b703-176132d5c7ac-kubelet-config\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.698466 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.698386    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:33.698634 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.698395    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:33.698634 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.698502    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:33.698634 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.698609    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:33.702170 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.702149    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a7d6a71-9978-4998-b703-176132d5c7ac-dbus\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.702289 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.702194    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a7d6a71-9978-4998-b703-176132d5c7ac-kubelet-config\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.702289 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.702250    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.702393 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.702312    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a7d6a71-9978-4998-b703-176132d5c7ac-dbus\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.702393 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:33.702335    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a7d6a71-9978-4998-b703-176132d5c7ac-kubelet-config\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:33.702393 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.702363    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:33.702495 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:33.702424    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret podName:6a7d6a71-9978-4998-b703-176132d5c7ac nodeName:}" failed. No retries permitted until 2026-05-25 05:57:34.202405898 +0000 UTC m=+19.108173930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret") pod "global-pull-secret-syncer-d5ct2" (UID: "6a7d6a71-9978-4998-b703-176132d5c7ac") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:34.205863 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:34.205829    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:34.206126 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:34.205975    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:34.206126 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:34.206040    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret podName:6a7d6a71-9978-4998-b703-176132d5c7ac nodeName:}" failed. No retries permitted until 2026-05-25 05:57:35.206022349 +0000 UTC m=+20.111790378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret") pod "global-pull-secret-syncer-d5ct2" (UID: "6a7d6a71-9978-4998-b703-176132d5c7ac") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:34.699200 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:34.699005    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:34.699591 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:34.699262    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:35.212583 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:35.212546    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:35.212768 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:35.212668    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:35.212768 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:35.212746    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret podName:6a7d6a71-9978-4998-b703-176132d5c7ac nodeName:}" failed. No retries permitted until 2026-05-25 05:57:37.212731024 +0000 UTC m=+22.118499053 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret") pod "global-pull-secret-syncer-d5ct2" (UID: "6a7d6a71-9978-4998-b703-176132d5c7ac") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:35.699676 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:35.699651    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:35.700027 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:35.699741    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:35.700027 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:35.699833    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:35.700027 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:35.699949    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:36.699508 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.699328    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:36.699629 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:36.699609    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:36.848296 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.848259    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ncsps" event={"ID":"593f693a-e362-44a6-b492-2003cc4a489f","Type":"ContainerStarted","Data":"5c6f5fa436b312d31ab65363e1dd7f40665c0b47c6ac1a2d92431a21073f1b48"}
May 25 05:57:36.849574 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.849550    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ls4sm" event={"ID":"e19a06ea-d401-4ebf-8145-7f362b31ee97","Type":"ContainerStarted","Data":"590a2a8cb1c65c9edd5667a16ed897ad1d543ddc3e84ac03aa5e6778c5d12b43"}
May 25 05:57:36.850896 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.850872    2556 generic.go:358] "Generic (PLEG): container finished" podID="438670a2-3747-433b-8387-78a11257ee45" containerID="96808f7ea77418dc3da5697b12d694952ef62c4a50d1608e53cce1ebd13e3ca6" exitCode=0
May 25 05:57:36.850997 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.850936    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerDied","Data":"96808f7ea77418dc3da5697b12d694952ef62c4a50d1608e53cce1ebd13e3ca6"}
May 25 05:57:36.852399 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.852375    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v" event={"ID":"428c9d01-c18d-4104-9039-b610d2d52a35","Type":"ContainerStarted","Data":"aad34bf2828d0e030bcee6611f6eb3a86e179e73d5703c2f3e3401600e9eb668"}
May 25 05:57:36.855003 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.854987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 05:57:36.855309 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855284    2556 generic.go:358] "Generic (PLEG): container finished" podID="3272da78-8f57-42ec-97a7-50317f36f542" containerID="280f964fcbad5cc3f07b4eb8153707286a675e6d486b7b0618114a7d4f23f6e3" exitCode=1
May 25 05:57:36.855406 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855367    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"3969f4cb22039ec0fcd4365a9cf708db59a230ffdd9099618fa3a25dc8d7429d"}
May 25 05:57:36.855469 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855404    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"4f124e9128afa86857119e02f920775cfebe742fe8f7cbf0b00759710b08e1bb"}
May 25 05:57:36.855469 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855419    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"d4ec586c156056aff1990781ba84e2195d0eea74106795f6c1371024925717da"}
May 25 05:57:36.855469 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855431    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"afdf819b7576e774d574f899bb644aa9374eb8900bad0bbd1f06fcb9efc6b349"}
May 25 05:57:36.855469 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855444    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerDied","Data":"280f964fcbad5cc3f07b4eb8153707286a675e6d486b7b0618114a7d4f23f6e3"}
May 25 05:57:36.855469 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.855458    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"533be4b6b43a3429891bfc5b9ba1da5a239991b8d4285335eb475c15341539d9"}
May 25 05:57:36.856807 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.856775    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9qv84" event={"ID":"660fbf23-48e2-48d3-98f5-3c3ff4e9caed","Type":"ContainerStarted","Data":"95a7f78aab3092e04cea5283a72508048a73d69990404da93ce536cecc49d13f"}
May 25 05:57:36.858006 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.857977    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2j2ks" event={"ID":"ce1aa8a8-bacb-420d-af6b-e3335f2b4866","Type":"ContainerStarted","Data":"c3452de5bf2bcd19ebbb31880b9e41b0e8039a846b1fac77273ea31d2c8796fa"}
May 25 05:57:36.859070 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.859050    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mhq5" event={"ID":"40486405-21ff-427b-b442-cbad172fc783","Type":"ContainerStarted","Data":"a2aef299bbc324f4acffe032bd25ee1519b4f34fc0c9f8255827abb78a90b425"}
May 25 05:57:36.869309 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.869274    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ncsps" podStartSLOduration=4.147104882 podStartE2EDuration="21.869265241s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.30089077 +0000 UTC m=+3.206658803" lastFinishedPulling="2026-05-25 05:57:36.023051134 +0000 UTC m=+20.928819162" observedRunningTime="2026-05-25 05:57:36.869092093 +0000 UTC m=+21.774860165" watchObservedRunningTime="2026-05-25 05:57:36.869265241 +0000 UTC m=+21.775033291"
May 25 05:57:36.896281 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.896244    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ls4sm" podStartSLOduration=4.234227113 podStartE2EDuration="21.896233768s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.29741714 +0000 UTC m=+3.203185169" lastFinishedPulling="2026-05-25 05:57:35.959423781 +0000 UTC m=+20.865191824" observedRunningTime="2026-05-25 05:57:36.895848272 +0000 UTC m=+21.801616323" watchObservedRunningTime="2026-05-25 05:57:36.896233768 +0000 UTC m=+21.802001820"
May 25 05:57:36.939032 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.938990    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9qv84" podStartSLOduration=4.244161054 podStartE2EDuration="21.938977674s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.296459179 +0000 UTC m=+3.202227210" lastFinishedPulling="2026-05-25 05:57:35.991275787 +0000 UTC m=+20.897043830" observedRunningTime="2026-05-25 05:57:36.938847414 +0000 UTC m=+21.844615465" watchObservedRunningTime="2026-05-25 05:57:36.938977674 +0000 UTC m=+21.844745724"
May 25 05:57:36.939263 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:36.939238    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mhq5" podStartSLOduration=4.254151333 podStartE2EDuration="21.9392322s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.303862591 +0000 UTC m=+3.209630620" lastFinishedPulling="2026-05-25 05:57:35.988943444 +0000 UTC m=+20.894711487" observedRunningTime="2026-05-25 05:57:36.913870159 +0000 UTC m=+21.819638209" watchObservedRunningTime="2026-05-25 05:57:36.9392322 +0000 UTC m=+21.845000251"
May 25 05:57:37.158437 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.158402    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:37.158988 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.158974    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:37.181048 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.181000    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2j2ks" podStartSLOduration=11.458944439 podStartE2EDuration="21.180986451s" podCreationTimestamp="2026-05-25 05:57:16 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.308436966 +0000 UTC m=+3.214205000" lastFinishedPulling="2026-05-25 05:57:28.030478971 +0000 UTC m=+12.936247012" observedRunningTime="2026-05-25 05:57:36.986739397 +0000 UTC m=+21.892507446" watchObservedRunningTime="2026-05-25 05:57:37.180986451 +0000 UTC m=+22.086754552"
May 25 05:57:37.228803 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.228773    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:37.228920 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:37.228887    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:37.228962 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:37.228934    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret podName:6a7d6a71-9978-4998-b703-176132d5c7ac nodeName:}" failed. No retries permitted until 2026-05-25 05:57:41.228921976 +0000 UTC m=+26.134690004 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret") pod "global-pull-secret-syncer-d5ct2" (UID: "6a7d6a71-9978-4998-b703-176132d5c7ac") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:37.592453 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.592268    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 05:57:37.642025 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.641927    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T05:57:37.592447958Z","UUID":"e0a6286f-be78-4b0a-a118-490bf5931f75","Handler":null,"Name":"","Endpoint":""}
May 25 05:57:37.644051 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.644025    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 05:57:37.644051 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.644056    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 05:57:37.698882 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.698806    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:37.699074 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.698804    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:37.699074 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:37.698921    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:37.699074 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:37.699031    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:37.862458 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.862413    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5cffg" event={"ID":"bea83059-ff15-484c-a69d-b98f584285cc","Type":"ContainerStarted","Data":"dbb4f550b61e630657646e11da6f64b8d194289aab38d88ced9112b2f0d1e05a"}
May 25 05:57:37.864100 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.864073    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v" event={"ID":"428c9d01-c18d-4104-9039-b610d2d52a35","Type":"ContainerStarted","Data":"5ad500442f2406310cb15bab11675c02379b4e551ec671c8f8c2aed2a5ed997c"}
May 25 05:57:37.864931 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.864903    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:37.865336 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.865316    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mhq5"
May 25 05:57:37.879579 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:37.879537    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5cffg" podStartSLOduration=5.193206359 podStartE2EDuration="22.879522688s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.30295411 +0000 UTC m=+3.208722155" lastFinishedPulling="2026-05-25 05:57:35.989270455 +0000 UTC m=+20.895038484" observedRunningTime="2026-05-25 05:57:37.879034241 +0000 UTC m=+22.784802293" watchObservedRunningTime="2026-05-25 05:57:37.879522688 +0000 UTC m=+22.785290740"
May 25 05:57:38.698919 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:38.698885    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:38.699095 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:38.699003    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:39.698720 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:39.698679    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:39.698720 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:39.698695    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:39.699419 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:39.698815    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:39.699419 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:39.698940    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:39.869236 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:39.869200    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v" event={"ID":"428c9d01-c18d-4104-9039-b610d2d52a35","Type":"ContainerStarted","Data":"77ccb597b93a2ba454b7f752df57edbba209985e62815b59ff789d2d8fd1ccb2"}
May 25 05:57:39.872443 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:39.872425    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 05:57:39.872863 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:39.872833    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"d732258e9072b8375cf172cde754394eb396f7081ee9d261465bf7d3a92a806c"}
May 25 05:57:39.888542 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:39.888504    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wnl2v" podStartSLOduration=4.355420473 podStartE2EDuration="24.888493501s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.306165182 +0000 UTC m=+3.211933214" lastFinishedPulling="2026-05-25 05:57:38.839238206 +0000 UTC m=+23.745006242" observedRunningTime="2026-05-25 05:57:39.888156519 +0000 UTC m=+24.793924584" watchObservedRunningTime="2026-05-25 05:57:39.888493501 +0000 UTC m=+24.794261543"
May 25 05:57:40.698646 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:40.698619    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:40.698804 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:40.698745    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:41.263488 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.263253    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:41.263488 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:41.263390    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:41.263639 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:41.263509    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret podName:6a7d6a71-9978-4998-b703-176132d5c7ac nodeName:}" failed. No retries permitted until 2026-05-25 05:57:49.263494665 +0000 UTC m=+34.169262694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret") pod "global-pull-secret-syncer-d5ct2" (UID: "6a7d6a71-9978-4998-b703-176132d5c7ac") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:41.699212 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.699174    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:41.699669 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:41.699286    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:41.699669 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.699318    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:41.699669 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:41.699372    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:41.876833 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.876800    2556 generic.go:358] "Generic (PLEG): container finished" podID="438670a2-3747-433b-8387-78a11257ee45" containerID="557895cd4b72779790252816a273f255892b115a433aa27dd26073a42845ebd6" exitCode=0
May 25 05:57:41.876993 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.876871    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerDied","Data":"557895cd4b72779790252816a273f255892b115a433aa27dd26073a42845ebd6"}
May 25 05:57:41.879832 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.879817    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 05:57:41.880148 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.880126    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"39c75085c6347900eea9fb3d30712913a5b871370776a6cb8a962c1ddedcda21"}
May 25 05:57:41.880383 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.880362    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:41.880512 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.880486    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:41.880588 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.880567    2556 scope.go:117] "RemoveContainer" containerID="280f964fcbad5cc3f07b4eb8153707286a675e6d486b7b0618114a7d4f23f6e3"
May 25 05:57:41.897822 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:41.896809    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:42.698891 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.698863    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:42.699020 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:42.698999    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:42.883735 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.883506    2556 generic.go:358] "Generic (PLEG): container finished" podID="438670a2-3747-433b-8387-78a11257ee45" containerID="07d944d0d2f360cb6ce10541b2aae64be9791782ce22a016dde15a46979706eb" exitCode=0
May 25 05:57:42.883735 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.883591    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerDied","Data":"07d944d0d2f360cb6ce10541b2aae64be9791782ce22a016dde15a46979706eb"}
May 25 05:57:42.886925 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.886874    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 05:57:42.887266 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.887238    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" event={"ID":"3272da78-8f57-42ec-97a7-50317f36f542","Type":"ContainerStarted","Data":"36c1aba9f86fff644bcbba81510ab76b8981fe88e804992a5e211f87ab4c6ff7"}
May 25 05:57:42.887656 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.887635    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:42.902916 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.902899    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:57:42.926897 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.926851    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn" podStartSLOduration=10.223815087 podStartE2EDuration="27.92683935s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.301654601 +0000 UTC m=+3.207422632" lastFinishedPulling="2026-05-25 05:57:36.004678861 +0000 UTC m=+20.910446895" observedRunningTime="2026-05-25 05:57:42.92585067 +0000 UTC m=+27.831618720" watchObservedRunningTime="2026-05-25 05:57:42.92683935 +0000 UTC m=+27.832607400"
May 25 05:57:42.953538 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.953516    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcxw8"]
May 25 05:57:42.953654 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.953641    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:42.953784 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:42.953765    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:42.956436 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.956405    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q4tlp"]
May 25 05:57:42.956523 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.956516    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:42.956620 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:42.956598    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:42.957169 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.957149    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d5ct2"]
May 25 05:57:42.957240 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:42.957210    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:42.957312 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:42.957292    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:43.891093 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:43.891056    2556 generic.go:358] "Generic (PLEG): container finished" podID="438670a2-3747-433b-8387-78a11257ee45" containerID="1992f7c16daf3208ecdac8c25e51b7245c5bb2b0ed46f6b7c76371d6e5102464" exitCode=0
May 25 05:57:43.891615 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:43.891139    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerDied","Data":"1992f7c16daf3208ecdac8c25e51b7245c5bb2b0ed46f6b7c76371d6e5102464"}
May 25 05:57:44.699322 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:44.699292    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:44.699472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:44.699292    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:44.699472 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:44.699428    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:44.699593 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:44.699292    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:44.699593 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:44.699484    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:44.699593 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:44.699559    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:46.699327 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:46.699296    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:46.700089 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:46.699412    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:46.700089 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:46.699419    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:46.700089 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:46.699503    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:46.700089 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:46.699518    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:46.700089 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:46.699610    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:48.698687 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.698647    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:48.699103 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.698683    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:48.699103 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:48.698794    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d5ct2" podUID="6a7d6a71-9978-4998-b703-176132d5c7ac"
May 25 05:57:48.699103 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:48.698863    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tcxw8" podUID="cb9f7217-4ee1-4d73-a997-ee78a2570a46"
May 25 05:57:48.699103 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.698911    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:48.699103 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:48.698982    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q4tlp" podUID="f9a1ee32-5081-4d51-8ef9-383d9b9b39e8"
May 25 05:57:48.907403 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.907334    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-119.ec2.internal" event="NodeReady"
May 25 05:57:48.907541 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.907490    2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 05:57:48.942461 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.942434    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-584d59fd8-vl9f8"]
May 25 05:57:48.945084 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.945056    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:48.947577 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.947400    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rkkwr\""
May 25 05:57:48.948001 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.947741    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 05:57:48.948001 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.947850    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 05:57:48.948001 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.947905    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 05:57:48.952305 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.952285    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 05:57:48.954362 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.954338    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kcb49"]
May 25 05:57:48.956203 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.956173    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t7bbl"]
May 25 05:57:48.956493 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.956382    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcb49"
May 25 05:57:48.958037 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.958011    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584d59fd8-vl9f8"]
May 25 05:57:48.958142 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.958109    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:48.958374 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.958240    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 05:57:48.958374 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.958343    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjmkj\""
May 25 05:57:48.958510 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.958477    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 05:57:48.959691 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.959673    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 05:57:48.960143 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.960123    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 05:57:48.960529 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.960511    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g6njt\""
May 25 05:57:48.960612 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.960561    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 05:57:48.967180 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.967140    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kcb49"]
May 25 05:57:48.969386 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:48.969365    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7bbl"]
May 25 05:57:49.023160 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023134    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-image-registry-private-configuration\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023320 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023171    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-certificates\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023320 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023233    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-ca-trust-extracted\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023320 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023320 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-bound-sa-token\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023545 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023343    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdjs8\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-kube-api-access-hdjs8\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023545 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023399    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-trusted-ca\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.023545 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.023425    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-installation-pull-secrets\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.124633 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124598    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-config-volume\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.124633 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124643    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kbbb\" (UniqueName: \"kubernetes.io/projected/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-kube-api-access-4kbbb\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.124881 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124685    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-image-registry-private-configuration\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.124881 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124729    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-certificates\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.124881 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124779    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-ca-trust-extracted\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.124881 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckm4t\" (UniqueName: \"kubernetes.io/projected/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-kube-api-access-ckm4t\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:49.124881 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124836    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.124881 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124861    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-bound-sa-token\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.125120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124894    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdjs8\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-kube-api-access-hdjs8\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.125120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124931    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:49.125120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.125120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.124981    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-tmp-dir\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.125120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.125030    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-trusted-ca\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.125120 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.125054    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-installation-pull-secrets\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.125359 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.125229    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:49.125359 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.125244    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:57:49.125359 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.125285    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:57:49.625270848 +0000 UTC m=+34.531038877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:57:49.125753 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.125728    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-ca-trust-extracted\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.125962 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.125938    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-certificates\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.126528 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.126489    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-trusted-ca\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.130694 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.130672    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-installation-pull-secrets\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.130830 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.130727    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-image-registry-private-configuration\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.134212 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.134187    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-bound-sa-token\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.134321 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.134210    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdjs8\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-kube-api-access-hdjs8\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.226305 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226189    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckm4t\" (UniqueName: \"kubernetes.io/projected/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-kube-api-access-ckm4t\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:49.226305 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226269    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:49.226305 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226295    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226321    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-tmp-dir\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.226362    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226389    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-config-volume\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226413    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kbbb\" (UniqueName: \"kubernetes.io/projected/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-kube-api-access-4kbbb\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.226431    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:49.726413864 +0000 UTC m=+34.632181893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.226437    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:49.226538 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.226516    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:49.726497332 +0000 UTC m=+34.632265373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:57:49.226883 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.226766    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-tmp-dir\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.227028 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.227007    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-config-volume\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.235899 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.235873    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckm4t\" (UniqueName: \"kubernetes.io/projected/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-kube-api-access-ckm4t\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:49.237078 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.237049    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kbbb\" (UniqueName: \"kubernetes.io/projected/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-kube-api-access-4kbbb\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.327024 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.326983    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:49.327173 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.327132    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 05:57:49.327226 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.327207    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret podName:6a7d6a71-9978-4998-b703-176132d5c7ac nodeName:}" failed. No retries permitted until 2026-05-25 05:58:05.327188507 +0000 UTC m=+50.232956537 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret") pod "global-pull-secret-syncer-d5ct2" (UID: "6a7d6a71-9978-4998-b703-176132d5c7ac") : object "kube-system"/"original-pull-secret" not registered
May 25 05:57:49.428094 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.428060    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:49.428254 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.428125    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:49.428254 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.428229    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 05:57:49.428254 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.428254    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 05:57:49.428373 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.428260    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:49.428373 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.428266    2556 projected.go:194] Error preparing data for projected volume kube-api-access-xtdt8 for pod openshift-network-diagnostics/network-check-target-q4tlp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:49.428373 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.428319    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:58:21.428304168 +0000 UTC m=+66.334072197 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 05:57:49.428373 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.428334    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8 podName:f9a1ee32-5081-4d51-8ef9-383d9b9b39e8 nodeName:}" failed. No retries permitted until 2026-05-25 05:58:21.428327904 +0000 UTC m=+66.334095933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xtdt8" (UniqueName: "kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8") pod "network-check-target-q4tlp" (UID: "f9a1ee32-5081-4d51-8ef9-383d9b9b39e8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 05:57:49.630063 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.630022    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:49.630247 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.630198    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:49.630247 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.630222    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:57:49.630341 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.630293    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:57:50.630270966 +0000 UTC m=+35.536038999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:57:49.730658 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.730614    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:49.730658 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:49.730660    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:49.731160 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.730791    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:49.731160 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.730820    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:49.731160 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.730865    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:50.730845802 +0000 UTC m=+35.636613846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:57:49.731160 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:49.730886    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:50.730875967 +0000 UTC m=+35.636643999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:57:50.145607 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.145578    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"]
May 25 05:57:50.161373 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.161348    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"]
May 25 05:57:50.161514 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.161462    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.163678 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.163458    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 25 05:57:50.163678 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.163464    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 25 05:57:50.163678 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.163576    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-cr92v\""
May 25 05:57:50.163678 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.163590    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 25 05:57:50.164024 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.163884    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 25 05:57:50.335875 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.335849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcs88\" (UniqueName: \"kubernetes.io/projected/452e8625-4f6b-49f8-b35a-37eef39d784e-kube-api-access-vcs88\") pod \"managed-serviceaccount-addon-agent-597bc774f8-wxhjq\" (UID: \"452e8625-4f6b-49f8-b35a-37eef39d784e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.335993 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.335972    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/452e8625-4f6b-49f8-b35a-37eef39d784e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597bc774f8-wxhjq\" (UID: \"452e8625-4f6b-49f8-b35a-37eef39d784e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.437233 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.437205    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vcs88\" (UniqueName: \"kubernetes.io/projected/452e8625-4f6b-49f8-b35a-37eef39d784e-kube-api-access-vcs88\") pod \"managed-serviceaccount-addon-agent-597bc774f8-wxhjq\" (UID: \"452e8625-4f6b-49f8-b35a-37eef39d784e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.437375 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.437362    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/452e8625-4f6b-49f8-b35a-37eef39d784e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597bc774f8-wxhjq\" (UID: \"452e8625-4f6b-49f8-b35a-37eef39d784e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.440211 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.440182    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/452e8625-4f6b-49f8-b35a-37eef39d784e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-597bc774f8-wxhjq\" (UID: \"452e8625-4f6b-49f8-b35a-37eef39d784e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.445268 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.445248    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcs88\" (UniqueName: \"kubernetes.io/projected/452e8625-4f6b-49f8-b35a-37eef39d784e-kube-api-access-vcs88\") pod \"managed-serviceaccount-addon-agent-597bc774f8-wxhjq\" (UID: \"452e8625-4f6b-49f8-b35a-37eef39d784e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.484685 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.484662    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"
May 25 05:57:50.638932 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.638898    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:50.639061 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.639039    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:50.639061 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.639057    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:57:50.639154 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.639112    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:57:52.639093463 +0000 UTC m=+37.544861493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:57:50.657888 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.657858    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq"]
May 25 05:57:50.661953 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:57:50.661928    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod452e8625_4f6b_49f8_b35a_37eef39d784e.slice/crio-2a529c687b530a52c7afc1534208c471c075535aa414c9ba40b79a5730b6a461 WatchSource:0}: Error finding container 2a529c687b530a52c7afc1534208c471c075535aa414c9ba40b79a5730b6a461: Status 404 returned error can't find the container with id 2a529c687b530a52c7afc1534208c471c075535aa414c9ba40b79a5730b6a461
May 25 05:57:50.698852 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.698817    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:57:50.698852 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.698848    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:57:50.699042 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.699025    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:57:50.701049 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.701028    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kfc7\""
May 25 05:57:50.701152 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.701031    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5pvm\""
May 25 05:57:50.701152 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.701053    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 05:57:50.701814 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.701671    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 05:57:50.701814 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.701685    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 05:57:50.703079 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.702957    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 05:57:50.739976 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.739953    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:50.740254 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.739978    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:50.740254 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.740078    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:50.740254 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.740079    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:50.740254 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.740138    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:52.7401213 +0000 UTC m=+37.645889330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:57:50.740254 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:50.740151    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:52.740145483 +0000 UTC m=+37.645913512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:57:50.904919 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.904871    2556 generic.go:358] "Generic (PLEG): container finished" podID="438670a2-3747-433b-8387-78a11257ee45" containerID="f871ca7b851395e36c2e83f11d92cf7038726e678a898b242d7e03fa920fe7e3" exitCode=0
May 25 05:57:50.905075 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.904949    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerDied","Data":"f871ca7b851395e36c2e83f11d92cf7038726e678a898b242d7e03fa920fe7e3"}
May 25 05:57:50.905955 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:50.905933    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq" event={"ID":"452e8625-4f6b-49f8-b35a-37eef39d784e","Type":"ContainerStarted","Data":"2a529c687b530a52c7afc1534208c471c075535aa414c9ba40b79a5730b6a461"}
May 25 05:57:51.913008 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:51.912642    2556 generic.go:358] "Generic (PLEG): container finished" podID="438670a2-3747-433b-8387-78a11257ee45" containerID="ccacb80de7c597a6cd21a40b651a5c21c65d2b73925a97d6daf3601b3be102a3" exitCode=0
May 25 05:57:51.913008 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:51.912750    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerDied","Data":"ccacb80de7c597a6cd21a40b651a5c21c65d2b73925a97d6daf3601b3be102a3"}
May 25 05:57:52.658510 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:52.658470    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:52.658689 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.658638    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:52.658689 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.658659    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:57:52.658825 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.658739    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:57:56.658718185 +0000 UTC m=+41.564486228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:57:52.759839 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:52.759763    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:52.759839 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:52.759796    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:52.760020 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.759933    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:52.760020 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.760011    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:56.759989688 +0000 UTC m=+41.665757721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:57:52.760122 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.759935    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:52.760122 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:52.760085    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:57:56.760070255 +0000 UTC m=+41.665838295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:57:52.918368 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:52.918334    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" event={"ID":"438670a2-3747-433b-8387-78a11257ee45","Type":"ContainerStarted","Data":"e06c370910a4f8a70d4836d452c911bd2c4242d886d4628d5fc5380f7ecb5e37"}
May 25 05:57:52.947224 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:52.945433    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4cc5d" podStartSLOduration=6.073767205 podStartE2EDuration="37.945414037s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:57:18.307995885 +0000 UTC m=+3.213763914" lastFinishedPulling="2026-05-25 05:57:50.179642714 +0000 UTC m=+35.085410746" observedRunningTime="2026-05-25 05:57:52.942439878 +0000 UTC m=+37.848207929" watchObservedRunningTime="2026-05-25 05:57:52.945414037 +0000 UTC m=+37.851182091"
May 25 05:57:54.923014 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:54.922972    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq" event={"ID":"452e8625-4f6b-49f8-b35a-37eef39d784e","Type":"ContainerStarted","Data":"7846f87372f958c25178782ff1ec5329dbd528b87f1e46983a42b6261b924fda"}
May 25 05:57:54.950364 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:54.950322    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-597bc774f8-wxhjq" podStartSLOduration=1.810689543 podStartE2EDuration="4.950308944s" podCreationTimestamp="2026-05-25 05:57:50 +0000 UTC" firstStartedPulling="2026-05-25 05:57:50.663805097 +0000 UTC m=+35.569573130" lastFinishedPulling="2026-05-25 05:57:53.803424502 +0000 UTC m=+38.709192531" observedRunningTime="2026-05-25 05:57:54.949801594 +0000 UTC m=+39.855569644" watchObservedRunningTime="2026-05-25 05:57:54.950308944 +0000 UTC m=+39.856076995"
May 25 05:57:56.687781 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:56.687735    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:57:56.688128 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.687878    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:57:56.688128 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.687896    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:57:56.688128 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.687952    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:58:04.687937357 +0000 UTC m=+49.593705387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:57:56.788463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:56.788424    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:57:56.788570 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:57:56.788466    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:57:56.788570 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.788565    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:57:56.788630 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.788567    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:57:56.788630 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.788610    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:58:04.788598051 +0000 UTC m=+49.694366080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:57:56.788630 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:57:56.788623    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:58:04.788617351 +0000 UTC m=+49.694385379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:58:04.746873 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:04.746831    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:58:04.747404 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.747036    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:58:04.747404 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.747062    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:58:04.747404 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.747140    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:58:20.747117714 +0000 UTC m=+65.652885758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:58:04.847472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:04.847437    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:58:04.847472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:04.847473    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:58:04.847653 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.847597    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:58:04.847653 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.847615    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:58:04.847753 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.847659    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:58:20.847644476 +0000 UTC m=+65.753412505 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:58:04.847753 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:04.847671    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:58:20.847665651 +0000 UTC m=+65.753433680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:58:05.351764 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:05.351727    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:58:05.355118 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:05.355095    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7d6a71-9978-4998-b703-176132d5c7ac-original-pull-secret\") pod \"global-pull-secret-syncer-d5ct2\" (UID: \"6a7d6a71-9978-4998-b703-176132d5c7ac\") " pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:58:05.421313 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:05.421285    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d5ct2"
May 25 05:58:05.550879 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:05.550845    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d5ct2"]
May 25 05:58:05.554295 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:58:05.554248    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7d6a71_9978_4998_b703_176132d5c7ac.slice/crio-0ae0c364bf43c06bfe80eedce5e860433a1f251f808b5cc6f40c9690d5ec66a7 WatchSource:0}: Error finding container 0ae0c364bf43c06bfe80eedce5e860433a1f251f808b5cc6f40c9690d5ec66a7: Status 404 returned error can't find the container with id 0ae0c364bf43c06bfe80eedce5e860433a1f251f808b5cc6f40c9690d5ec66a7
May 25 05:58:05.945488 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:05.945453    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d5ct2" event={"ID":"6a7d6a71-9978-4998-b703-176132d5c7ac","Type":"ContainerStarted","Data":"0ae0c364bf43c06bfe80eedce5e860433a1f251f808b5cc6f40c9690d5ec66a7"}
May 25 05:58:09.954930 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:09.954891    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d5ct2" event={"ID":"6a7d6a71-9978-4998-b703-176132d5c7ac","Type":"ContainerStarted","Data":"5c2fc0b910c38a7d3656e970edf56a851a80ac20947fe53227841a31f5f715ce"}
May 25 05:58:09.971249 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:09.971191    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d5ct2" podStartSLOduration=32.976007498 podStartE2EDuration="36.971178715s" podCreationTimestamp="2026-05-25 05:57:33 +0000 UTC" firstStartedPulling="2026-05-25 05:58:05.555975208 +0000 UTC m=+50.461743241" lastFinishedPulling="2026-05-25 05:58:09.551146426 +0000 UTC m=+54.456914458" observedRunningTime="2026-05-25 05:58:09.970155313 +0000 UTC m=+54.875923378" watchObservedRunningTime="2026-05-25 05:58:09.971178715 +0000 UTC m=+54.876946767"
May 25 05:58:14.903252 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:14.903226    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pk6gn"
May 25 05:58:20.751891 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:20.751855    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:58:20.752251 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.752005    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:58:20.752251 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.752025    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:58:20.752251 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.752082    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:58:52.752065597 +0000 UTC m=+97.657833627 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:58:20.852940 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:20.852910    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:58:20.853024 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:20.852945    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:58:20.853077 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.853059    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:58:20.853140 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.853130    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:58:52.853115663 +0000 UTC m=+97.758883697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:58:20.853189 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.853066    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:58:20.853189 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:20.853176    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:58:52.853167146 +0000 UTC m=+97.758935184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:58:21.458194 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.458153    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:58:21.458369 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.458296    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:58:21.460423 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.460405    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 05:58:21.460503 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.460448    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 05:58:21.468835 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:21.468811    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 05:58:21.468929 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:21.468886    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs podName:cb9f7217-4ee1-4d73-a997-ee78a2570a46 nodeName:}" failed. No retries permitted until 2026-05-25 05:59:25.46886739 +0000 UTC m=+130.374635420 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs") pod "network-metrics-daemon-tcxw8" (UID: "cb9f7217-4ee1-4d73-a997-ee78a2570a46") : secret "metrics-daemon-secret" not found
May 25 05:58:21.470303 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.470285    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 05:58:21.481373 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.481347    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtdt8\" (UniqueName: \"kubernetes.io/projected/f9a1ee32-5081-4d51-8ef9-383d9b9b39e8-kube-api-access-xtdt8\") pod \"network-check-target-q4tlp\" (UID: \"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8\") " pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:58:21.613464 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.613428    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5pvm\""
May 25 05:58:21.622117 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.622099    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:58:21.740607 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.740539    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q4tlp"]
May 25 05:58:21.744008 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:58:21.743982    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a1ee32_5081_4d51_8ef9_383d9b9b39e8.slice/crio-01e8c3532868d33f2960850d297c716a65678573712b0bcf6778bd3acc0aaa9e WatchSource:0}: Error finding container 01e8c3532868d33f2960850d297c716a65678573712b0bcf6778bd3acc0aaa9e: Status 404 returned error can't find the container with id 01e8c3532868d33f2960850d297c716a65678573712b0bcf6778bd3acc0aaa9e
May 25 05:58:21.978211 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:21.978176    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q4tlp" event={"ID":"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8","Type":"ContainerStarted","Data":"01e8c3532868d33f2960850d297c716a65678573712b0bcf6778bd3acc0aaa9e"}
May 25 05:58:24.986051 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:24.986017    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q4tlp" event={"ID":"f9a1ee32-5081-4d51-8ef9-383d9b9b39e8","Type":"ContainerStarted","Data":"b099532f3c24932358ff7e1743f0da390ff0774d798e57d11145f297a6f8a987"}
May 25 05:58:24.986379 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:24.986172    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:58:25.000958 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:25.000903    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q4tlp" podStartSLOduration=67.306720402 podStartE2EDuration="1m10.000889964s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:58:21.74570086 +0000 UTC m=+66.651468889" lastFinishedPulling="2026-05-25 05:58:24.439870423 +0000 UTC m=+69.345638451" observedRunningTime="2026-05-25 05:58:24.999764544 +0000 UTC m=+69.905532594" watchObservedRunningTime="2026-05-25 05:58:25.000889964 +0000 UTC m=+69.906658044"
May 25 05:58:49.552999 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:49.552889    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ls4sm_e19a06ea-d401-4ebf-8145-7f362b31ee97/dns-node-resolver/0.log"
May 25 05:58:50.352980 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:50.352953    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2j2ks_ce1aa8a8-bacb-420d-af6b-e3335f2b4866/node-ca/0.log"
May 25 05:58:52.780400 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:52.780312    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") pod \"image-registry-584d59fd8-vl9f8\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") " pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:58:52.780760 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.780457    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 25 05:58:52.780760 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.780476    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584d59fd8-vl9f8: secret "image-registry-tls" not found
May 25 05:58:52.780760 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.780535    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls podName:ff3b9c11-38eb-4a96-a189-b75f83cf7a0b nodeName:}" failed. No retries permitted until 2026-05-25 05:59:56.780518248 +0000 UTC m=+161.686286277 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls") pod "image-registry-584d59fd8-vl9f8" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b") : secret "image-registry-tls" not found
May 25 05:58:52.881653 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:52.881605    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:58:52.881653 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:52.881654    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:58:52.881842 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.881766    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 05:58:52.881842 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.881768    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 05:58:52.881842 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.881824    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls podName:f7e08bd3-fbfa-4ff7-860a-ef6b8637188f nodeName:}" failed. No retries permitted until 2026-05-25 05:59:56.881809635 +0000 UTC m=+161.787577664 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls") pod "dns-default-kcb49" (UID: "f7e08bd3-fbfa-4ff7-860a-ef6b8637188f") : secret "dns-default-metrics-tls" not found
May 25 05:58:52.881842 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:52.881837    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert podName:f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f nodeName:}" failed. No retries permitted until 2026-05-25 05:59:56.881831322 +0000 UTC m=+161.787599350 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert") pod "ingress-canary-t7bbl" (UID: "f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f") : secret "canary-serving-cert" not found
May 25 05:58:54.146759 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.146726    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"]
May 25 05:58:54.149098 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.149083    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"
May 25 05:58:54.150915 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.150880    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nbdzr\""
May 25 05:58:54.151021 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.151001    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 25 05:58:54.151253 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.151236    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 25 05:58:54.152471 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.152452    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"]
May 25 05:58:54.155751 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.155732    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.157663 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.157647    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 25 05:58:54.157768 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.157675    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 25 05:58:54.157816 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.157767    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 25 05:58:54.157854 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.157823    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 25 05:58:54.157854 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.157832    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-flk6d\""
May 25 05:58:54.159129 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.159109    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"]
May 25 05:58:54.165505 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.165488    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"]
May 25 05:58:54.190173 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.190147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9znnb\" (UniqueName: \"kubernetes.io/projected/27e030e6-eaed-4775-851d-e3e326593e8b-kube-api-access-9znnb\") pod \"volume-data-source-validator-5cf8c89d64-mgh9j\" (UID: \"27e030e6-eaed-4775-851d-e3e326593e8b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"
May 25 05:58:54.251185 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.251163    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-lm7hc"]
May 25 05:58:54.252774 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.252760    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.254499 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.254459    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 25 05:58:54.254693 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.254645    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 25 05:58:54.254811 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.254794    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7rf57\""
May 25 05:58:54.254862 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.254817    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 25 05:58:54.254862 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.254846    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 25 05:58:54.260449 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.260429    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 25 05:58:54.263458 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.263440    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-lm7hc"]
May 25 05:58:54.290861 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e833df1-55eb-489d-9489-6bae2662c9bf-trusted-ca\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.290946 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290889    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9zq\" (UniqueName: \"kubernetes.io/projected/fb464081-c56d-4e6e-be54-928b37f50e7d-kube-api-access-zx9zq\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.290946 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290909    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e833df1-55eb-489d-9489-6bae2662c9bf-config\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.291055 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e833df1-55eb-489d-9489-6bae2662c9bf-serving-cert\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.291055 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l4rj\" (UniqueName: \"kubernetes.io/projected/6e833df1-55eb-489d-9489-6bae2662c9bf-kube-api-access-6l4rj\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.291055 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290980    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9znnb\" (UniqueName: \"kubernetes.io/projected/27e030e6-eaed-4775-851d-e3e326593e8b-kube-api-access-9znnb\") pod \"volume-data-source-validator-5cf8c89d64-mgh9j\" (UID: \"27e030e6-eaed-4775-851d-e3e326593e8b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"
May 25 05:58:54.291055 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.290997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb464081-c56d-4e6e-be54-928b37f50e7d-config\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.291241 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.291068    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb464081-c56d-4e6e-be54-928b37f50e7d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.298077 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.298053    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9znnb\" (UniqueName: \"kubernetes.io/projected/27e030e6-eaed-4775-851d-e3e326593e8b-kube-api-access-9znnb\") pod \"volume-data-source-validator-5cf8c89d64-mgh9j\" (UID: \"27e030e6-eaed-4775-851d-e3e326593e8b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"
May 25 05:58:54.391642 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391610    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e833df1-55eb-489d-9489-6bae2662c9bf-config\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.391789 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391650    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e833df1-55eb-489d-9489-6bae2662c9bf-serving-cert\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.391789 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391675    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6l4rj\" (UniqueName: \"kubernetes.io/projected/6e833df1-55eb-489d-9489-6bae2662c9bf-kube-api-access-6l4rj\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.391789 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391729    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb464081-c56d-4e6e-be54-928b37f50e7d-config\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.391789 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391773    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb464081-c56d-4e6e-be54-928b37f50e7d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.392005 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391826    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e833df1-55eb-489d-9489-6bae2662c9bf-trusted-ca\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.392005 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.391894    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9zq\" (UniqueName: \"kubernetes.io/projected/fb464081-c56d-4e6e-be54-928b37f50e7d-kube-api-access-zx9zq\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.392308 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.392281    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb464081-c56d-4e6e-be54-928b37f50e7d-config\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.392429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.392404    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e833df1-55eb-489d-9489-6bae2662c9bf-config\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.393027 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.393010    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e833df1-55eb-489d-9489-6bae2662c9bf-trusted-ca\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.393949 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.393931    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb464081-c56d-4e6e-be54-928b37f50e7d-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.394013 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.393933    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e833df1-55eb-489d-9489-6bae2662c9bf-serving-cert\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.399241 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.399175    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l4rj\" (UniqueName: \"kubernetes.io/projected/6e833df1-55eb-489d-9489-6bae2662c9bf-kube-api-access-6l4rj\") pod \"console-operator-76dff48d59-lm7hc\" (UID: \"6e833df1-55eb-489d-9489-6bae2662c9bf\") " pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.399332 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.399287    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9zq\" (UniqueName: \"kubernetes.io/projected/fb464081-c56d-4e6e-be54-928b37f50e7d-kube-api-access-zx9zq\") pod \"kube-storage-version-migrator-operator-565644f49-npqqf\" (UID: \"fb464081-c56d-4e6e-be54-928b37f50e7d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.458636 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.458609    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"
May 25 05:58:54.465255 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.465238    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"
May 25 05:58:54.562302 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.562268    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:58:54.597078 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.596079    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j"]
May 25 05:58:54.603755 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.603731    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf"]
May 25 05:58:54.604340 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:58:54.604315    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27e030e6_eaed_4775_851d_e3e326593e8b.slice/crio-9a00a0cda4dfdd4d2b910387265037db5240d8009afd005b84f1ad3d40d2a0fa WatchSource:0}: Error finding container 9a00a0cda4dfdd4d2b910387265037db5240d8009afd005b84f1ad3d40d2a0fa: Status 404 returned error can't find the container with id 9a00a0cda4dfdd4d2b910387265037db5240d8009afd005b84f1ad3d40d2a0fa
May 25 05:58:54.607733 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:58:54.607689    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb464081_c56d_4e6e_be54_928b37f50e7d.slice/crio-4dce131f09193f4b32d5b540c2371ac2deb959e03dee9269c404c4bf233628bf WatchSource:0}: Error finding container 4dce131f09193f4b32d5b540c2371ac2deb959e03dee9269c404c4bf233628bf: Status 404 returned error can't find the container with id 4dce131f09193f4b32d5b540c2371ac2deb959e03dee9269c404c4bf233628bf
May 25 05:58:54.695445 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:54.695414    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-lm7hc"]
May 25 05:58:54.698484 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:58:54.698460    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e833df1_55eb_489d_9489_6bae2662c9bf.slice/crio-0cbe94789a824ceacef5ea11663d77da5ac3c80cbe78b765623b296617eb9ffc WatchSource:0}: Error finding container 0cbe94789a824ceacef5ea11663d77da5ac3c80cbe78b765623b296617eb9ffc: Status 404 returned error can't find the container with id 0cbe94789a824ceacef5ea11663d77da5ac3c80cbe78b765623b296617eb9ffc
May 25 05:58:55.044273 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:55.044189    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf" event={"ID":"fb464081-c56d-4e6e-be54-928b37f50e7d","Type":"ContainerStarted","Data":"4dce131f09193f4b32d5b540c2371ac2deb959e03dee9269c404c4bf233628bf"}
May 25 05:58:55.045076 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:55.045043    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j" event={"ID":"27e030e6-eaed-4775-851d-e3e326593e8b","Type":"ContainerStarted","Data":"9a00a0cda4dfdd4d2b910387265037db5240d8009afd005b84f1ad3d40d2a0fa"}
May 25 05:58:55.045913 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:55.045893    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" event={"ID":"6e833df1-55eb-489d-9489-6bae2662c9bf","Type":"ContainerStarted","Data":"0cbe94789a824ceacef5ea11663d77da5ac3c80cbe78b765623b296617eb9ffc"}
May 25 05:58:55.991309 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:55.991276    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q4tlp"
May 25 05:58:58.059928 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.059887    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf" event={"ID":"fb464081-c56d-4e6e-be54-928b37f50e7d","Type":"ContainerStarted","Data":"241f3df0174dc1cf52ee27e21e0dd45966e77361641847f9398855b84dbd97fa"}
May 25 05:58:58.061216 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.061189    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j" event={"ID":"27e030e6-eaed-4775-851d-e3e326593e8b","Type":"ContainerStarted","Data":"37ba8dd031f0be70d091ecc965e61b580e175c2217d120e8b317578932ea0d5f"}
May 25 05:58:58.062582 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.062565    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/0.log"
May 25 05:58:58.062686 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.062597    2556 generic.go:358] "Generic (PLEG): container finished" podID="6e833df1-55eb-489d-9489-6bae2662c9bf" containerID="97b9f7a9a62c2d543623dfbbf86dd79e96010ea09f6567bd1d920d5b3dd73ce4" exitCode=255
May 25 05:58:58.062686 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.062631    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" event={"ID":"6e833df1-55eb-489d-9489-6bae2662c9bf","Type":"ContainerDied","Data":"97b9f7a9a62c2d543623dfbbf86dd79e96010ea09f6567bd1d920d5b3dd73ce4"}
May 25 05:58:58.062894 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.062876    2556 scope.go:117] "RemoveContainer" containerID="97b9f7a9a62c2d543623dfbbf86dd79e96010ea09f6567bd1d920d5b3dd73ce4"
May 25 05:58:58.083094 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.083055    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf" podStartSLOduration=1.465352388 podStartE2EDuration="4.083043525s" podCreationTimestamp="2026-05-25 05:58:54 +0000 UTC" firstStartedPulling="2026-05-25 05:58:54.609665134 +0000 UTC m=+99.515433166" lastFinishedPulling="2026-05-25 05:58:57.227356275 +0000 UTC m=+102.133124303" observedRunningTime="2026-05-25 05:58:58.081905374 +0000 UTC m=+102.987673426" watchObservedRunningTime="2026-05-25 05:58:58.083043525 +0000 UTC m=+102.988811576"
May 25 05:58:58.112599 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:58.112552    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-mgh9j" podStartSLOduration=1.496344682 podStartE2EDuration="4.112540818s" podCreationTimestamp="2026-05-25 05:58:54 +0000 UTC" firstStartedPulling="2026-05-25 05:58:54.606017526 +0000 UTC m=+99.511785556" lastFinishedPulling="2026-05-25 05:58:57.22221366 +0000 UTC m=+102.127981692" observedRunningTime="2026-05-25 05:58:58.096026993 +0000 UTC m=+103.001795045" watchObservedRunningTime="2026-05-25 05:58:58.112540818 +0000 UTC m=+103.018308869"
May 25 05:58:59.066990 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:59.066962    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 05:58:59.067443 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:59.067329    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/0.log"
May 25 05:58:59.067443 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:59.067374    2556 generic.go:358] "Generic (PLEG): container finished" podID="6e833df1-55eb-489d-9489-6bae2662c9bf" containerID="9a480dcffa35353989d869068d726c2cdf6be50ac8075593c392da1e99a567c0" exitCode=255
May 25 05:58:59.067551 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:59.067459    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" event={"ID":"6e833df1-55eb-489d-9489-6bae2662c9bf","Type":"ContainerDied","Data":"9a480dcffa35353989d869068d726c2cdf6be50ac8075593c392da1e99a567c0"}
May 25 05:58:59.067551 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:59.067498    2556 scope.go:117] "RemoveContainer" containerID="97b9f7a9a62c2d543623dfbbf86dd79e96010ea09f6567bd1d920d5b3dd73ce4"
May 25 05:58:59.067755 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:58:59.067736    2556 scope.go:117] "RemoveContainer" containerID="9a480dcffa35353989d869068d726c2cdf6be50ac8075593c392da1e99a567c0"
May 25 05:58:59.067993 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:58:59.067971    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-lm7hc_openshift-console-operator(6e833df1-55eb-489d-9489-6bae2662c9bf)\"" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" podUID="6e833df1-55eb-489d-9489-6bae2662c9bf"
May 25 05:59:00.071156 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:00.071133    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 05:59:00.071511 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:00.071434    2556 scope.go:117] "RemoveContainer" containerID="9a480dcffa35353989d869068d726c2cdf6be50ac8075593c392da1e99a567c0"
May 25 05:59:00.071598 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:00.071580    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-lm7hc_openshift-console-operator(6e833df1-55eb-489d-9489-6bae2662c9bf)\"" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" podUID="6e833df1-55eb-489d-9489-6bae2662c9bf"
May 25 05:59:04.562589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:04.562552    2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:59:04.562589 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:04.562592    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:59:04.563123 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:04.563063    2556 scope.go:117] "RemoveContainer" containerID="9a480dcffa35353989d869068d726c2cdf6be50ac8075593c392da1e99a567c0"
May 25 05:59:04.563263 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:04.563244    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-lm7hc_openshift-console-operator(6e833df1-55eb-489d-9489-6bae2662c9bf)\"" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" podUID="6e833df1-55eb-489d-9489-6bae2662c9bf"
May 25 05:59:19.610766 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.610733    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"]
May 25 05:59:19.613681 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.613660    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.615607 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.615559    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 25 05:59:19.616159 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.616137    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f5qs8\""
May 25 05:59:19.616258 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.616143    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 25 05:59:19.624651 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.624632    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"]
May 25 05:59:19.649371 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.649348    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584d59fd8-vl9f8"]
May 25 05:59:19.649518 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:19.649500    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-584d59fd8-vl9f8" podUID="ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"
May 25 05:59:19.698918 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.698900    2556 scope.go:117] "RemoveContainer" containerID="9a480dcffa35353989d869068d726c2cdf6be50ac8075593c392da1e99a567c0"
May 25 05:59:19.717909 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.717887    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"]
May 25 05:59:19.722131 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.722114    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f95589667-d8wdc"]
May 25 05:59:19.722278 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.722262    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"
May 25 05:59:19.724954 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.724930    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zcxj8"]
May 25 05:59:19.725183 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.725043    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ltng5\""
May 25 05:59:19.725183 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.725065    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.727737 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.727687    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"]
May 25 05:59:19.727845 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.727799    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.731314 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.731230    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 05:59:19.731550 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.731486    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w8pjf\""
May 25 05:59:19.731813 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.731737    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 05:59:19.732200 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.732009    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 05:59:19.732200 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.732009    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 05:59:19.734343 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.734328    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:19.736538 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.736515    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k46l8\""
May 25 05:59:19.736943 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.736922    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 25 05:59:19.737596 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.737580    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"]
May 25 05:59:19.738390 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.738374    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"]
May 25 05:59:19.739147 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.739126    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zcxj8"]
May 25 05:59:19.744289 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.744265    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f95589667-d8wdc"]
May 25 05:59:19.773098 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.773076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8870eb81-f20a-4a7c-a86b-109ebbbb80e1-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-t5nmh\" (UID: \"8870eb81-f20a-4a7c-a86b-109ebbbb80e1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.773193 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.773171    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8870eb81-f20a-4a7c-a86b-109ebbbb80e1-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t5nmh\" (UID: \"8870eb81-f20a-4a7c-a86b-109ebbbb80e1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.874193 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874119    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtgn\" (UniqueName: \"kubernetes.io/projected/9d310832-0ca4-4967-b189-d289f27d4d88-kube-api-access-rjtgn\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.874193 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d310832-0ca4-4967-b189-d289f27d4d88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874222    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d310832-0ca4-4967-b189-d289f27d4d88-data-volume\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw2kg\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-kube-api-access-dw2kg\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874262    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqj4\" (UniqueName: \"kubernetes.io/projected/0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7-kube-api-access-ttqj4\") pod \"network-check-source-7f44b6dd87-kv55l\" (UID: \"0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874278    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-registry-tls\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874295    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/971bb522-68df-46e4-bc1c-6f99171e49c6-trusted-ca\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/971bb522-68df-46e4-bc1c-6f99171e49c6-image-registry-private-configuration\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874402    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8870eb81-f20a-4a7c-a86b-109ebbbb80e1-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t5nmh\" (UID: \"8870eb81-f20a-4a7c-a86b-109ebbbb80e1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.874441 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874432    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8870eb81-f20a-4a7c-a86b-109ebbbb80e1-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-t5nmh\" (UID: \"8870eb81-f20a-4a7c-a86b-109ebbbb80e1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874449    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d310832-0ca4-4967-b189-d289f27d4d88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09152d19-e7ae-4779-ad6a-4186b1118941-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4886j\" (UID: \"09152d19-e7ae-4779-ad6a-4186b1118941\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d310832-0ca4-4967-b189-d289f27d4d88-crio-socket\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874561    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-bound-sa-token\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874589    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/971bb522-68df-46e4-bc1c-6f99171e49c6-ca-trust-extracted\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874603    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/971bb522-68df-46e4-bc1c-6f99171e49c6-registry-certificates\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.874892 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.874620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/971bb522-68df-46e4-bc1c-6f99171e49c6-installation-pull-secrets\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.875228 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.875101    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8870eb81-f20a-4a7c-a86b-109ebbbb80e1-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-t5nmh\" (UID: \"8870eb81-f20a-4a7c-a86b-109ebbbb80e1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.876728 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.876685    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8870eb81-f20a-4a7c-a86b-109ebbbb80e1-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t5nmh\" (UID: \"8870eb81-f20a-4a7c-a86b-109ebbbb80e1\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.923246 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.923226    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"
May 25 05:59:19.975922 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.975857    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-bound-sa-token\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976047 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.975935    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/971bb522-68df-46e4-bc1c-6f99171e49c6-ca-trust-extracted\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976411 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976386    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/971bb522-68df-46e4-bc1c-6f99171e49c6-registry-certificates\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976508 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976430    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/971bb522-68df-46e4-bc1c-6f99171e49c6-installation-pull-secrets\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976508 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976465    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtgn\" (UniqueName: \"kubernetes.io/projected/9d310832-0ca4-4967-b189-d289f27d4d88-kube-api-access-rjtgn\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976509    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d310832-0ca4-4967-b189-d289f27d4d88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976563    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d310832-0ca4-4967-b189-d289f27d4d88-data-volume\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976601    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw2kg\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-kube-api-access-dw2kg\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976625    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqj4\" (UniqueName: \"kubernetes.io/projected/0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7-kube-api-access-ttqj4\") pod \"network-check-source-7f44b6dd87-kv55l\" (UID: \"0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976653    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-registry-tls\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976681    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/971bb522-68df-46e4-bc1c-6f99171e49c6-trusted-ca\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976751    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/971bb522-68df-46e4-bc1c-6f99171e49c6-image-registry-private-configuration\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976796    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d310832-0ca4-4967-b189-d289f27d4d88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976821    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09152d19-e7ae-4779-ad6a-4186b1118941-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4886j\" (UID: \"09152d19-e7ae-4779-ad6a-4186b1118941\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:19.976926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976858    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d310832-0ca4-4967-b189-d289f27d4d88-crio-socket\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.977429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976961    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9d310832-0ca4-4967-b189-d289f27d4d88-crio-socket\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.977429 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.976321    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/971bb522-68df-46e4-bc1c-6f99171e49c6-ca-trust-extracted\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.978573 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.978151    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/971bb522-68df-46e4-bc1c-6f99171e49c6-registry-certificates\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.978573 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.978238    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d310832-0ca4-4967-b189-d289f27d4d88-data-volume\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.978573 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.978336    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9d310832-0ca4-4967-b189-d289f27d4d88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.979687 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.979659    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/971bb522-68df-46e4-bc1c-6f99171e49c6-trusted-ca\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.984966 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.981691    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/971bb522-68df-46e4-bc1c-6f99171e49c6-installation-pull-secrets\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.984966 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.982203    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09152d19-e7ae-4779-ad6a-4186b1118941-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-4886j\" (UID: \"09152d19-e7ae-4779-ad6a-4186b1118941\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:19.985483 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.985440    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/971bb522-68df-46e4-bc1c-6f99171e49c6-image-registry-private-configuration\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.985759 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.985742    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9d310832-0ca4-4967-b189-d289f27d4d88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.986177 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.986108    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-bound-sa-token\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.986177 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.986113    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-registry-tls\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:19.988166 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.988143    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqj4\" (UniqueName: \"kubernetes.io/projected/0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7-kube-api-access-ttqj4\") pod \"network-check-source-7f44b6dd87-kv55l\" (UID: \"0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"
May 25 05:59:19.988790 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.988387    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtgn\" (UniqueName: \"kubernetes.io/projected/9d310832-0ca4-4967-b189-d289f27d4d88-kube-api-access-rjtgn\") pod \"insights-runtime-extractor-zcxj8\" (UID: \"9d310832-0ca4-4967-b189-d289f27d4d88\") " pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:19.988980 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:19.988960    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw2kg\" (UniqueName: \"kubernetes.io/projected/971bb522-68df-46e4-bc1c-6f99171e49c6-kube-api-access-dw2kg\") pod \"image-registry-7f95589667-d8wdc\" (UID: \"971bb522-68df-46e4-bc1c-6f99171e49c6\") " pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:20.048195 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.048172    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh"]
May 25 05:59:20.051143 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:20.051119    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8870eb81_f20a_4a7c_a86b_109ebbbb80e1.slice/crio-a7d5db65d0e87ea556675e1eba81659d3ed22b8c228f9c28f7035a41f7ef97b0 WatchSource:0}: Error finding container a7d5db65d0e87ea556675e1eba81659d3ed22b8c228f9c28f7035a41f7ef97b0: Status 404 returned error can't find the container with id a7d5db65d0e87ea556675e1eba81659d3ed22b8c228f9c28f7035a41f7ef97b0
May 25 05:59:20.051222 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.051183    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"
May 25 05:59:20.060422 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.060404    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rkkwr\""
May 25 05:59:20.064102 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.064085    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zcxj8"
May 25 05:59:20.068687 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.068648    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:20.068798 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.068751    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:20.121095 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.121064    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 05:59:20.121249 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.121184    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" event={"ID":"6e833df1-55eb-489d-9489-6bae2662c9bf","Type":"ContainerStarted","Data":"a93ce46ffd95526acab989da7a0f382ba1800e157010d4e69f1187bcbbc1597e"}
May 25 05:59:20.121978 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.121756    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:59:20.124268 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.124154    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh" event={"ID":"8870eb81-f20a-4a7c-a86b-109ebbbb80e1","Type":"ContainerStarted","Data":"a7d5db65d0e87ea556675e1eba81659d3ed22b8c228f9c28f7035a41f7ef97b0"}
May 25 05:59:20.124268 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.124219    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:59:20.130975 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.130848    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:59:20.141024 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.139609    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc" podStartSLOduration=23.615279072 podStartE2EDuration="26.139590143s" podCreationTimestamp="2026-05-25 05:58:54 +0000 UTC" firstStartedPulling="2026-05-25 05:58:54.700175911 +0000 UTC m=+99.605943957" lastFinishedPulling="2026-05-25 05:58:57.224486993 +0000 UTC m=+102.130255028" observedRunningTime="2026-05-25 05:59:20.13852618 +0000 UTC m=+125.044294232" watchObservedRunningTime="2026-05-25 05:59:20.139590143 +0000 UTC m=+125.045358197"
May 25 05:59:20.215058 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.214931    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l"]
May 25 05:59:20.219866 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:20.219837    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7cc01a_ee7f_48da_9d98_40cf4bf9dec7.slice/crio-95a6f9bb05c71b2223eb37e30902007512b49aae3e758e17b94834473727c3f4 WatchSource:0}: Error finding container 95a6f9bb05c71b2223eb37e30902007512b49aae3e758e17b94834473727c3f4: Status 404 returned error can't find the container with id 95a6f9bb05c71b2223eb37e30902007512b49aae3e758e17b94834473727c3f4
May 25 05:59:20.278911 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.278889    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-trusted-ca\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279016 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.278919    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-certificates\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279016 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.278947    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-bound-sa-token\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279016 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.278972    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdjs8\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-kube-api-access-hdjs8\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279191 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279087    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-installation-pull-secrets\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279191 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279179    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-image-registry-private-configuration\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279298 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279208    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-ca-trust-extracted\") pod \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\" (UID: \"ff3b9c11-38eb-4a96-a189-b75f83cf7a0b\") "
May 25 05:59:20.279298 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279230    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 05:59:20.279298 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279281    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 05:59:20.279504 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279484    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 05:59:20.280154 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279557    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-ca-trust-extracted\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.280154 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279579    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-trusted-ca\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.280154 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.279594    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-certificates\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.281587 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.281546    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-kube-api-access-hdjs8" (OuterVolumeSpecName: "kube-api-access-hdjs8") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "kube-api-access-hdjs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 05:59:20.281587 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.281559    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 05:59:20.281837 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.281593    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 05:59:20.281837 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.281625    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" (UID: "ff3b9c11-38eb-4a96-a189-b75f83cf7a0b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 05:59:20.293644 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.293626    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f95589667-d8wdc"]
May 25 05:59:20.296536 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:20.296516    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971bb522_68df_46e4_bc1c_6f99171e49c6.slice/crio-b983777301ea6bfe19d1a1b06c2678ad1ab75dc0016e68e1e7dcc6a551d03283 WatchSource:0}: Error finding container b983777301ea6bfe19d1a1b06c2678ad1ab75dc0016e68e1e7dcc6a551d03283: Status 404 returned error can't find the container with id b983777301ea6bfe19d1a1b06c2678ad1ab75dc0016e68e1e7dcc6a551d03283
May 25 05:59:20.380144 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.380085    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-image-registry-private-configuration\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.380144 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.380108    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-bound-sa-token\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.380144 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.380118    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdjs8\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-kube-api-access-hdjs8\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.380144 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.380127    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-installation-pull-secrets\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:20.440371 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.440327    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"]
May 25 05:59:20.443112 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.443070    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zcxj8"]
May 25 05:59:20.443640 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:20.443609    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09152d19_e7ae_4779_ad6a_4186b1118941.slice/crio-058bbbce03f2dceda9f2a4e5056f31f9230e0118a7ccdbae4ad0206190dcfde1 WatchSource:0}: Error finding container 058bbbce03f2dceda9f2a4e5056f31f9230e0118a7ccdbae4ad0206190dcfde1: Status 404 returned error can't find the container with id 058bbbce03f2dceda9f2a4e5056f31f9230e0118a7ccdbae4ad0206190dcfde1
May 25 05:59:20.448443 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:20.448422    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d310832_0ca4_4967_b189_d289f27d4d88.slice/crio-626a4b787e6d9aa26744918f3cd549daebc371440f4cbff1a85267c5116ab9da WatchSource:0}: Error finding container 626a4b787e6d9aa26744918f3cd549daebc371440f4cbff1a85267c5116ab9da: Status 404 returned error can't find the container with id 626a4b787e6d9aa26744918f3cd549daebc371440f4cbff1a85267c5116ab9da
May 25 05:59:20.937766 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:20.937736    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-lm7hc"
May 25 05:59:21.130295 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.130254    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcxj8" event={"ID":"9d310832-0ca4-4967-b189-d289f27d4d88","Type":"ContainerStarted","Data":"9b0fea35b3ac2821835b5c704fcc759b53dbc49755393b1a254442dc3452cc31"}
May 25 05:59:21.130295 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.130299    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcxj8" event={"ID":"9d310832-0ca4-4967-b189-d289f27d4d88","Type":"ContainerStarted","Data":"626a4b787e6d9aa26744918f3cd549daebc371440f4cbff1a85267c5116ab9da"}
May 25 05:59:21.132062 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.132024    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f95589667-d8wdc" event={"ID":"971bb522-68df-46e4-bc1c-6f99171e49c6","Type":"ContainerStarted","Data":"17060e7202cbbc06ccac0a2e9796995408333f8f0da1d79fd93eacc4a27a078f"}
May 25 05:59:21.132174 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.132064    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f95589667-d8wdc" event={"ID":"971bb522-68df-46e4-bc1c-6f99171e49c6","Type":"ContainerStarted","Data":"b983777301ea6bfe19d1a1b06c2678ad1ab75dc0016e68e1e7dcc6a551d03283"}
May 25 05:59:21.132247 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.132171    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:21.133782 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.133737    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l" event={"ID":"0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7","Type":"ContainerStarted","Data":"6ee9d9dee82dbd1b3435002b8249e84cb96a63fbada2745ab2d9f76e3e7c8410"}
May 25 05:59:21.133782 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.133770    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l" event={"ID":"0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7","Type":"ContainerStarted","Data":"95a6f9bb05c71b2223eb37e30902007512b49aae3e758e17b94834473727c3f4"}
May 25 05:59:21.135585 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.135336    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j" event={"ID":"09152d19-e7ae-4779-ad6a-4186b1118941","Type":"ContainerStarted","Data":"058bbbce03f2dceda9f2a4e5056f31f9230e0118a7ccdbae4ad0206190dcfde1"}
May 25 05:59:21.135585 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.135394    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584d59fd8-vl9f8"
May 25 05:59:21.163833 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.163777    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f95589667-d8wdc" podStartSLOduration=2.163753018 podStartE2EDuration="2.163753018s" podCreationTimestamp="2026-05-25 05:59:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:59:21.159139926 +0000 UTC m=+126.064907978" watchObservedRunningTime="2026-05-25 05:59:21.163753018 +0000 UTC m=+126.069521067"
May 25 05:59:21.184351 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.184310    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584d59fd8-vl9f8"]
May 25 05:59:21.190192 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.190172    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-584d59fd8-vl9f8"]
May 25 05:59:21.201860 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.201806    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-kv55l" podStartSLOduration=2.201794374 podStartE2EDuration="2.201794374s" podCreationTimestamp="2026-05-25 05:59:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 05:59:21.201495653 +0000 UTC m=+126.107263703" watchObservedRunningTime="2026-05-25 05:59:21.201794374 +0000 UTC m=+126.107562422"
May 25 05:59:21.289795 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.289306    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 05:59:21.703274 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:21.703250    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff3b9c11-38eb-4a96-a189-b75f83cf7a0b" path="/var/lib/kubelet/pods/ff3b9c11-38eb-4a96-a189-b75f83cf7a0b/volumes"
May 25 05:59:22.138841 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.138795    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j" event={"ID":"09152d19-e7ae-4779-ad6a-4186b1118941","Type":"ContainerStarted","Data":"3923e71a8eab2d5003e8f25ae539458cd91f5e14b04fffef5761b32011b26775"}
May 25 05:59:22.139347 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.139107    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:22.140775 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.140742    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcxj8" event={"ID":"9d310832-0ca4-4967-b189-d289f27d4d88","Type":"ContainerStarted","Data":"3bc41b54f081889299b5bec187dee5e688a5f40b9c14f0cdb24be5d86ab7f652"}
May 25 05:59:22.142397 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.142355    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh" event={"ID":"8870eb81-f20a-4a7c-a86b-109ebbbb80e1","Type":"ContainerStarted","Data":"ab0ec0ae4dbaeeeaf4898b7c9c24bf74636c48e7ef836df2393d84bb21cec415"}
May 25 05:59:22.144764 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.144746    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j"
May 25 05:59:22.153988 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.153953    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-4886j" podStartSLOduration=1.9288596550000001 podStartE2EDuration="3.153943286s" podCreationTimestamp="2026-05-25 05:59:19 +0000 UTC" firstStartedPulling="2026-05-25 05:59:20.446050571 +0000 UTC m=+125.351818602" lastFinishedPulling="2026-05-25 05:59:21.671134189 +0000 UTC m=+126.576902233" observedRunningTime="2026-05-25 05:59:22.15268423 +0000 UTC m=+127.058452302" watchObservedRunningTime="2026-05-25 05:59:22.153943286 +0000 UTC m=+127.059711353"
May 25 05:59:22.168795 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.168739    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t5nmh" podStartSLOduration=1.597882297 podStartE2EDuration="3.168726447s" podCreationTimestamp="2026-05-25 05:59:19 +0000 UTC" firstStartedPulling="2026-05-25 05:59:20.055301559 +0000 UTC m=+124.961069588" lastFinishedPulling="2026-05-25 05:59:21.626145706 +0000 UTC m=+126.531913738" observedRunningTime="2026-05-25 05:59:22.167011734 +0000 UTC m=+127.072779793" watchObservedRunningTime="2026-05-25 05:59:22.168726447 +0000 UTC m=+127.074494501"
May 25 05:59:22.573340 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.573265    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"]
May 25 05:59:22.577774 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.577751    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.579828 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.579798    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 25 05:59:22.579828 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.579818    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 25 05:59:22.579828 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.579827    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-tf6kd\""
May 25 05:59:22.580053 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.579827    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 05:59:22.580249 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.580215    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 05:59:22.580249 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.580258    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 05:59:22.588752 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.588699    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"]
May 25 05:59:22.702581 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.702549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d5983-f430-4380-8684-57575fb00ae7-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.702812 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.702600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb1d5983-f430-4380-8684-57575fb00ae7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.702812 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.702674    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x56bm\" (UniqueName: \"kubernetes.io/projected/fb1d5983-f430-4380-8684-57575fb00ae7-kube-api-access-x56bm\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.702812 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.702802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb1d5983-f430-4380-8684-57575fb00ae7-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.803854 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.803823    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d5983-f430-4380-8684-57575fb00ae7-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.804018 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.803876    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb1d5983-f430-4380-8684-57575fb00ae7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.804018 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.803923    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x56bm\" (UniqueName: \"kubernetes.io/projected/fb1d5983-f430-4380-8684-57575fb00ae7-kube-api-access-x56bm\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.804101 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.804037    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb1d5983-f430-4380-8684-57575fb00ae7-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.804524 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.804498    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb1d5983-f430-4380-8684-57575fb00ae7-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.806231 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.806207    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fb1d5983-f430-4380-8684-57575fb00ae7-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.806315 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.806267    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb1d5983-f430-4380-8684-57575fb00ae7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.810784 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.810766    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x56bm\" (UniqueName: \"kubernetes.io/projected/fb1d5983-f430-4380-8684-57575fb00ae7-kube-api-access-x56bm\") pod \"prometheus-operator-7779bbdd78-ls4rz\" (UID: \"fb1d5983-f430-4380-8684-57575fb00ae7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:22.887251 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:22.887226    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"
May 25 05:59:23.001251 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:23.001218    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz"]
May 25 05:59:23.003988 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:23.003965    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb1d5983_f430_4380_8684_57575fb00ae7.slice/crio-8f5645eaa8675bebc941a4b21aa37c2784cd4d0eed9aa9c7ba3ce4ffddb1ebcd WatchSource:0}: Error finding container 8f5645eaa8675bebc941a4b21aa37c2784cd4d0eed9aa9c7ba3ce4ffddb1ebcd: Status 404 returned error can't find the container with id 8f5645eaa8675bebc941a4b21aa37c2784cd4d0eed9aa9c7ba3ce4ffddb1ebcd
May 25 05:59:23.147003 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:23.146904    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz" event={"ID":"fb1d5983-f430-4380-8684-57575fb00ae7","Type":"ContainerStarted","Data":"8f5645eaa8675bebc941a4b21aa37c2784cd4d0eed9aa9c7ba3ce4ffddb1ebcd"}
May 25 05:59:23.149997 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:23.149970    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zcxj8" event={"ID":"9d310832-0ca4-4967-b189-d289f27d4d88","Type":"ContainerStarted","Data":"26747bd380989080e45e7f8462577e650a8ce8329909db5883283ab3ab71105a"}
May 25 05:59:25.157420 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.157385    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz" event={"ID":"fb1d5983-f430-4380-8684-57575fb00ae7","Type":"ContainerStarted","Data":"046c29d747713dbc686726ee11546fb1d29496a8fbe9a5546687649590e37660"}
May 25 05:59:25.157420 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.157423    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz" event={"ID":"fb1d5983-f430-4380-8684-57575fb00ae7","Type":"ContainerStarted","Data":"9cdc4d000ebf35a138867ff400f6eb5e348e5e4032ebb1f737ca9aeebf34433c"}
May 25 05:59:25.171209 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.171161    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zcxj8" podStartSLOduration=3.868489054 podStartE2EDuration="6.171146197s" podCreationTimestamp="2026-05-25 05:59:19 +0000 UTC" firstStartedPulling="2026-05-25 05:59:20.514171784 +0000 UTC m=+125.419939818" lastFinishedPulling="2026-05-25 05:59:22.81682893 +0000 UTC m=+127.722596961" observedRunningTime="2026-05-25 05:59:23.169525824 +0000 UTC m=+128.075293885" watchObservedRunningTime="2026-05-25 05:59:25.171146197 +0000 UTC m=+130.076914251"
May 25 05:59:25.171725 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.171670    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-ls4rz" podStartSLOduration=1.803743388 podStartE2EDuration="3.171659753s" podCreationTimestamp="2026-05-25 05:59:22 +0000 UTC" firstStartedPulling="2026-05-25 05:59:23.005740822 +0000 UTC m=+127.911508850" lastFinishedPulling="2026-05-25 05:59:24.373657183 +0000 UTC m=+129.279425215" observedRunningTime="2026-05-25 05:59:25.170539218 +0000 UTC m=+130.076307269" watchObservedRunningTime="2026-05-25 05:59:25.171659753 +0000 UTC m=+130.077427805"
May 25 05:59:25.526531 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.526461    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:59:25.528691 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.528666    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb9f7217-4ee1-4d73-a997-ee78a2570a46-metrics-certs\") pod \"network-metrics-daemon-tcxw8\" (UID: \"cb9f7217-4ee1-4d73-a997-ee78a2570a46\") " pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:59:25.819021 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.818943    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9kfc7\""
May 25 05:59:25.827509 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.827470    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tcxw8"
May 25 05:59:25.947497 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:25.947469    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tcxw8"]
May 25 05:59:25.949210 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:25.949176    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9f7217_4ee1_4d73_a997_ee78a2570a46.slice/crio-34528a8c0571acab2733e741bdefe742a6b82cd73fae86b112342e0c8a2435e6 WatchSource:0}: Error finding container 34528a8c0571acab2733e741bdefe742a6b82cd73fae86b112342e0c8a2435e6: Status 404 returned error can't find the container with id 34528a8c0571acab2733e741bdefe742a6b82cd73fae86b112342e0c8a2435e6
May 25 05:59:26.161061 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.161031    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcxw8" event={"ID":"cb9f7217-4ee1-4d73-a997-ee78a2570a46","Type":"ContainerStarted","Data":"34528a8c0571acab2733e741bdefe742a6b82cd73fae86b112342e0c8a2435e6"}
May 25 05:59:26.893228 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.893199    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"]
May 25 05:59:26.897994 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.897973    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:26.899800 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.899780    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-df4gg\""
May 25 05:59:26.899915 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.899855    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 25 05:59:26.899915 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.899883    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 25 05:59:26.906317 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.906294    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"]
May 25 05:59:26.912218 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.912199    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p9lxq"]
May 25 05:59:26.915321 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.915306    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:26.917086 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.917068    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 05:59:26.917214 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.917193    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 05:59:26.917321 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.917217    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7krpk\""
May 25 05:59:26.917321 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:26.917263    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 05:59:27.038974 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.038950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-metrics-client-ca\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039068 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.038985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dbjn\" (UniqueName: \"kubernetes.io/projected/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-kube-api-access-7dbjn\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039068 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039008    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-wtmp\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039068 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-sys\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039244 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-tls\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039244 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039116    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039244 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/250f659c-e544-4f66-a751-2584e77dfc00-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.039244 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f72p5\" (UniqueName: \"kubernetes.io/projected/250f659c-e544-4f66-a751-2584e77dfc00-kube-api-access-f72p5\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.039244 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039209    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039244 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039232    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.039562 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039249    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-textfile\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.039562 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.039562 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.039296    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-root\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140242 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140164    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-metrics-client-ca\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140242 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140199    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dbjn\" (UniqueName: \"kubernetes.io/projected/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-kube-api-access-7dbjn\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140242 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140225    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-wtmp\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140338    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-sys\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140377    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-sys\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140378    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-tls\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140345    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-wtmp\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140425    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140454    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/250f659c-e544-4f66-a751-2584e77dfc00-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.140472 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:27.140460    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140502    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f72p5\" (UniqueName: \"kubernetes.io/projected/250f659c-e544-4f66-a751-2584e77dfc00-kube-api-access-f72p5\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:27.140513    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-tls podName:b0f14f4b-c70f-4f29-b117-3a3eaad9d48b nodeName:}" failed. No retries permitted until 2026-05-25 05:59:27.640494915 +0000 UTC m=+132.546262963 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-tls") pod "node-exporter-p9lxq" (UID: "b0f14f4b-c70f-4f29-b117-3a3eaad9d48b") : secret "node-exporter-tls" not found
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140560    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140593    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140617    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-textfile\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140644    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140675    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-root\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:27.140729    2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-metrics-client-ca\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140767    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-root\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.140819 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:27.140773    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-tls podName:250f659c-e544-4f66-a751-2584e77dfc00 nodeName:}" failed. No retries permitted until 2026-05-25 05:59:27.640758693 +0000 UTC m=+132.546526727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-hfrgm" (UID: "250f659c-e544-4f66-a751-2584e77dfc00") : secret "openshift-state-metrics-tls" not found
May 25 05:59:27.141290 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.140975    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-textfile\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.141290 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.141070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-accelerators-collector-config\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.141290 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.141218    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/250f659c-e544-4f66-a751-2584e77dfc00-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.143057 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.143035    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.143156 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.143096    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.150425 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.150406    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dbjn\" (UniqueName: \"kubernetes.io/projected/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-kube-api-access-7dbjn\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.150603 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.150584    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f72p5\" (UniqueName: \"kubernetes.io/projected/250f659c-e544-4f66-a751-2584e77dfc00-kube-api-access-f72p5\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.167743 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.167697    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcxw8" event={"ID":"cb9f7217-4ee1-4d73-a997-ee78a2570a46","Type":"ContainerStarted","Data":"fbbcd9ab84e042387e7d2b836c361c25da1025408d871fcd33982d6c152d22b0"}
May 25 05:59:27.167743 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.167744    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tcxw8" event={"ID":"cb9f7217-4ee1-4d73-a997-ee78a2570a46","Type":"ContainerStarted","Data":"a69838d165fec8464c978e6e981d418f317de4b944918f9fc09e7b4e1c6b5056"}
May 25 05:59:27.185370 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.185331    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tcxw8" podStartSLOduration=131.283956238 podStartE2EDuration="2m12.185321109s" podCreationTimestamp="2026-05-25 05:57:15 +0000 UTC" firstStartedPulling="2026-05-25 05:59:25.951006751 +0000 UTC m=+130.856774780" lastFinishedPulling="2026-05-25 05:59:26.852371616 +0000 UTC m=+131.758139651" observedRunningTime="2026-05-25 05:59:27.184311852 +0000 UTC m=+132.090079901" watchObservedRunningTime="2026-05-25 05:59:27.185321109 +0000 UTC m=+132.091089159"
May 25 05:59:27.645005 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.644975    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-tls\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.645164 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.645034    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.647331 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.647303    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0f14f4b-c70f-4f29-b117-3a3eaad9d48b-node-exporter-tls\") pod \"node-exporter-p9lxq\" (UID: \"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b\") " pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.647462 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.647442    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/250f659c-e544-4f66-a751-2584e77dfc00-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-hfrgm\" (UID: \"250f659c-e544-4f66-a751-2584e77dfc00\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.826304 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.826277    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"
May 25 05:59:27.843631 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.843607    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p9lxq"
May 25 05:59:27.855218 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:27.855179    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0f14f4b_c70f_4f29_b117_3a3eaad9d48b.slice/crio-256a7981ba6fecea16ec478607aa0195ab20354fc4e98e9819a84d0328d0db77 WatchSource:0}: Error finding container 256a7981ba6fecea16ec478607aa0195ab20354fc4e98e9819a84d0328d0db77: Status 404 returned error can't find the container with id 256a7981ba6fecea16ec478607aa0195ab20354fc4e98e9819a84d0328d0db77
May 25 05:59:27.956518 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:27.956484    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm"]
May 25 05:59:27.959596 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:27.959563    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250f659c_e544_4f66_a751_2584e77dfc00.slice/crio-1ce357e6589c26df10bfbb6cc31632a9fb51866dcfaf13a5b9a2e2719dee4565 WatchSource:0}: Error finding container 1ce357e6589c26df10bfbb6cc31632a9fb51866dcfaf13a5b9a2e2719dee4565: Status 404 returned error can't find the container with id 1ce357e6589c26df10bfbb6cc31632a9fb51866dcfaf13a5b9a2e2719dee4565
May 25 05:59:28.172226 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:28.172193    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9lxq" event={"ID":"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b","Type":"ContainerStarted","Data":"256a7981ba6fecea16ec478607aa0195ab20354fc4e98e9819a84d0328d0db77"}
May 25 05:59:28.173531 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:28.173510    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm" event={"ID":"250f659c-e544-4f66-a751-2584e77dfc00","Type":"ContainerStarted","Data":"19d871d5c19e90005c679b13c8e11c32dceef5247b4acdc77e1b78ba3ffd851b"}
May 25 05:59:28.173644 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:28.173536    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm" event={"ID":"250f659c-e544-4f66-a751-2584e77dfc00","Type":"ContainerStarted","Data":"1ce357e6589c26df10bfbb6cc31632a9fb51866dcfaf13a5b9a2e2719dee4565"}
May 25 05:59:29.178070 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.177986    2556 generic.go:358] "Generic (PLEG): container finished" podID="b0f14f4b-c70f-4f29-b117-3a3eaad9d48b" containerID="989794ae144eb979cbbadb69820a8c5345c89680cbda062f3249739c9d69e5d3" exitCode=0
May 25 05:59:29.178473 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.178097    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9lxq" event={"ID":"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b","Type":"ContainerDied","Data":"989794ae144eb979cbbadb69820a8c5345c89680cbda062f3249739c9d69e5d3"}
May 25 05:59:29.179951 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.179924    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm" event={"ID":"250f659c-e544-4f66-a751-2584e77dfc00","Type":"ContainerStarted","Data":"c0d7aa2e9b0e7dea497552c1c566cfdb3c755905eb925dd77517e66461c701b1"}
May 25 05:59:29.872867 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.872837    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"]
May 25 05:59:29.876392 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.876373    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:29.878413 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.878390    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 25 05:59:29.878501 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.878390    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 25 05:59:29.878798 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.878773    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l9j5d\""
May 25 05:59:29.878918 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.878799    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 25 05:59:29.879014 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.878913    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ffurgkkdhrs7s\""
May 25 05:59:29.879149 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.879114    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 25 05:59:29.879245 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.879168    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 25 05:59:29.885587 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:29.885569    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"]
May 25 05:59:30.067575 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-tls\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067575 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067542    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067575 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067563    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-grpc-tls\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067784 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067827 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067827 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-metrics-client-ca\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067902 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067835    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.067902 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.067867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw9bb\" (UniqueName: \"kubernetes.io/projected/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-kube-api-access-kw9bb\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.168666 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168638    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-tls\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.168666 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168669    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.168868 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168686    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-grpc-tls\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.168868 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168830    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.168939 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168898    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.168939 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168925    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-metrics-client-ca\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.169021 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.168962    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.169072 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.169026    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kw9bb\" (UniqueName: \"kubernetes.io/projected/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-kube-api-access-kw9bb\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.169686 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.169657    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-metrics-client-ca\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.171255 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.171235    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.171366 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.171318    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-grpc-tls\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.171516 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.171494    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.171691 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.171673    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.171790 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.171772    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.171867 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.171851    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-secret-thanos-querier-tls\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.175849 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.175828    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw9bb\" (UniqueName: \"kubernetes.io/projected/5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4-kube-api-access-kw9bb\") pod \"thanos-querier-89bb44f4b-kdcgb\" (UID: \"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4\") " pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.184542 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.184516    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm" event={"ID":"250f659c-e544-4f66-a751-2584e77dfc00","Type":"ContainerStarted","Data":"fd4299ff914ace75c7d673491c31b06c18a4d953fa080328c79a5fd6e2d445ab"}
May 25 05:59:30.185504 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.185487    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:30.186640 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.186620    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9lxq" event={"ID":"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b","Type":"ContainerStarted","Data":"ffc9880d82e59fd735e763d7b08e7e53f46ae5cffe24dbcc2cede1b16f84757a"}
May 25 05:59:30.186785 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.186644    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p9lxq" event={"ID":"b0f14f4b-c70f-4f29-b117-3a3eaad9d48b","Type":"ContainerStarted","Data":"dce109e7db30ca2676e09be7d8d547e728d8a0f29fdeacf893cc68fd9fa0d21d"}
May 25 05:59:30.199807 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.199762    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-hfrgm" podStartSLOduration=2.724679349 podStartE2EDuration="4.199672604s" podCreationTimestamp="2026-05-25 05:59:26 +0000 UTC" firstStartedPulling="2026-05-25 05:59:28.230025074 +0000 UTC m=+133.135793103" lastFinishedPulling="2026-05-25 05:59:29.705018326 +0000 UTC m=+134.610786358" observedRunningTime="2026-05-25 05:59:30.198978995 +0000 UTC m=+135.104747059" watchObservedRunningTime="2026-05-25 05:59:30.199672604 +0000 UTC m=+135.105440657"
May 25 05:59:30.215985 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.215930    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p9lxq" podStartSLOduration=3.215278901 podStartE2EDuration="4.21590139s" podCreationTimestamp="2026-05-25 05:59:26 +0000 UTC" firstStartedPulling="2026-05-25 05:59:27.85684675 +0000 UTC m=+132.762614778" lastFinishedPulling="2026-05-25 05:59:28.857469237 +0000 UTC m=+133.763237267" observedRunningTime="2026-05-25 05:59:30.21403079 +0000 UTC m=+135.119798839" watchObservedRunningTime="2026-05-25 05:59:30.21590139 +0000 UTC m=+135.121669442"
May 25 05:59:30.309812 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:30.309782    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"]
May 25 05:59:30.313152 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:30.313128    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbdbb81_9bb5_4059_9f08_1d120cfbaeb4.slice/crio-527666fa19ecb504673e71d63b6096c50c396c1e6dae423f39d4af71dfe7396a WatchSource:0}: Error finding container 527666fa19ecb504673e71d63b6096c50c396c1e6dae423f39d4af71dfe7396a: Status 404 returned error can't find the container with id 527666fa19ecb504673e71d63b6096c50c396c1e6dae423f39d4af71dfe7396a
May 25 05:59:31.190874 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.190839    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"527666fa19ecb504673e71d63b6096c50c396c1e6dae423f39d4af71dfe7396a"}
May 25 05:59:31.308674 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.308635    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d9d74b559-6jf4m"]
May 25 05:59:31.312159 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.312138    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.313933 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.313910    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 25 05:59:31.314562 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.314538    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 25 05:59:31.314562 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.314552    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fv7csj3k0tcgk\""
May 25 05:59:31.314924 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.314854    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 25 05:59:31.314924 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.314906    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 05:59:31.315090 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.314980    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jpz98\""
May 25 05:59:31.321797 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.321778    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d9d74b559-6jf4m"]
May 25 05:59:31.481371 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c24180-2349-48e3-a395-7c970d2ebcbc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.481371 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-client-ca-bundle\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.481617 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481468    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-secret-metrics-server-client-certs\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.481617 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481516    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-secret-metrics-server-tls\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.481617 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481574    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02c24180-2349-48e3-a395-7c970d2ebcbc-audit-log\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.481905 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481660    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02c24180-2349-48e3-a395-7c970d2ebcbc-metrics-server-audit-profiles\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.481905 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.481696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wl448\" (UniqueName: \"kubernetes.io/projected/02c24180-2349-48e3-a395-7c970d2ebcbc-kube-api-access-wl448\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.582971 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.582942    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-secret-metrics-server-client-certs\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583143 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.582980    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-secret-metrics-server-tls\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583143 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583016    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02c24180-2349-48e3-a395-7c970d2ebcbc-audit-log\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583250 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583143    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02c24180-2349-48e3-a395-7c970d2ebcbc-metrics-server-audit-profiles\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583250 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583201    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wl448\" (UniqueName: \"kubernetes.io/projected/02c24180-2349-48e3-a395-7c970d2ebcbc-kube-api-access-wl448\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583350 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583266    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c24180-2349-48e3-a395-7c970d2ebcbc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583350 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583303    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-client-ca-bundle\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583466 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583400    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/02c24180-2349-48e3-a395-7c970d2ebcbc-audit-log\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.583934 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.583899    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02c24180-2349-48e3-a395-7c970d2ebcbc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.584054 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.584037    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/02c24180-2349-48e3-a395-7c970d2ebcbc-metrics-server-audit-profiles\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.585447 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.585425    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-secret-metrics-server-client-certs\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.585755 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.585737    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-client-ca-bundle\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.585839 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.585787    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/02c24180-2349-48e3-a395-7c970d2ebcbc-secret-metrics-server-tls\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.590303 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.590284    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wl448\" (UniqueName: \"kubernetes.io/projected/02c24180-2349-48e3-a395-7c970d2ebcbc-kube-api-access-wl448\") pod \"metrics-server-5d9d74b559-6jf4m\" (UID: \"02c24180-2349-48e3-a395-7c970d2ebcbc\") " pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.623758 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.623732    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:31.694833 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.694797    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"]
May 25 05:59:31.699810 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.699784    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:31.701614 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.701555    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 25 05:59:31.701614 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.701555    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-dhvbz\""
May 25 05:59:31.707926 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.707859    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"]
May 25 05:59:31.766858 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.766838    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d9d74b559-6jf4m"]
May 25 05:59:31.886544 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.886511    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8pg7q\" (UID: \"de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:31.988106 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:31.988076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8pg7q\" (UID: \"de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:31.988293 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:31.988223    2556 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 25 05:59:31.988352 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:31.988311    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed-monitoring-plugin-cert podName:de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed nodeName:}" failed. No retries permitted until 2026-05-25 05:59:32.488288381 +0000 UTC m=+137.394056417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-8pg7q" (UID: "de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed") : secret "monitoring-plugin-cert" not found
May 25 05:59:32.238484 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:32.238440    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c24180_2349_48e3_a395_7c970d2ebcbc.slice/crio-df5f6d5f5e70a97a12b020263b9918463d85a300da41320478a7df5fee0a1572 WatchSource:0}: Error finding container df5f6d5f5e70a97a12b020263b9918463d85a300da41320478a7df5fee0a1572: Status 404 returned error can't find the container with id df5f6d5f5e70a97a12b020263b9918463d85a300da41320478a7df5fee0a1572
May 25 05:59:32.492714 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:32.492624    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8pg7q\" (UID: \"de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:32.494842 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:32.494824    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-8pg7q\" (UID: \"de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:32.612991 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:32.612963    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:32.727267 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:32.727080    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"]
May 25 05:59:32.729696 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:32.729669    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6b9de1_5387_4e27_99b3_6e6a8ebdf3ed.slice/crio-efbe04b20fb75ad89a04ad6dd81b6bbc36f46710dd30dd9f1c97ac4667586966 WatchSource:0}: Error finding container efbe04b20fb75ad89a04ad6dd81b6bbc36f46710dd30dd9f1c97ac4667586966: Status 404 returned error can't find the container with id efbe04b20fb75ad89a04ad6dd81b6bbc36f46710dd30dd9f1c97ac4667586966
May 25 05:59:33.199188 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:33.199143    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m" event={"ID":"02c24180-2349-48e3-a395-7c970d2ebcbc","Type":"ContainerStarted","Data":"df5f6d5f5e70a97a12b020263b9918463d85a300da41320478a7df5fee0a1572"}
May 25 05:59:33.201193 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:33.201125    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"4a8a67a9a8a4e6f0a3c8c246b98b8403dfbd82e01d0fe294d6a95cd113d79922"}
May 25 05:59:33.201193 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:33.201159    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"08f1bac4f44d0d8d29f599dbcd3e78848caf368f0c9c844c61f99a2cdba55224"}
May 25 05:59:33.201193 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:33.201175    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"0410f4bd7ff06d7571b4e869904ec70c0c6ae27d3ffd8d21a2223b823a198d6c"}
May 25 05:59:33.202341 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:33.202311    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q" event={"ID":"de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed","Type":"ContainerStarted","Data":"efbe04b20fb75ad89a04ad6dd81b6bbc36f46710dd30dd9f1c97ac4667586966"}
May 25 05:59:35.208724 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.208683    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m" event={"ID":"02c24180-2349-48e3-a395-7c970d2ebcbc","Type":"ContainerStarted","Data":"f868d7b6b8644c3cceb76363af9338b51b593e54a3e136e74b918e24f3e49e93"}
May 25 05:59:35.211156 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.211132    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"78e161bf07add2e6e3b0836c2a51f40f0ad10352f4e905a69e541a7d8d8d406b"}
May 25 05:59:35.211292 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.211161    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"700e4cbdce1962636e2d7ab996b7265a9c193754327c52d4e0a02470011dfbd5"}
May 25 05:59:35.211292 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.211175    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" event={"ID":"5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4","Type":"ContainerStarted","Data":"5de17928df9acf5d782fd71c7dd5665eb8c4a11765af73ae896c6f5be832cbb9"}
May 25 05:59:35.211292 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.211259    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:35.212553 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.212534    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q" event={"ID":"de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed","Type":"ContainerStarted","Data":"79c9c5d32b35ef6bc8b639595efe4bf1f21dfca0f7237bc674ecd5f6c52ee122"}
May 25 05:59:35.212690 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.212675    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:35.217092 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.217072    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q"
May 25 05:59:35.225228 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.225193    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m" podStartSLOduration=2.256716726 podStartE2EDuration="4.225181182s" podCreationTimestamp="2026-05-25 05:59:31 +0000 UTC" firstStartedPulling="2026-05-25 05:59:32.240147413 +0000 UTC m=+137.145915445" lastFinishedPulling="2026-05-25 05:59:34.20861187 +0000 UTC m=+139.114379901" observedRunningTime="2026-05-25 05:59:35.223970279 +0000 UTC m=+140.129738331" watchObservedRunningTime="2026-05-25 05:59:35.225181182 +0000 UTC m=+140.130949291"
May 25 05:59:35.244833 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.244798    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb" podStartSLOduration=2.351616655 podStartE2EDuration="6.244789953s" podCreationTimestamp="2026-05-25 05:59:29 +0000 UTC" firstStartedPulling="2026-05-25 05:59:30.315468075 +0000 UTC m=+135.221236109" lastFinishedPulling="2026-05-25 05:59:34.208641367 +0000 UTC m=+139.114409407" observedRunningTime="2026-05-25 05:59:35.244536362 +0000 UTC m=+140.150304421" watchObservedRunningTime="2026-05-25 05:59:35.244789953 +0000 UTC m=+140.150557986"
May 25 05:59:35.261119 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:35.261083    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-8pg7q" podStartSLOduration=2.781514101 podStartE2EDuration="4.261072712s" podCreationTimestamp="2026-05-25 05:59:31 +0000 UTC" firstStartedPulling="2026-05-25 05:59:32.732046256 +0000 UTC m=+137.637814285" lastFinishedPulling="2026-05-25 05:59:34.211604858 +0000 UTC m=+139.117372896" observedRunningTime="2026-05-25 05:59:35.259191029 +0000 UTC m=+140.164959080" watchObservedRunningTime="2026-05-25 05:59:35.261072712 +0000 UTC m=+140.166840761"
May 25 05:59:38.032909 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.032875    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-85dcf6c7b5-l846d"]
May 25 05:59:38.037141 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.037121    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.039629 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039597    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8tn6\""
May 25 05:59:38.039747 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039672    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 05:59:38.039747 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039681    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 05:59:38.039747 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039598    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 05:59:38.039936 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039601    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 05:59:38.039936 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039606    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 05:59:38.039936 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039597    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 05:59:38.039936 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.039597    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 05:59:38.043770 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.043723    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 25 05:59:38.046123 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.046103    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85dcf6c7b5-l846d"]
May 25 05:59:38.138514 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-serving-cert\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.138514 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-oauth-serving-cert\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.138657 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138533    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-service-ca\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.138657 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138550    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mnc\" (UniqueName: \"kubernetes.io/projected/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-kube-api-access-c7mnc\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.138657 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138628    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-config\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.138814 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138693    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-oauth-config\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.138814 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.138767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-trusted-ca-bundle\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239353 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239326    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-serving-cert\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239356    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-oauth-serving-cert\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239374    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-service-ca\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239391    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mnc\" (UniqueName: \"kubernetes.io/projected/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-kube-api-access-c7mnc\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239463 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239416    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-config\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239631 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239547    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-oauth-config\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.239631 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.239596    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-trusted-ca-bundle\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.240093 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.240069    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-service-ca\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.240251 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.240177    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-config\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.240364 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.240270    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-oauth-serving-cert\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.240539 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.240520    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-trusted-ca-bundle\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.241824 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.241807    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-oauth-config\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.241956 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.241941    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-serving-cert\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.246973 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.246945    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mnc\" (UniqueName: \"kubernetes.io/projected/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-kube-api-access-c7mnc\") pod \"console-85dcf6c7b5-l846d\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") " pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.346677 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.346653    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:38.496895 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:38.496860    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85dcf6c7b5-l846d"]
May 25 05:59:38.499827 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:38.499781    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b66513_b6c8_4cda_b6fa_d270fd86e8ad.slice/crio-30906105f3c35448f36e9f3ef698caa41f3620e8db53006c3e65288539faf823 WatchSource:0}: Error finding container 30906105f3c35448f36e9f3ef698caa41f3620e8db53006c3e65288539faf823: Status 404 returned error can't find the container with id 30906105f3c35448f36e9f3ef698caa41f3620e8db53006c3e65288539faf823
May 25 05:59:39.225343 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:39.225303    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6c7b5-l846d" event={"ID":"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad","Type":"ContainerStarted","Data":"30906105f3c35448f36e9f3ef698caa41f3620e8db53006c3e65288539faf823"}
May 25 05:59:41.220776 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:41.220748    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-89bb44f4b-kdcgb"
May 25 05:59:41.232446 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:41.232418    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6c7b5-l846d" event={"ID":"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad","Type":"ContainerStarted","Data":"cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286"}
May 25 05:59:41.257699 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:41.257612    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-85dcf6c7b5-l846d" podStartSLOduration=0.764871851 podStartE2EDuration="3.257595691s" podCreationTimestamp="2026-05-25 05:59:38 +0000 UTC" firstStartedPulling="2026-05-25 05:59:38.501839269 +0000 UTC m=+143.407607298" lastFinishedPulling="2026-05-25 05:59:40.994563107 +0000 UTC m=+145.900331138" observedRunningTime="2026-05-25 05:59:41.256344647 +0000 UTC m=+146.162112697" watchObservedRunningTime="2026-05-25 05:59:41.257595691 +0000 UTC m=+146.163363743"
May 25 05:59:42.147381 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:42.147349    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f95589667-d8wdc"
May 25 05:59:48.347000 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:48.346967    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:48.347341 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:48.347054    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:48.351727 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:48.351691    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:49.259042 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:49.259014    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 05:59:51.624833 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:51.624799    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:51.625300 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:51.624865    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 05:59:51.970471 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:51.970391    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kcb49" podUID="f7e08bd3-fbfa-4ff7-860a-ef6b8637188f"
May 25 05:59:51.978546 ip-10-0-128-119 kubenswrapper[2556]: E0525 05:59:51.978516    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-t7bbl" podUID="f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f"
May 25 05:59:52.263331 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:52.263251    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:59:52.263331 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:52.263255    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcb49"
May 25 05:59:56.897621 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:56.897574    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:59:56.898123 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:56.897654    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:59:56.899950 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:56.899928    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7e08bd3-fbfa-4ff7-860a-ef6b8637188f-metrics-tls\") pod \"dns-default-kcb49\" (UID: \"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f\") " pod="openshift-dns/dns-default-kcb49"
May 25 05:59:56.899950 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:56.899940    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f-cert\") pod \"ingress-canary-t7bbl\" (UID: \"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f\") " pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:59:57.066487 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.066457    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vjmkj\""
May 25 05:59:57.066784 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.066764    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g6njt\""
May 25 05:59:57.075126 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.075110    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kcb49"
May 25 05:59:57.075224 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.075184    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7bbl"
May 25 05:59:57.221499 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.221444    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7bbl"]
May 25 05:59:57.224116 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:57.224090    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a05f75_30d2_4ec1_92d3_6136ae7d0b4f.slice/crio-ee178bdd9c8e272e88372b6ee9e251699ddd3c6869ea02141508807b3c57fc5d WatchSource:0}: Error finding container ee178bdd9c8e272e88372b6ee9e251699ddd3c6869ea02141508807b3c57fc5d: Status 404 returned error can't find the container with id ee178bdd9c8e272e88372b6ee9e251699ddd3c6869ea02141508807b3c57fc5d
May 25 05:59:57.243470 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.243443    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kcb49"]
May 25 05:59:57.246056 ip-10-0-128-119 kubenswrapper[2556]: W0525 05:59:57.246033    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e08bd3_fbfa_4ff7_860a_ef6b8637188f.slice/crio-7ed6b38cf306927cce71c094315d80d2fb7b17ff78de5e1599861cf809a75cfc WatchSource:0}: Error finding container 7ed6b38cf306927cce71c094315d80d2fb7b17ff78de5e1599861cf809a75cfc: Status 404 returned error can't find the container with id 7ed6b38cf306927cce71c094315d80d2fb7b17ff78de5e1599861cf809a75cfc
May 25 05:59:57.278136 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.278110    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7bbl" event={"ID":"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f","Type":"ContainerStarted","Data":"ee178bdd9c8e272e88372b6ee9e251699ddd3c6869ea02141508807b3c57fc5d"}
May 25 05:59:57.279141 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:57.279118    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcb49" event={"ID":"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f","Type":"ContainerStarted","Data":"7ed6b38cf306927cce71c094315d80d2fb7b17ff78de5e1599861cf809a75cfc"}
May 25 05:59:59.287150 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:59.287110    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7bbl" event={"ID":"f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f","Type":"ContainerStarted","Data":"2b5498efa86e919730f27216d036bc66dd0424a7ffa50db7ca556b6878a728d4"}
May 25 05:59:59.288854 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:59.288829    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcb49" event={"ID":"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f","Type":"ContainerStarted","Data":"a99a4787807bd9607c0e0dfc6549fb24af67838d843d8daa68db11507d286fc8"}
May 25 05:59:59.288980 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:59.288861    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kcb49" event={"ID":"f7e08bd3-fbfa-4ff7-860a-ef6b8637188f","Type":"ContainerStarted","Data":"46b27d7a33f363927ccecb23b03b0511803971ccd8f7d44dfcbf32650d6e7924"}
May 25 05:59:59.288980 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:59.288898    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kcb49"
May 25 05:59:59.304119 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:59.304077    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t7bbl" podStartSLOduration=129.470015011 podStartE2EDuration="2m11.304064365s" podCreationTimestamp="2026-05-25 05:57:48 +0000 UTC" firstStartedPulling="2026-05-25 05:59:57.225851479 +0000 UTC m=+162.131619508" lastFinishedPulling="2026-05-25 05:59:59.059900834 +0000 UTC m=+163.965668862" observedRunningTime="2026-05-25 05:59:59.30249323 +0000 UTC m=+164.208261279" watchObservedRunningTime="2026-05-25 05:59:59.304064365 +0000 UTC m=+164.209832412"
May 25 05:59:59.321033 ip-10-0-128-119 kubenswrapper[2556]: I0525 05:59:59.320958    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kcb49" podStartSLOduration=129.512295284 podStartE2EDuration="2m11.320942835s" podCreationTimestamp="2026-05-25 05:57:48 +0000 UTC" firstStartedPulling="2026-05-25 05:59:57.247691454 +0000 UTC m=+162.153459483" lastFinishedPulling="2026-05-25 05:59:59.056338996 +0000 UTC m=+163.962107034" observedRunningTime="2026-05-25 05:59:59.318865743 +0000 UTC m=+164.224633806" watchObservedRunningTime="2026-05-25 05:59:59.320942835 +0000 UTC m=+164.226710887"
May 25 06:00:09.294484 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:09.294416    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kcb49"
May 25 06:00:11.629780 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:11.629748    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 06:00:11.633551 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:11.633528    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d9d74b559-6jf4m"
May 25 06:00:33.387166 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:33.387082    2556 generic.go:358] "Generic (PLEG): container finished" podID="fb464081-c56d-4e6e-be54-928b37f50e7d" containerID="241f3df0174dc1cf52ee27e21e0dd45966e77361641847f9398855b84dbd97fa" exitCode=0
May 25 06:00:33.387496 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:33.387154    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf" event={"ID":"fb464081-c56d-4e6e-be54-928b37f50e7d","Type":"ContainerDied","Data":"241f3df0174dc1cf52ee27e21e0dd45966e77361641847f9398855b84dbd97fa"}
May 25 06:00:33.387496 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:33.387468    2556 scope.go:117] "RemoveContainer" containerID="241f3df0174dc1cf52ee27e21e0dd45966e77361641847f9398855b84dbd97fa"
May 25 06:00:34.392048 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:00:34.392009    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-npqqf" event={"ID":"fb464081-c56d-4e6e-be54-928b37f50e7d","Type":"ContainerStarted","Data":"b4e374f97dc4223283f66bcff5cb2886cd0f2750660cc43a434796287684d02f"}
May 25 06:01:21.143677 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.143637    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5499b8b447-k6rv8"]
May 25 06:01:21.146917 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.146899    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.158240 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.158213    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5499b8b447-k6rv8"]
May 25 06:01:21.177322 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-serving-cert\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.177426 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-trusted-ca-bundle\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.177426 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-oauth-config\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.177426 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177396    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-oauth-serving-cert\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.177584 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177443    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-service-ca\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.177584 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-console-config\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.177671 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.177588    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txdmj\" (UniqueName: \"kubernetes.io/projected/800b1621-588a-4ef5-83ef-2977314c8459-kube-api-access-txdmj\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278426 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278401    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-oauth-config\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278551 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278435    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-oauth-serving-cert\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278551 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278452    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-service-ca\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278551 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278496    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-console-config\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278551 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278530    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txdmj\" (UniqueName: \"kubernetes.io/projected/800b1621-588a-4ef5-83ef-2977314c8459-kube-api-access-txdmj\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278735 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278659    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-serving-cert\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.278735 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.278681    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-trusted-ca-bundle\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.279326 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.279302    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-service-ca\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.279430 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.279326    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-oauth-serving-cert\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.279430 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.279360    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-console-config\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.279512 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.279444    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-trusted-ca-bundle\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.280993 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.280968    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-oauth-config\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.281086 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.281025    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-serving-cert\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.286316 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.286271    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txdmj\" (UniqueName: \"kubernetes.io/projected/800b1621-588a-4ef5-83ef-2977314c8459-kube-api-access-txdmj\") pod \"console-5499b8b447-k6rv8\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") " pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.457601 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.457513    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:21.590802 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:21.590780    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5499b8b447-k6rv8"]
May 25 06:01:21.593305 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:01:21.593272    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800b1621_588a_4ef5_83ef_2977314c8459.slice/crio-60da1f95188d0d2fe22fa18c73e5f97a30b74813d464479a0ebd29c5b9a0d6ed WatchSource:0}: Error finding container 60da1f95188d0d2fe22fa18c73e5f97a30b74813d464479a0ebd29c5b9a0d6ed: Status 404 returned error can't find the container with id 60da1f95188d0d2fe22fa18c73e5f97a30b74813d464479a0ebd29c5b9a0d6ed
May 25 06:01:22.546408 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:22.546374    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5499b8b447-k6rv8" event={"ID":"800b1621-588a-4ef5-83ef-2977314c8459","Type":"ContainerStarted","Data":"a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb"}
May 25 06:01:22.546408 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:22.546410    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5499b8b447-k6rv8" event={"ID":"800b1621-588a-4ef5-83ef-2977314c8459","Type":"ContainerStarted","Data":"60da1f95188d0d2fe22fa18c73e5f97a30b74813d464479a0ebd29c5b9a0d6ed"}
May 25 06:01:31.458453 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:31.458359    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:31.458453 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:31.458419    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:31.463113 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:31.463089    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:31.480957 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:31.480910    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5499b8b447-k6rv8" podStartSLOduration=10.480894709 podStartE2EDuration="10.480894709s" podCreationTimestamp="2026-05-25 06:01:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:01:22.569523538 +0000 UTC m=+247.475291590" watchObservedRunningTime="2026-05-25 06:01:31.480894709 +0000 UTC m=+256.386662759"
May 25 06:01:31.576522 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:31.576497    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:01:31.626805 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:31.626764    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85dcf6c7b5-l846d"]
May 25 06:01:56.651820 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:56.651780    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-85dcf6c7b5-l846d" podUID="c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" containerName="console" containerID="cri-o://cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286" gracePeriod=15
May 25 06:01:56.886051 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:56.886027    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85dcf6c7b5-l846d_c5b66513-b6c8-4cda-b6fa-d270fd86e8ad/console/0.log"
May 25 06:01:56.886158 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:56.886090    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 06:01:57.079921 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.079898    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-oauth-serving-cert\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080085 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.079941    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7mnc\" (UniqueName: \"kubernetes.io/projected/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-kube-api-access-c7mnc\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080085 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.079971    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-trusted-ca-bundle\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080085 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080072    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-config\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080242 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080124    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-serving-cert\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080242 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080159    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-service-ca\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080242 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080228    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-oauth-config\") pod \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\" (UID: \"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad\") "
May 25 06:01:57.080394 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080302    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:01:57.080394 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080363    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:01:57.080500 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080481    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-config" (OuterVolumeSpecName: "console-config") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:01:57.080634 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080609    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:01:57.080634 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080626    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-oauth-serving-cert\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.080767 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080645    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-trusted-ca-bundle\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.080767 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.080657    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-config\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.082313 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.082278    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:01:57.082313 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.082303    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:01:57.082441 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.082340    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-kube-api-access-c7mnc" (OuterVolumeSpecName: "kube-api-access-c7mnc") pod "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" (UID: "c5b66513-b6c8-4cda-b6fa-d270fd86e8ad"). InnerVolumeSpecName "kube-api-access-c7mnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:01:57.181034 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.181002    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-serving-cert\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.181034 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.181031    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-service-ca\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.181196 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.181040    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-console-oauth-config\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.181196 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.181051    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7mnc\" (UniqueName: \"kubernetes.io/projected/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad-kube-api-access-c7mnc\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:01:57.645593 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.645570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85dcf6c7b5-l846d_c5b66513-b6c8-4cda-b6fa-d270fd86e8ad/console/0.log"
May 25 06:01:57.645770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.645607    2556 generic.go:358] "Generic (PLEG): container finished" podID="c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" containerID="cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286" exitCode=2
May 25 06:01:57.645770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.645639    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6c7b5-l846d" event={"ID":"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad","Type":"ContainerDied","Data":"cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286"}
May 25 06:01:57.645770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.645678    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85dcf6c7b5-l846d"
May 25 06:01:57.645770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.645688    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85dcf6c7b5-l846d" event={"ID":"c5b66513-b6c8-4cda-b6fa-d270fd86e8ad","Type":"ContainerDied","Data":"30906105f3c35448f36e9f3ef698caa41f3620e8db53006c3e65288539faf823"}
May 25 06:01:57.645770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.645727    2556 scope.go:117] "RemoveContainer" containerID="cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286"
May 25 06:01:57.653949 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.653762    2556 scope.go:117] "RemoveContainer" containerID="cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286"
May 25 06:01:57.654150 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:01:57.654000    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286\": container with ID starting with cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286 not found: ID does not exist" containerID="cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286"
May 25 06:01:57.654150 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.654024    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286"} err="failed to get container status \"cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286\": rpc error: code = NotFound desc = could not find container \"cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286\": container with ID starting with cd95cdc67bd7beb1553d05bef0a526a8fc7e0f262665bd8a42deed206f13a286 not found: ID does not exist"
May 25 06:01:57.664591 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.664567    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85dcf6c7b5-l846d"]
May 25 06:01:57.668096 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.668077    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85dcf6c7b5-l846d"]
May 25 06:01:57.703390 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:01:57.703365    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" path="/var/lib/kubelet/pods/c5b66513-b6c8-4cda-b6fa-d270fd86e8ad/volumes"
May 25 06:02:15.574491 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:02:15.574459    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:02:15.574993 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:02:15.574459    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:02:15.581508 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:02:15.581484    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:02:15.581953 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:02:15.581934    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:02:15.585255 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:02:15.585236    2556 kubelet.go:1628] "Image garbage collection succeeded"
May 25 06:03:53.092255 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.092217    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"]
May 25 06:03:53.092793 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.092699    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" containerName="console"
May 25 06:03:53.092793 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.092736    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" containerName="console"
May 25 06:03:53.092924 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.092822    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b66513-b6c8-4cda-b6fa-d270fd86e8ad" containerName="console"
May 25 06:03:53.096213 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.096193    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.098267 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098239    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 25 06:03:53.098381 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098239    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 25 06:03:53.098381 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098318    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-ll4dg\""
May 25 06:03:53.098564 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098545    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 25 06:03:53.098679 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098548    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 25 06:03:53.098679 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098665    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 25 06:03:53.098806 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098627    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 25 06:03:53.098806 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.098552    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 25 06:03:53.106169 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.106147    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"]
May 25 06:03:53.149404 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.149370    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vjcg\" (UniqueName: \"kubernetes.io/projected/1e85c117-198c-4e91-bfa8-a0103e85f896-kube-api-access-9vjcg\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.149602 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.149414    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-registry-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.149602 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.149433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e85c117-198c-4e91-bfa8-a0103e85f896-feast-data\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.149602 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.149514    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.149602 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.149581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.149806 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.149632    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-offline-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250198 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250166    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250373 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250208    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-offline-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250373 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250246    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjcg\" (UniqueName: \"kubernetes.io/projected/1e85c117-198c-4e91-bfa8-a0103e85f896-kube-api-access-9vjcg\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250373 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250269    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-registry-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250373 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250288    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e85c117-198c-4e91-bfa8-a0103e85f896-feast-data\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250373 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250306    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.250373 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:03:53.250319    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 25 06:03:53.250674 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:03:53.250394    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 25 06:03:53.250674 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:03:53.250404    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls podName:1e85c117-198c-4e91-bfa8-a0103e85f896 nodeName:}" failed. No retries permitted until 2026-05-25 06:03:53.750382549 +0000 UTC m=+398.656150595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls") pod "feast-simple-feast-setup-698647878b-9chb7" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896") : secret "feast-simple-feast-setup-ui-tls" not found
May 25 06:03:53.250674 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:03:53.250445    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls podName:1e85c117-198c-4e91-bfa8-a0103e85f896 nodeName:}" failed. No retries permitted until 2026-05-25 06:03:53.750430395 +0000 UTC m=+398.656198433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls") pod "feast-simple-feast-setup-698647878b-9chb7" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896") : secret "feast-simple-feast-setup-online-tls" not found
May 25 06:03:53.250864 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.250832    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e85c117-198c-4e91-bfa8-a0103e85f896-feast-data\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.252716 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.252681    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-registry-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.252816 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.252753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-offline-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.260445 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.260421    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjcg\" (UniqueName: \"kubernetes.io/projected/1e85c117-198c-4e91-bfa8-a0103e85f896-kube-api-access-9vjcg\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.753243 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.753210    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.753404 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.753252    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.755539 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.755516    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:53.755656 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:53.755587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls\") pod \"feast-simple-feast-setup-698647878b-9chb7\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:54.005324 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:54.005237    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:03:54.134557 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:54.134533    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"]
May 25 06:03:54.136490 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:03:54.136460    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e85c117_198c_4e91_bfa8_a0103e85f896.slice/crio-3acbe47e3f9212e80a6ed23ce9451d1f0cd16c517d676e9e76146719518637f6 WatchSource:0}: Error finding container 3acbe47e3f9212e80a6ed23ce9451d1f0cd16c517d676e9e76146719518637f6: Status 404 returned error can't find the container with id 3acbe47e3f9212e80a6ed23ce9451d1f0cd16c517d676e9e76146719518637f6
May 25 06:03:54.138128 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:54.138113    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:03:54.982850 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:03:54.982802    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"3acbe47e3f9212e80a6ed23ce9451d1f0cd16c517d676e9e76146719518637f6"}
May 25 06:04:27.083164 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:27.083126    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"}
May 25 06:04:31.095971 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:31.095933    2556 generic.go:358] "Generic (PLEG): container finished" podID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerID="8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf" exitCode=0
May 25 06:04:31.096329 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:31.095996    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"}
May 25 06:04:32.100218 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:32.100181    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"}
May 25 06:04:37.115835 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:37.115801    2556 generic.go:358] "Generic (PLEG): container finished" podID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerID="324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec" exitCode=0
May 25 06:04:37.116206 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:37.115860    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"}
May 25 06:04:37.120126 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:37.120104    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 25 06:04:38.124457 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:38.124412    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"}
May 25 06:04:38.124958 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:38.124468    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"}
May 25 06:04:38.124958 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:38.124484    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"}
May 25 06:04:38.124958 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:38.124498    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerStarted","Data":"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"}
May 25 06:04:38.147157 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:38.147090    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podStartSLOduration=13.072445777 podStartE2EDuration="45.147070274s" podCreationTimestamp="2026-05-25 06:03:53 +0000 UTC" firstStartedPulling="2026-05-25 06:03:54.138232755 +0000 UTC m=+399.044000784" lastFinishedPulling="2026-05-25 06:04:26.21285725 +0000 UTC m=+431.118625281" observedRunningTime="2026-05-25 06:04:38.14614795 +0000 UTC m=+443.051916012" watchObservedRunningTime="2026-05-25 06:04:38.147070274 +0000 UTC m=+443.052838326"
May 25 06:04:39.006483 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.006375    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:39.006483 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.006429    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:39.006483 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.006449    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:39.006835 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.006755    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:39.009004 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.008956    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 25 06:04:39.009124 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.008999    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
May 25 06:04:39.009124 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.009078    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused"
May 25 06:04:39.009292 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:39.009255    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 25 06:04:42.006456 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:42.006408    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused"
May 25 06:04:42.007081 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:42.006455    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused"
May 25 06:04:42.007208 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:42.006460    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 25 06:04:42.007208 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:42.006468    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 25 06:04:44.006040 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:44.005997    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:44.006040 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:44.006047    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:44.006454 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:44.006056    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:44.006454 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:44.006064    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.006539 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.006499    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.006946 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.006759    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.006946 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.006878    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.007431 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.007405    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.007557 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.007514    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.007893 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.007878    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.011170 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.011154    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:04:45.157485 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:04:45.157455    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:05:08.524224 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:08.524191    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5499b8b447-k6rv8"]
May 25 06:05:33.550160 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.550114    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5499b8b447-k6rv8" podUID="800b1621-588a-4ef5-83ef-2977314c8459" containerName="console" containerID="cri-o://a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb" gracePeriod=15
May 25 06:05:33.787136 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.787115    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5499b8b447-k6rv8_800b1621-588a-4ef5-83ef-2977314c8459/console/0.log"
May 25 06:05:33.787235 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.787172    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:05:33.902014 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.901984    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-oauth-serving-cert\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902188 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902050    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-oauth-config\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902188 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902151    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-service-ca\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902303 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902191    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txdmj\" (UniqueName: \"kubernetes.io/projected/800b1621-588a-4ef5-83ef-2977314c8459-kube-api-access-txdmj\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902303 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902220    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-trusted-ca-bundle\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902303 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902244    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-console-config\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902303 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902270    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-serving-cert\") pod \"800b1621-588a-4ef5-83ef-2977314c8459\" (UID: \"800b1621-588a-4ef5-83ef-2977314c8459\") "
May 25 06:05:33.902511 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902351    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:05:33.902563 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902507    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-service-ca" (OuterVolumeSpecName: "service-ca") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:05:33.902625 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902588    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-service-ca\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:33.902676 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902611    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-oauth-serving-cert\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:33.902676 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902637    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:05:33.902676 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.902642    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-console-config" (OuterVolumeSpecName: "console-config") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:05:33.904284 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.904247    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800b1621-588a-4ef5-83ef-2977314c8459-kube-api-access-txdmj" (OuterVolumeSpecName: "kube-api-access-txdmj") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "kube-api-access-txdmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:05:33.904397 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.904308    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:05:33.904397 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:33.904348    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "800b1621-588a-4ef5-83ef-2977314c8459" (UID: "800b1621-588a-4ef5-83ef-2977314c8459"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:05:34.002942 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.002919    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-serving-cert\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:34.002942 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.002939    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/800b1621-588a-4ef5-83ef-2977314c8459-console-oauth-config\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:34.003064 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.002948    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txdmj\" (UniqueName: \"kubernetes.io/projected/800b1621-588a-4ef5-83ef-2977314c8459-kube-api-access-txdmj\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:34.003064 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.002958    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-trusted-ca-bundle\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:34.003064 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.002967    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/800b1621-588a-4ef5-83ef-2977314c8459-console-config\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:05:34.299447 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.299367    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5499b8b447-k6rv8_800b1621-588a-4ef5-83ef-2977314c8459/console/0.log"
May 25 06:05:34.299447 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.299410    2556 generic.go:358] "Generic (PLEG): container finished" podID="800b1621-588a-4ef5-83ef-2977314c8459" containerID="a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb" exitCode=2
May 25 06:05:34.299620 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.299470    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5499b8b447-k6rv8"
May 25 06:05:34.299620 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.299491    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5499b8b447-k6rv8" event={"ID":"800b1621-588a-4ef5-83ef-2977314c8459","Type":"ContainerDied","Data":"a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb"}
May 25 06:05:34.299620 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.299525    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5499b8b447-k6rv8" event={"ID":"800b1621-588a-4ef5-83ef-2977314c8459","Type":"ContainerDied","Data":"60da1f95188d0d2fe22fa18c73e5f97a30b74813d464479a0ebd29c5b9a0d6ed"}
May 25 06:05:34.299620 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.299540    2556 scope.go:117] "RemoveContainer" containerID="a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb"
May 25 06:05:34.307566 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.307544    2556 scope.go:117] "RemoveContainer" containerID="a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb"
May 25 06:05:34.307823 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:05:34.307799    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb\": container with ID starting with a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb not found: ID does not exist" containerID="a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb"
May 25 06:05:34.307912 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.307834    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb"} err="failed to get container status \"a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb\": rpc error: code = NotFound desc = could not find container \"a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb\": container with ID starting with a4d4a262927129f00d125d1be3e5df507a18726c230537dcc63a4ebc2817f5bb not found: ID does not exist"
May 25 06:05:34.318551 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.318529    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5499b8b447-k6rv8"]
May 25 06:05:34.321894 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:34.321874    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5499b8b447-k6rv8"]
May 25 06:05:35.703418 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:35.703388    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800b1621-588a-4ef5-83ef-2977314c8459" path="/var/lib/kubelet/pods/800b1621-588a-4ef5-83ef-2977314c8459/volumes"
May 25 06:05:46.421429 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.421393    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"]
May 25 06:05:46.421937 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.421858    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="registry" containerID="cri-o://b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2" gracePeriod=30
May 25 06:05:46.422010 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.421922    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui" containerID="cri-o://10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e" gracePeriod=30
May 25 06:05:46.422062 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.421978    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online" containerID="cri-o://63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350" gracePeriod=30
May 25 06:05:46.422062 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.421938    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="offline" containerID="cri-o://398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12" gracePeriod=30
May 25 06:05:46.774361 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.774277    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-j884r"]
May 25 06:05:46.774796 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.774760    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800b1621-588a-4ef5-83ef-2977314c8459" containerName="console"
May 25 06:05:46.774796 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.774785    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="800b1621-588a-4ef5-83ef-2977314c8459" containerName="console"
May 25 06:05:46.774949 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.774870    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="800b1621-588a-4ef5-83ef-2977314c8459" containerName="console"
May 25 06:05:46.780085 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.780063    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:46.782055 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.782025    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4q8mj\""
May 25 06:05:46.789049 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.789026    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-j884r"]
May 25 06:05:46.900684 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.900649    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-offline-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:46.900827 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.900700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-ui-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:46.900827 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.900767    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:46.900827 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.900799    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxf5v\" (UniqueName: \"kubernetes.io/projected/3d4d0ddd-168b-40af-a3b1-1da7f323309d-kube-api-access-wxf5v\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:46.900979 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.900830    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-online-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:46.900979 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:46.900850    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0ddd-168b-40af-a3b1-1da7f323309d-feast-data\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.001788 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.001739    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-online-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.001788 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.001798    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0ddd-168b-40af-a3b1-1da7f323309d-feast-data\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.002015 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.001848    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-offline-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.002015 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.001992    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-ui-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.002117 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.002051    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.002117 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.002103    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxf5v\" (UniqueName: \"kubernetes.io/projected/3d4d0ddd-168b-40af-a3b1-1da7f323309d-kube-api-access-wxf5v\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.002244 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:05:47.002211    2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 25 06:05:47.002302 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.002258    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0ddd-168b-40af-a3b1-1da7f323309d-feast-data\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.002371 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:05:47.002313    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls podName:3d4d0ddd-168b-40af-a3b1-1da7f323309d nodeName:}" failed. No retries permitted until 2026-05-25 06:05:47.502287455 +0000 UTC m=+512.408055497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls") pod "feast-simple-feast-setup-698647878b-j884r" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d") : secret "feast-simple-feast-setup-registry-tls" not found
May 25 06:05:47.004305 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.004282    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-ui-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.004432 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.004332    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-online-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.004797 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.004778    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-offline-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.009770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.009749    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxf5v\" (UniqueName: \"kubernetes.io/projected/3d4d0ddd-168b-40af-a3b1-1da7f323309d-kube-api-access-wxf5v\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.341161 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.341126    2556 generic.go:358] "Generic (PLEG): container finished" podID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerID="10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e" exitCode=0
May 25 06:05:47.341161 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.341152    2556 generic.go:358] "Generic (PLEG): container finished" podID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerID="63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350" exitCode=0
May 25 06:05:47.341355 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.341183    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"}
May 25 06:05:47.341355 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.341216    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"}
May 25 06:05:47.505998 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.505956    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.508384 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.508361    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls\") pod \"feast-simple-feast-setup-698647878b-j884r\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") " pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.690958 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.690865    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:47.820105 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:47.820079    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-j884r"]
May 25 06:05:47.821990 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:05:47.821962    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d4d0ddd_168b_40af_a3b1_1da7f323309d.slice/crio-ec7381df202377dee63078ad16351a9ccb9b39fb1928bf5742dba6f59e087ea1 WatchSource:0}: Error finding container ec7381df202377dee63078ad16351a9ccb9b39fb1928bf5742dba6f59e087ea1: Status 404 returned error can't find the container with id ec7381df202377dee63078ad16351a9ccb9b39fb1928bf5742dba6f59e087ea1
May 25 06:05:48.345292 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:48.345259    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"8e6c138c4cfa0e3280fe9f383ad976d2011426a595eb467ada4e817fbd479f96"}
May 25 06:05:48.345292 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:48.345295    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"ec7381df202377dee63078ad16351a9ccb9b39fb1928bf5742dba6f59e087ea1"}
May 25 06:05:52.357422 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:52.357394    2556 generic.go:358] "Generic (PLEG): container finished" podID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerID="8e6c138c4cfa0e3280fe9f383ad976d2011426a595eb467ada4e817fbd479f96" exitCode=0
May 25 06:05:52.357817 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:52.357457    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"8e6c138c4cfa0e3280fe9f383ad976d2011426a595eb467ada4e817fbd479f96"}
May 25 06:05:53.361633 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:53.361597    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"edbb32679a66756d276ee4e329ec3dc7c048e4cd675788b01338eb7fdc4934cf"}
May 25 06:05:55.008202 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:55.008151    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 25 06:05:55.155051 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:55.155012    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 25 06:05:58.378469 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:58.378433    2556 generic.go:358] "Generic (PLEG): container finished" podID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerID="edbb32679a66756d276ee4e329ec3dc7c048e4cd675788b01338eb7fdc4934cf" exitCode=0
May 25 06:05:58.378851 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:58.378503    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"edbb32679a66756d276ee4e329ec3dc7c048e4cd675788b01338eb7fdc4934cf"}
May 25 06:05:59.386314 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.386273    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"c388dffd64c9d739bc887ac71c71922bdaa1b652d8262f68d325f1d71d7c3f5f"}
May 25 06:05:59.386794 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.386324    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"4ed56daf4742bad7d52fa32f9c543d037c6c507287bfd40f62fb7638e1e814f6"}
May 25 06:05:59.386794 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.386342    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"d64596cb0770ff97c5ce376b5c25d5f976c2629d1f29f3e0351ae43668b1cbc4"}
May 25 06:05:59.386794 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.386356    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerStarted","Data":"99e66d29a02f1826e762021abb2400ff7386b526e19a79dc367a946af374f97a"}
May 25 06:05:59.409647 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.409578    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podStartSLOduration=13.409558441 podStartE2EDuration="13.409558441s" podCreationTimestamp="2026-05-25 06:05:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:05:59.406949923 +0000 UTC m=+524.312717988" watchObservedRunningTime="2026-05-25 06:05:59.409558441 +0000 UTC m=+524.315326493"
May 25 06:05:59.691819 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.691697    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:59.691819 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.691776    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:59.691819 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.691791    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:59.691819 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.691803    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:05:59.693927 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.693880    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
May 25 06:05:59.694190 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.694153    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
May 25 06:05:59.694293 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.694178    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 25 06:05:59.694396 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:05:59.694164    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 25 06:06:02.691602 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:02.691496    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
May 25 06:06:02.692196 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:02.691503    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 25 06:06:02.692313 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:02.691542    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 25 06:06:02.692313 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:02.691751    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
May 25 06:06:05.007518 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.007463    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 25 06:06:05.154864 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.154821    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 25 06:06:05.692794 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.692758    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.693211 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.693186    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.693697 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.693673    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.693812 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.693724    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.693812 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.693740    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.693812 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.693794    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.693906 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.693838    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:05.697390 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:05.697370    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:06.412344 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:06.412315    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:06.412344 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:06.412348    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:06.412864 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:06.412793    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:06.415083 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:06.415063    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:06:15.007554 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:15.007505    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 25 06:06:15.007985 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:15.007653    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:06:15.155401 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:15.155355    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 25 06:06:15.155569 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:15.155493    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:06:17.065956 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.065922    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:06:17.163106 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163077    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vjcg\" (UniqueName: \"kubernetes.io/projected/1e85c117-198c-4e91-bfa8-a0103e85f896-kube-api-access-9vjcg\") pod \"1e85c117-198c-4e91-bfa8-a0103e85f896\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") "
May 25 06:06:17.163241 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163148    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-offline-tls\") pod \"1e85c117-198c-4e91-bfa8-a0103e85f896\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") "
May 25 06:06:17.163241 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163177    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-registry-tls\") pod \"1e85c117-198c-4e91-bfa8-a0103e85f896\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") "
May 25 06:06:17.163241 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163234    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls\") pod \"1e85c117-198c-4e91-bfa8-a0103e85f896\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") "
May 25 06:06:17.163399 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163259    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls\") pod \"1e85c117-198c-4e91-bfa8-a0103e85f896\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") "
May 25 06:06:17.163399 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163296    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e85c117-198c-4e91-bfa8-a0103e85f896-feast-data\") pod \"1e85c117-198c-4e91-bfa8-a0103e85f896\" (UID: \"1e85c117-198c-4e91-bfa8-a0103e85f896\") "
May 25 06:06:17.163880 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.163832    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e85c117-198c-4e91-bfa8-a0103e85f896-feast-data" (OuterVolumeSpecName: "feast-data") pod "1e85c117-198c-4e91-bfa8-a0103e85f896" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:06:17.165329 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.165303    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1e85c117-198c-4e91-bfa8-a0103e85f896" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:06:17.165597 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.165576    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls" (OuterVolumeSpecName: "online-tls") pod "1e85c117-198c-4e91-bfa8-a0103e85f896" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:06:17.165686 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.165659    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e85c117-198c-4e91-bfa8-a0103e85f896-kube-api-access-9vjcg" (OuterVolumeSpecName: "kube-api-access-9vjcg") pod "1e85c117-198c-4e91-bfa8-a0103e85f896" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896"). InnerVolumeSpecName "kube-api-access-9vjcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:06:17.165754 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.165700    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1e85c117-198c-4e91-bfa8-a0103e85f896" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:06:17.165792 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.165744    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1e85c117-198c-4e91-bfa8-a0103e85f896" (UID: "1e85c117-198c-4e91-bfa8-a0103e85f896"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:06:17.264739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.264671    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-online-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:06:17.264739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.264695    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-ui-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:06:17.264739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.264722    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1e85c117-198c-4e91-bfa8-a0103e85f896-feast-data\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:06:17.264739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.264730    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vjcg\" (UniqueName: \"kubernetes.io/projected/1e85c117-198c-4e91-bfa8-a0103e85f896-kube-api-access-9vjcg\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:06:17.264739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.264739    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-offline-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:06:17.264949 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.264748    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/1e85c117-198c-4e91-bfa8-a0103e85f896-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:06:17.446018 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.445984    2556 generic.go:358] "Generic (PLEG): container finished" podID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerID="398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12" exitCode=137
May 25 06:06:17.446018 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.446009    2556 generic.go:358] "Generic (PLEG): container finished" podID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerID="b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2" exitCode=137
May 25 06:06:17.446296 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.446038    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"}
May 25 06:06:17.446296 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.446059    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"
May 25 06:06:17.446296 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.446073    2556 scope.go:117] "RemoveContainer" containerID="10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"
May 25 06:06:17.446296 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.446064    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"}
May 25 06:06:17.446296 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.446206    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-9chb7" event={"ID":"1e85c117-198c-4e91-bfa8-a0103e85f896","Type":"ContainerDied","Data":"3acbe47e3f9212e80a6ed23ce9451d1f0cd16c517d676e9e76146719518637f6"}
May 25 06:06:17.454780 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.454763    2556 scope.go:117] "RemoveContainer" containerID="398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"
May 25 06:06:17.461806 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.461784    2556 scope.go:117] "RemoveContainer" containerID="63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"
May 25 06:06:17.466958 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.466885    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"]
May 25 06:06:17.469772 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.469749    2556 scope.go:117] "RemoveContainer" containerID="b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"
May 25 06:06:17.470389 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.470369    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-9chb7"]
May 25 06:06:17.476476 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.476461    2556 scope.go:117] "RemoveContainer" containerID="324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"
May 25 06:06:17.482942 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.482924    2556 scope.go:117] "RemoveContainer" containerID="8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"
May 25 06:06:17.489235 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.489220    2556 scope.go:117] "RemoveContainer" containerID="10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"
May 25 06:06:17.489463 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:06:17.489446    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e\": container with ID starting with 10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e not found: ID does not exist" containerID="10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"
May 25 06:06:17.489514 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.489482    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"} err="failed to get container status \"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e\": rpc error: code = NotFound desc = could not find container \"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e\": container with ID starting with 10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e not found: ID does not exist"
May 25 06:06:17.489514 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.489500    2556 scope.go:117] "RemoveContainer" containerID="398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"
May 25 06:06:17.489736 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:06:17.489718    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12\": container with ID starting with 398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12 not found: ID does not exist" containerID="398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"
May 25 06:06:17.489810 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.489749    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"} err="failed to get container status \"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12\": rpc error: code = NotFound desc = could not find container \"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12\": container with ID starting with 398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12 not found: ID does not exist"
May 25 06:06:17.489810 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.489771    2556 scope.go:117] "RemoveContainer" containerID="63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"
May 25 06:06:17.489979 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:06:17.489963    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350\": container with ID starting with 63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350 not found: ID does not exist" containerID="63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"
May 25 06:06:17.490041 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.489987    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"} err="failed to get container status \"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350\": rpc error: code = NotFound desc = could not find container \"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350\": container with ID starting with 63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350 not found: ID does not exist"
May 25 06:06:17.490041 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490006    2556 scope.go:117] "RemoveContainer" containerID="b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"
May 25 06:06:17.490200 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:06:17.490184    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2\": container with ID starting with b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2 not found: ID does not exist" containerID="b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"
May 25 06:06:17.490264 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490206    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"} err="failed to get container status \"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2\": rpc error: code = NotFound desc = could not find container \"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2\": container with ID starting with b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2 not found: ID does not exist"
May 25 06:06:17.490264 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490226    2556 scope.go:117] "RemoveContainer" containerID="324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"
May 25 06:06:17.490425 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:06:17.490410    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec\": container with ID starting with 324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec not found: ID does not exist" containerID="324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"
May 25 06:06:17.490486 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490431    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"} err="failed to get container status \"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec\": rpc error: code = NotFound desc = could not find container \"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec\": container with ID starting with 324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec not found: ID does not exist"
May 25 06:06:17.490486 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490448    2556 scope.go:117] "RemoveContainer" containerID="8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"
May 25 06:06:17.490638 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:06:17.490622    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf\": container with ID starting with 8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf not found: ID does not exist" containerID="8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"
May 25 06:06:17.490699 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490643    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"} err="failed to get container status \"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf\": rpc error: code = NotFound desc = could not find container \"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf\": container with ID starting with 8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf not found: ID does not exist"
May 25 06:06:17.490699 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490659    2556 scope.go:117] "RemoveContainer" containerID="10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"
May 25 06:06:17.490893 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490875    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e"} err="failed to get container status \"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e\": rpc error: code = NotFound desc = could not find container \"10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e\": container with ID starting with 10a0aef4bbab5b022dd6a565b5faf5f2d9b5dc3a627f40744c6aa8df62be637e not found: ID does not exist"
May 25 06:06:17.490941 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.490894    2556 scope.go:117] "RemoveContainer" containerID="398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"
May 25 06:06:17.491065 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491046    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12"} err="failed to get container status \"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12\": rpc error: code = NotFound desc = could not find container \"398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12\": container with ID starting with 398d0aa9f84586426e8fa0707ddcfff3a60f2ed89d641e2906a80453590e5a12 not found: ID does not exist"
May 25 06:06:17.491104 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491066    2556 scope.go:117] "RemoveContainer" containerID="63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"
May 25 06:06:17.491285 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491267    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350"} err="failed to get container status \"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350\": rpc error: code = NotFound desc = could not find container \"63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350\": container with ID starting with 63e912ba569d26be20359243a6385450f03b9cc8f3434d7a59f405a696d5f350 not found: ID does not exist"
May 25 06:06:17.491349 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491287    2556 scope.go:117] "RemoveContainer" containerID="b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"
May 25 06:06:17.491501 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491483    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2"} err="failed to get container status \"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2\": rpc error: code = NotFound desc = could not find container \"b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2\": container with ID starting with b595fa56db012362ce00e2ea5088f3b4a54651c2f6e60d9584641235f64fffc2 not found: ID does not exist"
May 25 06:06:17.491558 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491502    2556 scope.go:117] "RemoveContainer" containerID="324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"
May 25 06:06:17.491737 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491694    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec"} err="failed to get container status \"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec\": rpc error: code = NotFound desc = could not find container \"324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec\": container with ID starting with 324e930c7999026a9ba9864690829776f6ae658aa62114d7083377b7ea9a53ec not found: ID does not exist"
May 25 06:06:17.491802 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491738    2556 scope.go:117] "RemoveContainer" containerID="8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"
May 25 06:06:17.491953 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.491932    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf"} err="failed to get container status \"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf\": rpc error: code = NotFound desc = could not find container \"8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf\": container with ID starting with 8511bc8af9681f7978244fdf8bc195589aa72dd4c6a585809ebf1b8c07dbecbf not found: ID does not exist"
May 25 06:06:17.702779 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:06:17.702745    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" path="/var/lib/kubelet/pods/1e85c117-198c-4e91-bfa8-a0103e85f896/volumes"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.347582    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"]
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348327    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="offline"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348347    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="offline"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348396    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="feast-apply"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348405    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="feast-apply"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348415    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348425    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348459    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="feast-init"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348469    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="feast-init"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348489    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="registry"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348497    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="registry"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348511    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348520    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348645    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="ui"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348663    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="offline"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348675    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="online"
May 25 06:07:08.350734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.348693    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e85c117-198c-4e91-bfa8-a0103e85f896" containerName="registry"
May 25 06:07:08.354171 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.354147    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.356038 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356013    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 25 06:07:08.356155 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356063    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 25 06:07:08.356155 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356073    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 25 06:07:08.356155 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356071    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 25 06:07:08.356405 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356389    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 25 06:07:08.356459 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356445    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 25 06:07:08.356507 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356397    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-67gph\""
May 25 06:07:08.356746 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.356731    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 25 06:07:08.359906 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.359888    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"]
May 25 06:07:08.471044 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.471015    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.471191 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.471050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-ui-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.471191 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.471085    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.471191 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.471107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8d5f52d6-1dd4-499c-b957-059d357cc040-registry-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.471191 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.471122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5f52d6-1dd4-499c-b957-059d357cc040-feast-data\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.471343 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.471191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbjtl\" (UniqueName: \"kubernetes.io/projected/8d5f52d6-1dd4-499c-b957-059d357cc040-kube-api-access-jbjtl\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.572586 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.572551    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.572586 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.572587    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8d5f52d6-1dd4-499c-b957-059d357cc040-registry-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.572829 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.572602    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5f52d6-1dd4-499c-b957-059d357cc040-feast-data\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.572829 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.572642    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbjtl\" (UniqueName: \"kubernetes.io/projected/8d5f52d6-1dd4-499c-b957-059d357cc040-kube-api-access-jbjtl\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.572829 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:07:08.572733    2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 25 06:07:08.572829 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.572805    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.572829 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:07:08.572821    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls podName:8d5f52d6-1dd4-499c-b957-059d357cc040 nodeName:}" failed. No retries permitted until 2026-05-25 06:07:09.072799072 +0000 UTC m=+593.978567101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls") pod "feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 25 06:07:08.573060 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.572871    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-ui-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.573060 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:07:08.572892    2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 25 06:07:08.573060 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:07:08.572956    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls podName:8d5f52d6-1dd4-499c-b957-059d357cc040 nodeName:}" failed. No retries permitted until 2026-05-25 06:07:09.072937014 +0000 UTC m=+593.978705056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls") pod "feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 25 06:07:08.573158 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.573078    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5f52d6-1dd4-499c-b957-059d357cc040-feast-data\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.573359 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.573340    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8d5f52d6-1dd4-499c-b957-059d357cc040-registry-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.575231 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.575214    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-ui-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:08.582426 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:08.582404    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbjtl\" (UniqueName: \"kubernetes.io/projected/8d5f52d6-1dd4-499c-b957-059d357cc040-kube-api-access-jbjtl\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:09.077121 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.077093    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:09.077309 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.077132    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:09.079455 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.079430    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:09.079560 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.079466    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls\") pod \"feast-simple-feast-remote-setup-c88ddc8b7-jk6dq\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:09.263870 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.263837    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:09.391954 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.391924    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"]
May 25 06:07:09.393782 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:07:09.393755    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d5f52d6_1dd4_499c_b957_059d357cc040.slice/crio-d203eea224636c4ae7a4881d4d779884e01530ea5c15a0d994172167b7f132a2 WatchSource:0}: Error finding container d203eea224636c4ae7a4881d4d779884e01530ea5c15a0d994172167b7f132a2: Status 404 returned error can't find the container with id d203eea224636c4ae7a4881d4d779884e01530ea5c15a0d994172167b7f132a2
May 25 06:07:09.611401 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.611311    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerStarted","Data":"c956f6384ea4cd287d4ef58916149d22f2e523616fcf3a60a347908a23b8ac83"}
May 25 06:07:09.611401 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:09.611361    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerStarted","Data":"d203eea224636c4ae7a4881d4d779884e01530ea5c15a0d994172167b7f132a2"}
May 25 06:07:14.631641 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:14.631605    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerID="c956f6384ea4cd287d4ef58916149d22f2e523616fcf3a60a347908a23b8ac83" exitCode=0
May 25 06:07:14.632184 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:14.631653    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerDied","Data":"c956f6384ea4cd287d4ef58916149d22f2e523616fcf3a60a347908a23b8ac83"}
May 25 06:07:15.599108 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:15.599079    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:07:15.599500 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:15.599481    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:07:15.605131 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:15.605114    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:07:15.605955 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:15.605940    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:07:15.635668 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:15.635645    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerStarted","Data":"b362bd21c1b9e571b485e9ee89a23fe7f13a993ea9e6632616f3250b4c66298c"}
May 25 06:07:20.655099 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:20.655069    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerID="b362bd21c1b9e571b485e9ee89a23fe7f13a993ea9e6632616f3250b4c66298c" exitCode=0
May 25 06:07:20.655461 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:20.655149    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerDied","Data":"b362bd21c1b9e571b485e9ee89a23fe7f13a993ea9e6632616f3250b4c66298c"}
May 25 06:07:20.657962 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:20.657943    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 25 06:07:21.661316 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:21.661282    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerStarted","Data":"20023a1a49012a1ba89ca1bba11ee27d0d84ab6cff95b0b66b659dd1d965665d"}
May 25 06:07:21.661316 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:21.661322    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerStarted","Data":"8e5371e152d2b27c8d59898030c1faff2323a9cd72ee3beec8b5e66a6da4f014"}
May 25 06:07:21.661885 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:21.661332    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerStarted","Data":"d3af2a634c450ffa69f99e479c0b0951552d1ce64d1fe19d5b21b0ea66b9dba7"}
May 25 06:07:21.683205 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:21.683162    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podStartSLOduration=13.683148673 podStartE2EDuration="13.683148673s" podCreationTimestamp="2026-05-25 06:07:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:07:21.680965641 +0000 UTC m=+606.586733692" watchObservedRunningTime="2026-05-25 06:07:21.683148673 +0000 UTC m=+606.588916724"
May 25 06:07:24.264885 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:24.264846    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:24.264885 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:24.264894    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:24.265541 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:24.264908    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:24.266691 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:24.266653    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused"
May 25 06:07:24.266691 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:24.266677    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
May 25 06:07:24.266860 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:24.266668    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
May 25 06:07:27.265217 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.265186    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.265991 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.265963    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.266097 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.266015    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.266097 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.266055    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.273675 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.273650    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.680761 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.680733    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.680925 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.680771    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.681411 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.681396    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:07:27.683661 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:07:27.683637    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:08:29.643008 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.642967    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"]
May 25 06:08:29.643600 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.643308    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online" containerID="cri-o://d3af2a634c450ffa69f99e479c0b0951552d1ce64d1fe19d5b21b0ea66b9dba7" gracePeriod=30
May 25 06:08:29.643600 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.643368    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui" containerID="cri-o://20023a1a49012a1ba89ca1bba11ee27d0d84ab6cff95b0b66b659dd1d965665d" gracePeriod=30
May 25 06:08:29.643600 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.643427    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="offline" containerID="cri-o://8e5371e152d2b27c8d59898030c1faff2323a9cd72ee3beec8b5e66a6da4f014" gracePeriod=30
May 25 06:08:29.750896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.750866    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-j884r"]
May 25 06:08:29.751238 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.751181    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="registry" containerID="cri-o://99e66d29a02f1826e762021abb2400ff7386b526e19a79dc367a946af374f97a" gracePeriod=30
May 25 06:08:29.751343 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.751253    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="offline" containerID="cri-o://4ed56daf4742bad7d52fa32f9c543d037c6c507287bfd40f62fb7638e1e814f6" gracePeriod=30
May 25 06:08:29.751343 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.751279    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui" containerID="cri-o://c388dffd64c9d739bc887ac71c71922bdaa1b652d8262f68d325f1d71d7c3f5f" gracePeriod=30
May 25 06:08:29.751466 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:29.751409    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online" containerID="cri-o://d64596cb0770ff97c5ce376b5c25d5f976c2629d1f29f3e0351ae43668b1cbc4" gracePeriod=30
May 25 06:08:30.862867 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.862833    2556 generic.go:358] "Generic (PLEG): container finished" podID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerID="c388dffd64c9d739bc887ac71c71922bdaa1b652d8262f68d325f1d71d7c3f5f" exitCode=0
May 25 06:08:30.862867 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.862858    2556 generic.go:358] "Generic (PLEG): container finished" podID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerID="d64596cb0770ff97c5ce376b5c25d5f976c2629d1f29f3e0351ae43668b1cbc4" exitCode=0
May 25 06:08:30.863275 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.862905    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"c388dffd64c9d739bc887ac71c71922bdaa1b652d8262f68d325f1d71d7c3f5f"}
May 25 06:08:30.863275 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.862940    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"d64596cb0770ff97c5ce376b5c25d5f976c2629d1f29f3e0351ae43668b1cbc4"}
May 25 06:08:30.864915 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.864897    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerID="20023a1a49012a1ba89ca1bba11ee27d0d84ab6cff95b0b66b659dd1d965665d" exitCode=0
May 25 06:08:30.864966 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.864916    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerID="d3af2a634c450ffa69f99e479c0b0951552d1ce64d1fe19d5b21b0ea66b9dba7" exitCode=0
May 25 06:08:30.865000 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.864966    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerDied","Data":"20023a1a49012a1ba89ca1bba11ee27d0d84ab6cff95b0b66b659dd1d965665d"}
May 25 06:08:30.865000 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:30.864992    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerDied","Data":"d3af2a634c450ffa69f99e479c0b0951552d1ce64d1fe19d5b21b0ea66b9dba7"}
May 25 06:08:36.413318 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:36.413271    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 25 06:08:36.413769 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:36.413274    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 25 06:08:37.680883 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:37.680837    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
May 25 06:08:37.681257 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:37.680854    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
May 25 06:08:46.412828 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:46.412783    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 25 06:08:46.413214 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:46.412795    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 25 06:08:47.680932 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:47.680896    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
May 25 06:08:47.681307 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:47.680891    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
May 25 06:08:56.412978 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:56.412929    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused"
May 25 06:08:56.413391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:56.413003    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
May 25 06:08:56.413391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:56.413083    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:08:56.413391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:56.413148    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:08:57.681038 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:57.680992    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused"
May 25 06:08:57.681438 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:57.681007    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused"
May 25 06:08:57.681438 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:57.681135    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:08:57.681438 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:57.681209    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:08:59.951167 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:59.951077    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerID="8e5371e152d2b27c8d59898030c1faff2323a9cd72ee3beec8b5e66a6da4f014" exitCode=137
May 25 06:08:59.951167 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:59.951143    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerDied","Data":"8e5371e152d2b27c8d59898030c1faff2323a9cd72ee3beec8b5e66a6da4f014"}
May 25 06:08:59.953629 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:59.953608    2556 generic.go:358] "Generic (PLEG): container finished" podID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerID="4ed56daf4742bad7d52fa32f9c543d037c6c507287bfd40f62fb7638e1e814f6" exitCode=137
May 25 06:08:59.953629 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:59.953629    2556 generic.go:358] "Generic (PLEG): container finished" podID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerID="99e66d29a02f1826e762021abb2400ff7386b526e19a79dc367a946af374f97a" exitCode=137
May 25 06:08:59.953811 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:59.953647    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"4ed56daf4742bad7d52fa32f9c543d037c6c507287bfd40f62fb7638e1e814f6"}
May 25 06:08:59.953811 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:08:59.953665    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"99e66d29a02f1826e762021abb2400ff7386b526e19a79dc367a946af374f97a"}
May 25 06:09:00.296858 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.296839    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:09:00.397766 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.397745    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:09:00.455798 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.455732    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls\") pod \"8d5f52d6-1dd4-499c-b957-059d357cc040\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") "
May 25 06:09:00.455925 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.455797    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls\") pod \"8d5f52d6-1dd4-499c-b957-059d357cc040\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") "
May 25 06:09:00.455925 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.455831    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbjtl\" (UniqueName: \"kubernetes.io/projected/8d5f52d6-1dd4-499c-b957-059d357cc040-kube-api-access-jbjtl\") pod \"8d5f52d6-1dd4-499c-b957-059d357cc040\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") "
May 25 06:09:00.455925 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.455881    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-ui-tls\") pod \"8d5f52d6-1dd4-499c-b957-059d357cc040\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") "
May 25 06:09:00.455925 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.455902    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8d5f52d6-1dd4-499c-b957-059d357cc040-registry-tls\") pod \"8d5f52d6-1dd4-499c-b957-059d357cc040\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") "
May 25 06:09:00.456114 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.455929    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5f52d6-1dd4-499c-b957-059d357cc040-feast-data\") pod \"8d5f52d6-1dd4-499c-b957-059d357cc040\" (UID: \"8d5f52d6-1dd4-499c-b957-059d357cc040\") "
May 25 06:09:00.456315 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.456292    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d5f52d6-1dd4-499c-b957-059d357cc040-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8d5f52d6-1dd4-499c-b957-059d357cc040" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 06:09:00.456537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.456506    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d5f52d6-1dd4-499c-b957-059d357cc040-feast-data" (OuterVolumeSpecName: "feast-data") pod "8d5f52d6-1dd4-499c-b957-059d357cc040" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:09:00.457992 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.457965    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls" (OuterVolumeSpecName: "online-tls") pod "8d5f52d6-1dd4-499c-b957-059d357cc040" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.458075 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.457988    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "8d5f52d6-1dd4-499c-b957-059d357cc040" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.458252 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.458236    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "8d5f52d6-1dd4-499c-b957-059d357cc040" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.458297 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.458247    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d5f52d6-1dd4-499c-b957-059d357cc040-kube-api-access-jbjtl" (OuterVolumeSpecName: "kube-api-access-jbjtl") pod "8d5f52d6-1dd4-499c-b957-059d357cc040" (UID: "8d5f52d6-1dd4-499c-b957-059d357cc040"). InnerVolumeSpecName "kube-api-access-jbjtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:09:00.557381 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557359    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls\") pod \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") "
May 25 06:09:00.557477 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557415    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-offline-tls\") pod \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") "
May 25 06:09:00.557477 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557434    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-online-tls\") pod \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") "
May 25 06:09:00.557477 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557450    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0ddd-168b-40af-a3b1-1da7f323309d-feast-data\") pod \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") "
May 25 06:09:00.557694 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557485    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-ui-tls\") pod \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") "
May 25 06:09:00.557694 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557503    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxf5v\" (UniqueName: \"kubernetes.io/projected/3d4d0ddd-168b-40af-a3b1-1da7f323309d-kube-api-access-wxf5v\") pod \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\" (UID: \"3d4d0ddd-168b-40af-a3b1-1da7f323309d\") "
May 25 06:09:00.557694 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557667    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-ui-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.557694 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557684    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/8d5f52d6-1dd4-499c-b957-059d357cc040-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.557871 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557698    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8d5f52d6-1dd4-499c-b957-059d357cc040-feast-data\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.557871 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557734    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-offline-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.558355 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.558322    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4d0ddd-168b-40af-a3b1-1da7f323309d-feast-data" (OuterVolumeSpecName: "feast-data") pod "3d4d0ddd-168b-40af-a3b1-1da7f323309d" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:09:00.558441 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.557747    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8d5f52d6-1dd4-499c-b957-059d357cc040-online-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.558498 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.558455    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbjtl\" (UniqueName: \"kubernetes.io/projected/8d5f52d6-1dd4-499c-b957-059d357cc040-kube-api-access-jbjtl\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.559660 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.559629    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3d4d0ddd-168b-40af-a3b1-1da7f323309d" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.559897 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.559871    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d4d0ddd-168b-40af-a3b1-1da7f323309d" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.559995 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.559927    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3d4d0ddd-168b-40af-a3b1-1da7f323309d" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.564466 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.561318    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-online-tls" (OuterVolumeSpecName: "online-tls") pod "3d4d0ddd-168b-40af-a3b1-1da7f323309d" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:09:00.564466 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.561330    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4d0ddd-168b-40af-a3b1-1da7f323309d-kube-api-access-wxf5v" (OuterVolumeSpecName: "kube-api-access-wxf5v") pod "3d4d0ddd-168b-40af-a3b1-1da7f323309d" (UID: "3d4d0ddd-168b-40af-a3b1-1da7f323309d"). InnerVolumeSpecName "kube-api-access-wxf5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:09:00.659472 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.659453    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-offline-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.659575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.659475    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-online-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.659575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.659484    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0ddd-168b-40af-a3b1-1da7f323309d-feast-data\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.659575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.659492    2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-ui-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.659575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.659502    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxf5v\" (UniqueName: \"kubernetes.io/projected/3d4d0ddd-168b-40af-a3b1-1da7f323309d-kube-api-access-wxf5v\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.659575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.659510    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3d4d0ddd-168b-40af-a3b1-1da7f323309d-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:09:00.959048 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.958975    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r" event={"ID":"3d4d0ddd-168b-40af-a3b1-1da7f323309d","Type":"ContainerDied","Data":"ec7381df202377dee63078ad16351a9ccb9b39fb1928bf5742dba6f59e087ea1"}
May 25 06:09:00.959048 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.959013    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-698647878b-j884r"
May 25 06:09:00.959048 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.959027    2556 scope.go:117] "RemoveContainer" containerID="c388dffd64c9d739bc887ac71c71922bdaa1b652d8262f68d325f1d71d7c3f5f"
May 25 06:09:00.961552 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.961523    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq" event={"ID":"8d5f52d6-1dd4-499c-b957-059d357cc040","Type":"ContainerDied","Data":"d203eea224636c4ae7a4881d4d779884e01530ea5c15a0d994172167b7f132a2"}
May 25 06:09:00.961648 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.961563    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"
May 25 06:09:00.971220 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.971200    2556 scope.go:117] "RemoveContainer" containerID="4ed56daf4742bad7d52fa32f9c543d037c6c507287bfd40f62fb7638e1e814f6"
May 25 06:09:00.978594 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.978578    2556 scope.go:117] "RemoveContainer" containerID="d64596cb0770ff97c5ce376b5c25d5f976c2629d1f29f3e0351ae43668b1cbc4"
May 25 06:09:00.983203 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.983183    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-j884r"]
May 25 06:09:00.986017 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.985997    2556 scope.go:117] "RemoveContainer" containerID="99e66d29a02f1826e762021abb2400ff7386b526e19a79dc367a946af374f97a"
May 25 06:09:00.986618 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.986595    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-698647878b-j884r"]
May 25 06:09:00.993105 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.993090    2556 scope.go:117] "RemoveContainer" containerID="edbb32679a66756d276ee4e329ec3dc7c048e4cd675788b01338eb7fdc4934cf"
May 25 06:09:00.996316 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.996296    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"]
May 25 06:09:00.999257 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:00.999237    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c88ddc8b7-jk6dq"]
May 25 06:09:01.001264 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.001252    2556 scope.go:117] "RemoveContainer" containerID="8e6c138c4cfa0e3280fe9f383ad976d2011426a595eb467ada4e817fbd479f96"
May 25 06:09:01.007643 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.007628    2556 scope.go:117] "RemoveContainer" containerID="20023a1a49012a1ba89ca1bba11ee27d0d84ab6cff95b0b66b659dd1d965665d"
May 25 06:09:01.014390 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.014375    2556 scope.go:117] "RemoveContainer" containerID="8e5371e152d2b27c8d59898030c1faff2323a9cd72ee3beec8b5e66a6da4f014"
May 25 06:09:01.020738 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.020721    2556 scope.go:117] "RemoveContainer" containerID="d3af2a634c450ffa69f99e479c0b0951552d1ce64d1fe19d5b21b0ea66b9dba7"
May 25 06:09:01.027127 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.027110    2556 scope.go:117] "RemoveContainer" containerID="b362bd21c1b9e571b485e9ee89a23fe7f13a993ea9e6632616f3250b4c66298c"
May 25 06:09:01.033327 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.033311    2556 scope.go:117] "RemoveContainer" containerID="c956f6384ea4cd287d4ef58916149d22f2e523616fcf3a60a347908a23b8ac83"
May 25 06:09:01.703438 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.703393    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" path="/var/lib/kubelet/pods/3d4d0ddd-168b-40af-a3b1-1da7f323309d/volumes"
May 25 06:09:01.704107 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:01.704083    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" path="/var/lib/kubelet/pods/8d5f52d6-1dd4-499c-b957-059d357cc040/volumes"
May 25 06:09:12.633250 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633215    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ccstp"]
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633573    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="feast-init"
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633590    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="feast-init"
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633610    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online"
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633618    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online"
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633628    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online"
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633636    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online"
May 25 06:09:12.633646 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633646    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633654    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633668    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="registry"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633675    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="registry"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633684    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633691    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633699    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="feast-apply"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633725    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="feast-apply"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633737    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="offline"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633744    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="offline"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633762    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="feast-init"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633769    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="feast-init"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633777    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="feast-apply"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633785    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="feast-apply"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633793    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="offline"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633801    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="offline"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633881    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="ui"
May 25 06:09:12.633896 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633893    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="registry"
May 25 06:09:12.634501 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633907    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="ui"
May 25 06:09:12.634501 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633916    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="online"
May 25 06:09:12.634501 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633925    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="online"
May 25 06:09:12.634501 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633934    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d5f52d6-1dd4-499c-b957-059d357cc040" containerName="offline"
May 25 06:09:12.634501 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.633943    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3d4d0ddd-168b-40af-a3b1-1da7f323309d" containerName="offline"
May 25 06:09:12.636754 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.636734    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.638870 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.638841    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-jkn4f\""
May 25 06:09:12.638987 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.638854    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 25 06:09:12.639268 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.639245    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 25 06:09:12.642542 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.642489    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 25 06:09:12.644941 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.644871    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ccstp"]
May 25 06:09:12.758201 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.758173    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-postgresdata\") pod \"postgres-7c7656cc6d-ccstp\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") " pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.758347 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.758208    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdj9q\" (UniqueName: \"kubernetes.io/projected/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-kube-api-access-sdj9q\") pod \"postgres-7c7656cc6d-ccstp\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") " pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.859388 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.859356    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-postgresdata\") pod \"postgres-7c7656cc6d-ccstp\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") " pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.859537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.859418    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdj9q\" (UniqueName: \"kubernetes.io/projected/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-kube-api-access-sdj9q\") pod \"postgres-7c7656cc6d-ccstp\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") " pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.859729 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.859693    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-postgresdata\") pod \"postgres-7c7656cc6d-ccstp\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") " pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.867211 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.867191    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdj9q\" (UniqueName: \"kubernetes.io/projected/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-kube-api-access-sdj9q\") pod \"postgres-7c7656cc6d-ccstp\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") " pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:12.947545 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:12.947480    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:09:13.071013 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:13.070888    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ccstp"]
May 25 06:09:13.073607 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:09:13.073582    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ff3ea05_b7de_4dda_8765_2bcdda4070a4.slice/crio-150a49a28228e7a17b9b8ea7ca2d02d60ab3bc5cab28049e69c3ac2ed48c53f7 WatchSource:0}: Error finding container 150a49a28228e7a17b9b8ea7ca2d02d60ab3bc5cab28049e69c3ac2ed48c53f7: Status 404 returned error can't find the container with id 150a49a28228e7a17b9b8ea7ca2d02d60ab3bc5cab28049e69c3ac2ed48c53f7
May 25 06:09:13.075187 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:13.075162    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:09:14.000801 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:14.000743    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ccstp" event={"ID":"9ff3ea05-b7de-4dda-8765-2bcdda4070a4","Type":"ContainerStarted","Data":"150a49a28228e7a17b9b8ea7ca2d02d60ab3bc5cab28049e69c3ac2ed48c53f7"}
May 25 06:09:18.828882 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:18.828860    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 25 06:09:19.015408 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:19.015372    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ccstp" event={"ID":"9ff3ea05-b7de-4dda-8765-2bcdda4070a4","Type":"ContainerStarted","Data":"eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29"}
May 25 06:09:19.029661 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:19.029616    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-ccstp" podStartSLOduration=1.278371637 podStartE2EDuration="7.029602209s" podCreationTimestamp="2026-05-25 06:09:12 +0000 UTC" firstStartedPulling="2026-05-25 06:09:13.075350598 +0000 UTC m=+717.981118632" lastFinishedPulling="2026-05-25 06:09:18.826581164 +0000 UTC m=+723.732349204" observedRunningTime="2026-05-25 06:09:19.028370014 +0000 UTC m=+723.934138067" watchObservedRunningTime="2026-05-25 06:09:19.029602209 +0000 UTC m=+723.935370260"
May 25 06:09:23.364255 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.364221    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"]
May 25 06:09:23.370657 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.370630    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.372592 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.372572    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 25 06:09:23.372726 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.372626    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 25 06:09:23.372726 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.372576    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 25 06:09:23.372726 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.372591    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-5vnkn\""
May 25 06:09:23.372928 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.372601    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 25 06:09:23.378481 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.378463    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"]
May 25 06:09:23.444026 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.443993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzsf6\" (UniqueName: \"kubernetes.io/projected/3a33b70f-4b6b-42bf-8483-f700ba857a48-kube-api-access-tzsf6\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.444026 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.444025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-online-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.444258 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.444056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a33b70f-4b6b-42bf-8483-f700ba857a48-feast-data\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.444258 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.444187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-offline-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.444258 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.444226    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-registry-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.544812 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.544779    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a33b70f-4b6b-42bf-8483-f700ba857a48-feast-data\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.544948 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.544854    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-offline-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.544948 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.544879    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-registry-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.545034 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.544997    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzsf6\" (UniqueName: \"kubernetes.io/projected/3a33b70f-4b6b-42bf-8483-f700ba857a48-kube-api-access-tzsf6\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.545067 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.545031    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-online-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.545247 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.545224    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a33b70f-4b6b-42bf-8483-f700ba857a48-feast-data\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.547457 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.547431    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-registry-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.547565 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.547431    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-offline-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.547565 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.547476    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-online-tls\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.551808 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.551783    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzsf6\" (UniqueName: \"kubernetes.io/projected/3a33b70f-4b6b-42bf-8483-f700ba857a48-kube-api-access-tzsf6\") pod \"feast-credit-scoring-76b8f8c964-587kd\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") " pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.680970 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.680875    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:23.809137 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:23.809113    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"]
May 25 06:09:23.811796 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:09:23.811774    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a33b70f_4b6b_42bf_8483_f700ba857a48.slice/crio-8186cff96928d01d9ede2815cf38e72a939ff8e21ab2a256d20439c59a2eb1a6 WatchSource:0}: Error finding container 8186cff96928d01d9ede2815cf38e72a939ff8e21ab2a256d20439c59a2eb1a6: Status 404 returned error can't find the container with id 8186cff96928d01d9ede2815cf38e72a939ff8e21ab2a256d20439c59a2eb1a6
May 25 06:09:24.032581 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:24.032500    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerStarted","Data":"96190fec859e29d95dc576f824570093d7c6687f55b6121988e59bd1808045d9"}
May 25 06:09:24.032581 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:24.032536    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerStarted","Data":"8186cff96928d01d9ede2815cf38e72a939ff8e21ab2a256d20439c59a2eb1a6"}
May 25 06:09:25.036917 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:25.036879    2556 generic.go:358] "Generic (PLEG): container finished" podID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerID="96190fec859e29d95dc576f824570093d7c6687f55b6121988e59bd1808045d9" exitCode=0
May 25 06:09:25.037387 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:25.036967    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerDied","Data":"96190fec859e29d95dc576f824570093d7c6687f55b6121988e59bd1808045d9"}
May 25 06:09:26.041600 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:26.041566    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerStarted","Data":"e6f24b46e721578d907286c87858316c59558fb252c3efdf232bbc747f5b9b59"}
May 25 06:09:32.060695 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:32.060655    2556 generic.go:358] "Generic (PLEG): container finished" podID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerID="e6f24b46e721578d907286c87858316c59558fb252c3efdf232bbc747f5b9b59" exitCode=0
May 25 06:09:32.061102 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:32.060728    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerDied","Data":"e6f24b46e721578d907286c87858316c59558fb252c3efdf232bbc747f5b9b59"}
May 25 06:09:33.066423 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.066383    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerStarted","Data":"67faf137bc3167e7938fb7fe6617688c099bb93bfd6d7f7e2b5791941d6d9f5b"}
May 25 06:09:33.066423 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.066427    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerStarted","Data":"b7c0336fb4579220a863c7d0a2936814439cbb19a312f523b6b935fea26a3e9b"}
May 25 06:09:33.067110 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.066436    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerStarted","Data":"db10d791c13b78e280fe83f2749b9625133ad91a3b000bb2682ea788d579a659"}
May 25 06:09:33.088835 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.088777    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podStartSLOduration=10.08875643 podStartE2EDuration="10.08875643s" podCreationTimestamp="2026-05-25 06:09:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:09:33.085812835 +0000 UTC m=+737.991580889" watchObservedRunningTime="2026-05-25 06:09:33.08875643 +0000 UTC m=+737.994524482"
May 25 06:09:33.681519 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.681475    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:33.681681 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.681532    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:33.681681 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:33.681547    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:35.681949 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:35.681911    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:35.682504 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:35.682477    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:35.682504 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:35.682506    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:35.683909 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:35.683876    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
May 25 06:09:35.684014 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:35.683927    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 25 06:09:35.684014 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:35.683876    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
May 25 06:09:38.681873 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:38.681825    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
May 25 06:09:38.682483 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:38.682457    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:38.683434 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:38.683415    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:38.687190 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:38.687172    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:39.090638 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:39.090609    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:41.681359 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:41.681313    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
May 25 06:09:44.682179 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:44.682146    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:09:44.682794 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:09:44.682779    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:10:43.939831 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:43.939793    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"]
May 25 06:10:43.940391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:43.940108    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry" containerID="cri-o://db10d791c13b78e280fe83f2749b9625133ad91a3b000bb2682ea788d579a659" gracePeriod=30
May 25 06:10:43.940391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:43.940149    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online" containerID="cri-o://b7c0336fb4579220a863c7d0a2936814439cbb19a312f523b6b935fea26a3e9b" gracePeriod=30
May 25 06:10:43.940391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:43.940144    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="offline" containerID="cri-o://67faf137bc3167e7938fb7fe6617688c099bb93bfd6d7f7e2b5791941d6d9f5b" gracePeriod=30
May 25 06:10:43.955099 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:43.955071    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ccstp"]
May 25 06:10:43.955261 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:43.955229    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-ccstp" podUID="9ff3ea05-b7de-4dda-8765-2bcdda4070a4" containerName="postgres" containerID="cri-o://eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29" gracePeriod=30
May 25 06:10:44.196094 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.196040    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:10:44.279694 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.279662    2556 generic.go:358] "Generic (PLEG): container finished" podID="9ff3ea05-b7de-4dda-8765-2bcdda4070a4" containerID="eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29" exitCode=0
May 25 06:10:44.279860 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.279741    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-ccstp"
May 25 06:10:44.279860 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.279743    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ccstp" event={"ID":"9ff3ea05-b7de-4dda-8765-2bcdda4070a4","Type":"ContainerDied","Data":"eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29"}
May 25 06:10:44.279860 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.279850    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-ccstp" event={"ID":"9ff3ea05-b7de-4dda-8765-2bcdda4070a4","Type":"ContainerDied","Data":"150a49a28228e7a17b9b8ea7ca2d02d60ab3bc5cab28049e69c3ac2ed48c53f7"}
May 25 06:10:44.279961 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.279871    2556 scope.go:117] "RemoveContainer" containerID="eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29"
May 25 06:10:44.287454 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.287438    2556 scope.go:117] "RemoveContainer" containerID="eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29"
May 25 06:10:44.287731 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:10:44.287690    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29\": container with ID starting with eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29 not found: ID does not exist" containerID="eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29"
May 25 06:10:44.287842 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.287741    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29"} err="failed to get container status \"eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29\": rpc error: code = NotFound desc = could not find container \"eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29\": container with ID starting with eaec0fea2b1c04d7d59753fdfdd5b3f7ece34ce1a29df5cf40351aef83502c29 not found: ID does not exist"
May 25 06:10:44.320087 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.320056    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-postgresdata\") pod \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") "
May 25 06:10:44.320197 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.320177    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdj9q\" (UniqueName: \"kubernetes.io/projected/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-kube-api-access-sdj9q\") pod \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\" (UID: \"9ff3ea05-b7de-4dda-8765-2bcdda4070a4\") "
May 25 06:10:44.322137 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.322112    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-kube-api-access-sdj9q" (OuterVolumeSpecName: "kube-api-access-sdj9q") pod "9ff3ea05-b7de-4dda-8765-2bcdda4070a4" (UID: "9ff3ea05-b7de-4dda-8765-2bcdda4070a4"). InnerVolumeSpecName "kube-api-access-sdj9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:10:44.352166 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.352132    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "9ff3ea05-b7de-4dda-8765-2bcdda4070a4" (UID: "9ff3ea05-b7de-4dda-8765-2bcdda4070a4"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:10:44.421262 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.421222    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdj9q\" (UniqueName: \"kubernetes.io/projected/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-kube-api-access-sdj9q\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:10:44.421262 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.421258    2556 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/9ff3ea05-b7de-4dda-8765-2bcdda4070a4-postgresdata\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:10:44.600085 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.600058    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ccstp"]
May 25 06:10:44.602950 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:44.602930    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-ccstp"]
May 25 06:10:45.285734 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:45.285686    2556 generic.go:358] "Generic (PLEG): container finished" podID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerID="b7c0336fb4579220a863c7d0a2936814439cbb19a312f523b6b935fea26a3e9b" exitCode=0
May 25 06:10:45.286098 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:45.285734    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerDied","Data":"b7c0336fb4579220a863c7d0a2936814439cbb19a312f523b6b935fea26a3e9b"}
May 25 06:10:45.703062 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:45.703029    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff3ea05-b7de-4dda-8765-2bcdda4070a4" path="/var/lib/kubelet/pods/9ff3ea05-b7de-4dda-8765-2bcdda4070a4/volumes"
May 25 06:10:49.087383 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:49.087342    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 25 06:10:59.087297 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:10:59.087249    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 25 06:11:09.087512 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:09.087469    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 25 06:11:09.087913 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:09.087601    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:11:14.370608 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.370563    2556 generic.go:358] "Generic (PLEG): container finished" podID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerID="67faf137bc3167e7938fb7fe6617688c099bb93bfd6d7f7e2b5791941d6d9f5b" exitCode=137
May 25 06:11:14.370608 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.370601    2556 generic.go:358] "Generic (PLEG): container finished" podID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerID="db10d791c13b78e280fe83f2749b9625133ad91a3b000bb2682ea788d579a659" exitCode=137
May 25 06:11:14.371026 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.370637    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerDied","Data":"67faf137bc3167e7938fb7fe6617688c099bb93bfd6d7f7e2b5791941d6d9f5b"}
May 25 06:11:14.371026 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.370668    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerDied","Data":"db10d791c13b78e280fe83f2749b9625133ad91a3b000bb2682ea788d579a659"}
May 25 06:11:14.588024 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.588000    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:11:14.670658 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.670544    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-offline-tls\") pod \"3a33b70f-4b6b-42bf-8483-f700ba857a48\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") "
May 25 06:11:14.670658 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.670606    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a33b70f-4b6b-42bf-8483-f700ba857a48-feast-data\") pod \"3a33b70f-4b6b-42bf-8483-f700ba857a48\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") "
May 25 06:11:14.670658 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.670634    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-online-tls\") pod \"3a33b70f-4b6b-42bf-8483-f700ba857a48\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") "
May 25 06:11:14.670975 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.670677    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-registry-tls\") pod \"3a33b70f-4b6b-42bf-8483-f700ba857a48\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") "
May 25 06:11:14.670975 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.670734    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzsf6\" (UniqueName: \"kubernetes.io/projected/3a33b70f-4b6b-42bf-8483-f700ba857a48-kube-api-access-tzsf6\") pod \"3a33b70f-4b6b-42bf-8483-f700ba857a48\" (UID: \"3a33b70f-4b6b-42bf-8483-f700ba857a48\") "
May 25 06:11:14.672903 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.672875    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-online-tls" (OuterVolumeSpecName: "online-tls") pod "3a33b70f-4b6b-42bf-8483-f700ba857a48" (UID: "3a33b70f-4b6b-42bf-8483-f700ba857a48"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:11:14.673031 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.673005    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3a33b70f-4b6b-42bf-8483-f700ba857a48" (UID: "3a33b70f-4b6b-42bf-8483-f700ba857a48"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:11:14.673218 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.673187    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3a33b70f-4b6b-42bf-8483-f700ba857a48" (UID: "3a33b70f-4b6b-42bf-8483-f700ba857a48"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:11:14.673315 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.673242    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a33b70f-4b6b-42bf-8483-f700ba857a48-kube-api-access-tzsf6" (OuterVolumeSpecName: "kube-api-access-tzsf6") pod "3a33b70f-4b6b-42bf-8483-f700ba857a48" (UID: "3a33b70f-4b6b-42bf-8483-f700ba857a48"). InnerVolumeSpecName "kube-api-access-tzsf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:11:14.679002 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.678981    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a33b70f-4b6b-42bf-8483-f700ba857a48-feast-data" (OuterVolumeSpecName: "feast-data") pod "3a33b70f-4b6b-42bf-8483-f700ba857a48" (UID: "3a33b70f-4b6b-42bf-8483-f700ba857a48"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:11:14.771891 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.771852    2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-offline-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:11:14.771891 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.771883    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a33b70f-4b6b-42bf-8483-f700ba857a48-feast-data\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:11:14.771891 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.771893    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-online-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:11:14.771891 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.771903    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a33b70f-4b6b-42bf-8483-f700ba857a48-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:11:14.772141 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:14.771912    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzsf6\" (UniqueName: \"kubernetes.io/projected/3a33b70f-4b6b-42bf-8483-f700ba857a48-kube-api-access-tzsf6\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:11:15.376328 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.376293    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd" event={"ID":"3a33b70f-4b6b-42bf-8483-f700ba857a48","Type":"ContainerDied","Data":"8186cff96928d01d9ede2815cf38e72a939ff8e21ab2a256d20439c59a2eb1a6"}
May 25 06:11:15.376797 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.376346    2556 scope.go:117] "RemoveContainer" containerID="67faf137bc3167e7938fb7fe6617688c099bb93bfd6d7f7e2b5791941d6d9f5b"
May 25 06:11:15.376797 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.376399    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"
May 25 06:11:15.385894 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.385870    2556 scope.go:117] "RemoveContainer" containerID="b7c0336fb4579220a863c7d0a2936814439cbb19a312f523b6b935fea26a3e9b"
May 25 06:11:15.393153 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.393135    2556 scope.go:117] "RemoveContainer" containerID="db10d791c13b78e280fe83f2749b9625133ad91a3b000bb2682ea788d579a659"
May 25 06:11:15.398231 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.398208    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"]
May 25 06:11:15.401082 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.401060    2556 scope.go:117] "RemoveContainer" containerID="e6f24b46e721578d907286c87858316c59558fb252c3efdf232bbc747f5b9b59"
May 25 06:11:15.405983 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.403055    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-76b8f8c964-587kd"]
May 25 06:11:15.413506 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.413479    2556 scope.go:117] "RemoveContainer" containerID="96190fec859e29d95dc576f824570093d7c6687f55b6121988e59bd1808045d9"
May 25 06:11:15.703787 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:11:15.703758    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" path="/var/lib/kubelet/pods/3a33b70f-4b6b-42bf-8483-f700ba857a48/volumes"
May 25 06:12:15.619236 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:15.619156    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:12:15.621619 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:15.621600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:12:15.625236 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:15.625211    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:12:15.627483 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:15.627466    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:12:40.963126 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963088    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-2nr7d"]
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963386    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963397    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963409    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff3ea05-b7de-4dda-8765-2bcdda4070a4" containerName="postgres"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963415    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff3ea05-b7de-4dda-8765-2bcdda4070a4" containerName="postgres"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963420    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="feast-init"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963426    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="feast-init"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963432    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="feast-apply"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963438    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="feast-apply"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963447    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963452    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963462    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="offline"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963467    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="offline"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963513    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="online"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963522    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="offline"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963531    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a33b70f-4b6b-42bf-8483-f700ba857a48" containerName="registry"
May 25 06:12:40.963604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.963538    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ff3ea05-b7de-4dda-8765-2bcdda4070a4" containerName="postgres"
May 25 06:12:40.966348 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.966331    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:12:40.968113 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.968090    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 25 06:12:40.968346 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.968326    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 25 06:12:40.968617 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.968595    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-sg5xs\""
May 25 06:12:40.975015 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:40.974983    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2nr7d"]
May 25 06:12:41.094054 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:41.094011    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzpzl\" (UniqueName: \"kubernetes.io/projected/407fd5a4-173f-40ab-8ec1-7f01ccc4d922-kube-api-access-jzpzl\") pod \"redis-854544c579-2nr7d\" (UID: \"407fd5a4-173f-40ab-8ec1-7f01ccc4d922\") " pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:12:41.194618 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:41.194575    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jzpzl\" (UniqueName: \"kubernetes.io/projected/407fd5a4-173f-40ab-8ec1-7f01ccc4d922-kube-api-access-jzpzl\") pod \"redis-854544c579-2nr7d\" (UID: \"407fd5a4-173f-40ab-8ec1-7f01ccc4d922\") " pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:12:41.202074 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:41.202042    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzpzl\" (UniqueName: \"kubernetes.io/projected/407fd5a4-173f-40ab-8ec1-7f01ccc4d922-kube-api-access-jzpzl\") pod \"redis-854544c579-2nr7d\" (UID: \"407fd5a4-173f-40ab-8ec1-7f01ccc4d922\") " pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:12:41.277146 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:41.277048    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:12:41.399466 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:41.399434    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2nr7d"]
May 25 06:12:41.402518 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:12:41.402487    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod407fd5a4_173f_40ab_8ec1_7f01ccc4d922.slice/crio-20384ba7ec20e4f6c5a989e6e1a249f30d238dda09fc41faa7956ef4bf74286f WatchSource:0}: Error finding container 20384ba7ec20e4f6c5a989e6e1a249f30d238dda09fc41faa7956ef4bf74286f: Status 404 returned error can't find the container with id 20384ba7ec20e4f6c5a989e6e1a249f30d238dda09fc41faa7956ef4bf74286f
May 25 06:12:41.626507 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:41.626461    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2nr7d" event={"ID":"407fd5a4-173f-40ab-8ec1-7f01ccc4d922","Type":"ContainerStarted","Data":"20384ba7ec20e4f6c5a989e6e1a249f30d238dda09fc41faa7956ef4bf74286f"}
May 25 06:12:43.633901 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:43.633861    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2nr7d" event={"ID":"407fd5a4-173f-40ab-8ec1-7f01ccc4d922","Type":"ContainerStarted","Data":"360c32d34b4d9f94bc6f097207d36acd6e9eac80983217b859c8aad85c83d5c7"}
May 25 06:12:43.647624 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:43.647571    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-2nr7d" podStartSLOduration=2.060879507 podStartE2EDuration="3.64755553s" podCreationTimestamp="2026-05-25 06:12:40 +0000 UTC" firstStartedPulling="2026-05-25 06:12:41.404148744 +0000 UTC m=+926.309916776" lastFinishedPulling="2026-05-25 06:12:42.990824768 +0000 UTC m=+927.896592799" observedRunningTime="2026-05-25 06:12:43.645763445 +0000 UTC m=+928.551531494" watchObservedRunningTime="2026-05-25 06:12:43.64755553 +0000 UTC m=+928.553323582"
May 25 06:12:46.417766 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.417721    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-grcsz"]
May 25 06:12:46.420866 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.420849    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.422824 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.422797    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 25 06:12:46.429466 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.429431    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-grcsz"]
May 25 06:12:46.544031 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.543988    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ba3783ab-c5e6-4869-93ba-20f81639f462-postgresdata\") pod \"postgres-7c7656cc6d-grcsz\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.544201 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.544041    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk84b\" (UniqueName: \"kubernetes.io/projected/ba3783ab-c5e6-4869-93ba-20f81639f462-kube-api-access-wk84b\") pod \"postgres-7c7656cc6d-grcsz\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.645218 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.645184    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ba3783ab-c5e6-4869-93ba-20f81639f462-postgresdata\") pod \"postgres-7c7656cc6d-grcsz\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.645218 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.645221    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wk84b\" (UniqueName: \"kubernetes.io/projected/ba3783ab-c5e6-4869-93ba-20f81639f462-kube-api-access-wk84b\") pod \"postgres-7c7656cc6d-grcsz\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.645600 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.645574    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ba3783ab-c5e6-4869-93ba-20f81639f462-postgresdata\") pod \"postgres-7c7656cc6d-grcsz\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.652198 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.652171    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk84b\" (UniqueName: \"kubernetes.io/projected/ba3783ab-c5e6-4869-93ba-20f81639f462-kube-api-access-wk84b\") pod \"postgres-7c7656cc6d-grcsz\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.730875 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.730797    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:12:46.849801 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:46.849765    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-grcsz"]
May 25 06:12:46.852699 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:12:46.852670    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba3783ab_c5e6_4869_93ba_20f81639f462.slice/crio-63da0397cf8191ee833f8b29729e883719fcb94a3d1fc41fcb0ad742df353cd1 WatchSource:0}: Error finding container 63da0397cf8191ee833f8b29729e883719fcb94a3d1fc41fcb0ad742df353cd1: Status 404 returned error can't find the container with id 63da0397cf8191ee833f8b29729e883719fcb94a3d1fc41fcb0ad742df353cd1
May 25 06:12:47.647032 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:47.646993    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz" event={"ID":"ba3783ab-c5e6-4869-93ba-20f81639f462","Type":"ContainerStarted","Data":"89bf1af0e520fbe798db824e0ec025700aec74b63462fa315c5f8710fb89fca0"}
May 25 06:12:47.647032 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:47.647030    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz" event={"ID":"ba3783ab-c5e6-4869-93ba-20f81639f462","Type":"ContainerStarted","Data":"63da0397cf8191ee833f8b29729e883719fcb94a3d1fc41fcb0ad742df353cd1"}
May 25 06:12:47.660104 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:47.660045    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz" podStartSLOduration=1.660025624 podStartE2EDuration="1.660025624s" podCreationTimestamp="2026-05-25 06:12:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:12:47.659179829 +0000 UTC m=+932.564947881" watchObservedRunningTime="2026-05-25 06:12:47.660025624 +0000 UTC m=+932.565793676"
May 25 06:12:52.090462 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.090423    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"]
May 25 06:12:52.096239 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.096219    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.098236 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.098215    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 25 06:12:52.098236 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.098229    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 25 06:12:52.098389 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.098259    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-g5hhd\""
May 25 06:12:52.098389 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.098273    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 25 06:12:52.105460 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.105441    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"]
May 25 06:12:52.191767 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.191740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4kf\" (UniqueName: \"kubernetes.io/projected/c047a103-89b0-41cd-be04-e1efb5336e27-kube-api-access-fs4kf\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.191890 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.191801    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-online-tls\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.191890 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.191868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-registry-tls\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.191961 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.191903    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c047a103-89b0-41cd-be04-e1efb5336e27-feast-data\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.293221 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.293191    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-online-tls\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.293320 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.293229    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-registry-tls\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.293320 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.293249    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c047a103-89b0-41cd-be04-e1efb5336e27-feast-data\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.293320 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.293280    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4kf\" (UniqueName: \"kubernetes.io/projected/c047a103-89b0-41cd-be04-e1efb5336e27-kube-api-access-fs4kf\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.293674 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.293652    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c047a103-89b0-41cd-be04-e1efb5336e27-feast-data\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.295571 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.295551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-online-tls\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.295737 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.295697    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-registry-tls\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.300880 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.300858    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4kf\" (UniqueName: \"kubernetes.io/projected/c047a103-89b0-41cd-be04-e1efb5336e27-kube-api-access-fs4kf\") pod \"feast-credit-scoring-5dd7bd7499-fjw4d\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") " pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.406589 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.406512    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:12:52.531624 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.531529    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"]
May 25 06:12:52.547814 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:12:52.534814    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc047a103_89b0_41cd_be04_e1efb5336e27.slice/crio-35b91e34c77c2393f69eab2b85fb658e5fa509152b0f5426650c6ad2cd6e0e9e WatchSource:0}: Error finding container 35b91e34c77c2393f69eab2b85fb658e5fa509152b0f5426650c6ad2cd6e0e9e: Status 404 returned error can't find the container with id 35b91e34c77c2393f69eab2b85fb658e5fa509152b0f5426650c6ad2cd6e0e9e
May 25 06:12:52.662398 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.662323    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerStarted","Data":"5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1"}
May 25 06:12:52.662398 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:52.662362    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerStarted","Data":"35b91e34c77c2393f69eab2b85fb658e5fa509152b0f5426650c6ad2cd6e0e9e"}
May 25 06:12:53.666513 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:53.666468    2556 generic.go:358] "Generic (PLEG): container finished" podID="c047a103-89b0-41cd-be04-e1efb5336e27" containerID="5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1" exitCode=0
May 25 06:12:53.666944 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:53.666529    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerDied","Data":"5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1"}
May 25 06:12:54.671768 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:12:54.671724    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerStarted","Data":"2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f"}
May 25 06:13:01.693929 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:01.693894    2556 generic.go:358] "Generic (PLEG): container finished" podID="c047a103-89b0-41cd-be04-e1efb5336e27" containerID="2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f" exitCode=0
May 25 06:13:01.694295 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:01.693970    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerDied","Data":"2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f"}
May 25 06:13:02.699910 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:02.699875    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerStarted","Data":"92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44"}
May 25 06:13:02.699910 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:02.699912    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerStarted","Data":"4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d"}
May 25 06:13:02.718066 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:02.718018    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podStartSLOduration=10.718000102 podStartE2EDuration="10.718000102s" podCreationTimestamp="2026-05-25 06:12:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:13:02.7169173 +0000 UTC m=+947.622685351" watchObservedRunningTime="2026-05-25 06:13:02.718000102 +0000 UTC m=+947.623768154"
May 25 06:13:04.407037 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:04.406995    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:04.407424 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:04.407054    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:04.408614 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:04.408584    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 25 06:13:04.408761 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:04.408629    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 25 06:13:07.406964 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:07.406907    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 25 06:13:07.707063 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:07.706976    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:07.707477 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:07.707455    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:07.710177 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:07.710153    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:10.406860 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:10.406809    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 25 06:13:12.406941 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:12.406903    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:13.408006 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:13.407979    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:13.408651 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:13.408631    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:13:17.947383 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.947349    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"]
May 25 06:13:17.952246 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.952224    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:17.953986 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.953969    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 25 06:13:17.954082 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.953996    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 25 06:13:17.954082 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.954059    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 25 06:13:17.954195 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.954126    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-gnflt\""
May 25 06:13:17.958919 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:17.958898    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"]
May 25 06:13:18.008585 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.008546    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7dbaa0d4-8af2-40c6-b370-5be68f191124-feast-data\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.008779 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.008601    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-registry-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.008779 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.008662    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.008779 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.008699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn7v4\" (UniqueName: \"kubernetes.io/projected/7dbaa0d4-8af2-40c6-b370-5be68f191124-kube-api-access-vn7v4\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.109660 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.109625    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7dbaa0d4-8af2-40c6-b370-5be68f191124-feast-data\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.109843 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.109668    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-registry-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.109843 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.109699    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.109843 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.109745    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vn7v4\" (UniqueName: \"kubernetes.io/projected/7dbaa0d4-8af2-40c6-b370-5be68f191124-kube-api-access-vn7v4\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.110015 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:13:18.109855    2556 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found
May 25 06:13:18.110015 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:13:18.109932    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls podName:7dbaa0d4-8af2-40c6-b370-5be68f191124 nodeName:}" failed. No retries permitted until 2026-05-25 06:13:18.609910985 +0000 UTC m=+963.515679021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls") pod "feast-driver-ranking-567d5bc98d-nvfc5" (UID: "7dbaa0d4-8af2-40c6-b370-5be68f191124") : secret "feast-driver-ranking-online-tls" not found
May 25 06:13:18.110133 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.110094    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7dbaa0d4-8af2-40c6-b370-5be68f191124-feast-data\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.112066 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.112046    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-registry-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.117391 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.117370    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn7v4\" (UniqueName: \"kubernetes.io/projected/7dbaa0d4-8af2-40c6-b370-5be68f191124-kube-api-access-vn7v4\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.615312 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.615267    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.617790 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.617755    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls\") pod \"feast-driver-ranking-567d5bc98d-nvfc5\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") " pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.862284 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.862240    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:18.996157 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:18.996125    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"]
May 25 06:13:18.998402 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:13:18.998371    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbaa0d4_8af2_40c6_b370_5be68f191124.slice/crio-7cf04d3092a6baf01ceccb0b6cd4c83e6af75ee8d3d702367b7b97ea85c2f725 WatchSource:0}: Error finding container 7cf04d3092a6baf01ceccb0b6cd4c83e6af75ee8d3d702367b7b97ea85c2f725: Status 404 returned error can't find the container with id 7cf04d3092a6baf01ceccb0b6cd4c83e6af75ee8d3d702367b7b97ea85c2f725
May 25 06:13:19.754476 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:19.754437    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerStarted","Data":"1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560"}
May 25 06:13:19.754476 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:19.754483    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerStarted","Data":"7cf04d3092a6baf01ceccb0b6cd4c83e6af75ee8d3d702367b7b97ea85c2f725"}
May 25 06:13:23.767562 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:23.767479    2556 generic.go:358] "Generic (PLEG): container finished" podID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerID="1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560" exitCode=0
May 25 06:13:23.767920 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:23.767552    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerDied","Data":"1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560"}
May 25 06:13:24.772771 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:24.772734    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerStarted","Data":"8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2"}
May 25 06:13:30.790820 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:30.790785    2556 generic.go:358] "Generic (PLEG): container finished" podID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerID="8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2" exitCode=0
May 25 06:13:30.791171 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:30.790860    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerDied","Data":"8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2"}
May 25 06:13:31.796363 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:31.796326    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerStarted","Data":"fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280"}
May 25 06:13:31.796363 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:31.796366    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerStarted","Data":"fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b"}
May 25 06:13:31.816631 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:31.816577    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podStartSLOduration=14.816564336 podStartE2EDuration="14.816564336s" podCreationTimestamp="2026-05-25 06:13:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:13:31.814110545 +0000 UTC m=+976.719878608" watchObservedRunningTime="2026-05-25 06:13:31.816564336 +0000 UTC m=+976.722332386"
May 25 06:13:33.863399 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:33.863357    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:33.863803 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:33.863411    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:33.865040 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:33.865003    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
May 25 06:13:33.865173 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:33.865044    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 25 06:13:36.862839 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:36.862787    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
May 25 06:13:36.867880 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:36.867851    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:36.868201 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:36.868183    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:36.871009 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:36.870985    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:38.862912 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:38.862869    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:39.863302 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:39.863264    2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
May 25 06:13:42.863563 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:42.863532    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:13:42.864264 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:13:42.864244    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:14:56.372665 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.372633    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"]
May 25 06:14:56.373193 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.372936    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry" containerID="cri-o://fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b" gracePeriod=30
May 25 06:14:56.373193 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.373004    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online" containerID="cri-o://fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280" gracePeriod=30
May 25 06:14:56.375430 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.375404    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"]
May 25 06:14:56.375739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.375715    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry" containerID="cri-o://4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d" gracePeriod=30
May 25 06:14:56.375934 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.375752    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online" containerID="cri-o://92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44" gracePeriod=30
May 25 06:14:56.869620 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:56.869573    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 25 06:14:57.708097 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:57.708058    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 25 06:14:58.064924 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.064838    2556 generic.go:358] "Generic (PLEG): container finished" podID="c047a103-89b0-41cd-be04-e1efb5336e27" containerID="92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44" exitCode=0
May 25 06:14:58.064924 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.064906    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerDied","Data":"92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44"}
May 25 06:14:58.066759 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.066736    2556 generic.go:358] "Generic (PLEG): container finished" podID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerID="fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280" exitCode=0
May 25 06:14:58.066863 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.066800    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerDied","Data":"fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280"}
May 25 06:14:58.878443 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.878409    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-grcsz"]
May 25 06:14:58.878903 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.878602    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz" podUID="ba3783ab-c5e6-4869-93ba-20f81639f462" containerName="postgres" containerID="cri-o://89bf1af0e520fbe798db824e0ec025700aec74b63462fa315c5f8710fb89fca0" gracePeriod=30
May 25 06:14:58.882725 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.882681    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2nr7d"]
May 25 06:14:58.882864 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:58.882845    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-2nr7d" podUID="407fd5a4-173f-40ab-8ec1-7f01ccc4d922" containerName="redis" containerID="cri-o://360c32d34b4d9f94bc6f097207d36acd6e9eac80983217b859c8aad85c83d5c7" gracePeriod=30
May 25 06:14:59.071818 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.071787    2556 generic.go:358] "Generic (PLEG): container finished" podID="407fd5a4-173f-40ab-8ec1-7f01ccc4d922" containerID="360c32d34b4d9f94bc6f097207d36acd6e9eac80983217b859c8aad85c83d5c7" exitCode=0
May 25 06:14:59.071956 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.071863    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2nr7d" event={"ID":"407fd5a4-173f-40ab-8ec1-7f01ccc4d922","Type":"ContainerDied","Data":"360c32d34b4d9f94bc6f097207d36acd6e9eac80983217b859c8aad85c83d5c7"}
May 25 06:14:59.073474 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.073378    2556 generic.go:358] "Generic (PLEG): container finished" podID="ba3783ab-c5e6-4869-93ba-20f81639f462" containerID="89bf1af0e520fbe798db824e0ec025700aec74b63462fa315c5f8710fb89fca0" exitCode=0
May 25 06:14:59.073474 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.073413    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz" event={"ID":"ba3783ab-c5e6-4869-93ba-20f81639f462","Type":"ContainerDied","Data":"89bf1af0e520fbe798db824e0ec025700aec74b63462fa315c5f8710fb89fca0"}
May 25 06:14:59.144720 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.144686    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:14:59.147957 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.147939    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:14:59.149182 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.149160    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk84b\" (UniqueName: \"kubernetes.io/projected/ba3783ab-c5e6-4869-93ba-20f81639f462-kube-api-access-wk84b\") pod \"ba3783ab-c5e6-4869-93ba-20f81639f462\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") "
May 25 06:14:59.149278 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.149190    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ba3783ab-c5e6-4869-93ba-20f81639f462-postgresdata\") pod \"ba3783ab-c5e6-4869-93ba-20f81639f462\" (UID: \"ba3783ab-c5e6-4869-93ba-20f81639f462\") "
May 25 06:14:59.151252 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.151226    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba3783ab-c5e6-4869-93ba-20f81639f462-kube-api-access-wk84b" (OuterVolumeSpecName: "kube-api-access-wk84b") pod "ba3783ab-c5e6-4869-93ba-20f81639f462" (UID: "ba3783ab-c5e6-4869-93ba-20f81639f462"). InnerVolumeSpecName "kube-api-access-wk84b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:14:59.183087 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.183047    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba3783ab-c5e6-4869-93ba-20f81639f462-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "ba3783ab-c5e6-4869-93ba-20f81639f462" (UID: "ba3783ab-c5e6-4869-93ba-20f81639f462"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:14:59.249891 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.249858    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzpzl\" (UniqueName: \"kubernetes.io/projected/407fd5a4-173f-40ab-8ec1-7f01ccc4d922-kube-api-access-jzpzl\") pod \"407fd5a4-173f-40ab-8ec1-7f01ccc4d922\" (UID: \"407fd5a4-173f-40ab-8ec1-7f01ccc4d922\") "
May 25 06:14:59.250047 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.250033    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk84b\" (UniqueName: \"kubernetes.io/projected/ba3783ab-c5e6-4869-93ba-20f81639f462-kube-api-access-wk84b\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:14:59.250047 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.250046    2556 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/ba3783ab-c5e6-4869-93ba-20f81639f462-postgresdata\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:14:59.251772 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.251751    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/407fd5a4-173f-40ab-8ec1-7f01ccc4d922-kube-api-access-jzpzl" (OuterVolumeSpecName: "kube-api-access-jzpzl") pod "407fd5a4-173f-40ab-8ec1-7f01ccc4d922" (UID: "407fd5a4-173f-40ab-8ec1-7f01ccc4d922"). InnerVolumeSpecName "kube-api-access-jzpzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:14:59.351233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:14:59.351206    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzpzl\" (UniqueName: \"kubernetes.io/projected/407fd5a4-173f-40ab-8ec1-7f01ccc4d922-kube-api-access-jzpzl\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:00.077841 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.077808    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-2nr7d" event={"ID":"407fd5a4-173f-40ab-8ec1-7f01ccc4d922","Type":"ContainerDied","Data":"20384ba7ec20e4f6c5a989e6e1a249f30d238dda09fc41faa7956ef4bf74286f"}
May 25 06:15:00.077841 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.077825    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-2nr7d"
May 25 06:15:00.078344 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.077857    2556 scope.go:117] "RemoveContainer" containerID="360c32d34b4d9f94bc6f097207d36acd6e9eac80983217b859c8aad85c83d5c7"
May 25 06:15:00.079442 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.079420    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz"
May 25 06:15:00.079557 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.079422    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-grcsz" event={"ID":"ba3783ab-c5e6-4869-93ba-20f81639f462","Type":"ContainerDied","Data":"63da0397cf8191ee833f8b29729e883719fcb94a3d1fc41fcb0ad742df353cd1"}
May 25 06:15:00.086394 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.086360    2556 scope.go:117] "RemoveContainer" containerID="89bf1af0e520fbe798db824e0ec025700aec74b63462fa315c5f8710fb89fca0"
May 25 06:15:00.096607 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.096587    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-grcsz"]
May 25 06:15:00.099483 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.099463    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-grcsz"]
May 25 06:15:00.107840 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.107821    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2nr7d"]
May 25 06:15:00.109398 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:00.109380    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-2nr7d"]
May 25 06:15:01.703370 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:01.703293    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="407fd5a4-173f-40ab-8ec1-7f01ccc4d922" path="/var/lib/kubelet/pods/407fd5a4-173f-40ab-8ec1-7f01ccc4d922/volumes"
May 25 06:15:01.703738 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:01.703618    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba3783ab-c5e6-4869-93ba-20f81639f462" path="/var/lib/kubelet/pods/ba3783ab-c5e6-4869-93ba-20f81639f462/volumes"
May 25 06:15:06.869359 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:06.869311    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 25 06:15:07.708575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:07.708538    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 25 06:15:16.869442 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:16.869398    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 25 06:15:16.869825 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:16.869509    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:15:17.708495 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:17.708458    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 25 06:15:17.708668 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:17.708556    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:15:26.869533 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:26.869490    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 25 06:15:27.026279 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.026253    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:15:27.050113 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.050092    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:15:27.165344 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.165262    2556 generic.go:358] "Generic (PLEG): container finished" podID="c047a103-89b0-41cd-be04-e1efb5336e27" containerID="4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d" exitCode=137
May 25 06:15:27.165537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.165343    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"
May 25 06:15:27.165537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.165351    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerDied","Data":"4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d"}
May 25 06:15:27.165537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.165395    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d" event={"ID":"c047a103-89b0-41cd-be04-e1efb5336e27","Type":"ContainerDied","Data":"35b91e34c77c2393f69eab2b85fb658e5fa509152b0f5426650c6ad2cd6e0e9e"}
May 25 06:15:27.165537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.165415    2556 scope.go:117] "RemoveContainer" containerID="92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44"
May 25 06:15:27.167311 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.167288    2556 generic.go:358] "Generic (PLEG): container finished" podID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerID="fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b" exitCode=137
May 25 06:15:27.167427 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.167346    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"
May 25 06:15:27.167427 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.167363    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerDied","Data":"fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b"}
May 25 06:15:27.167427 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.167390    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5" event={"ID":"7dbaa0d4-8af2-40c6-b370-5be68f191124","Type":"ContainerDied","Data":"7cf04d3092a6baf01ceccb0b6cd4c83e6af75ee8d3d702367b7b97ea85c2f725"}
May 25 06:15:27.173547 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173523    2556 scope.go:117] "RemoveContainer" containerID="4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d"
May 25 06:15:27.173831 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173763    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls\") pod \"7dbaa0d4-8af2-40c6-b370-5be68f191124\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") "
May 25 06:15:27.173831 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173801    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-online-tls\") pod \"c047a103-89b0-41cd-be04-e1efb5336e27\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") "
May 25 06:15:27.173979 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173853    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-registry-tls\") pod \"7dbaa0d4-8af2-40c6-b370-5be68f191124\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") "
May 25 06:15:27.173979 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173890    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-registry-tls\") pod \"c047a103-89b0-41cd-be04-e1efb5336e27\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") "
May 25 06:15:27.173979 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173910    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7dbaa0d4-8af2-40c6-b370-5be68f191124-feast-data\") pod \"7dbaa0d4-8af2-40c6-b370-5be68f191124\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") "
May 25 06:15:27.173979 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.173941    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn7v4\" (UniqueName: \"kubernetes.io/projected/7dbaa0d4-8af2-40c6-b370-5be68f191124-kube-api-access-vn7v4\") pod \"7dbaa0d4-8af2-40c6-b370-5be68f191124\" (UID: \"7dbaa0d4-8af2-40c6-b370-5be68f191124\") "
May 25 06:15:27.174666 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.174006    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs4kf\" (UniqueName: \"kubernetes.io/projected/c047a103-89b0-41cd-be04-e1efb5336e27-kube-api-access-fs4kf\") pod \"c047a103-89b0-41cd-be04-e1efb5336e27\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") "
May 25 06:15:27.174666 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.174045    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c047a103-89b0-41cd-be04-e1efb5336e27-feast-data\") pod \"c047a103-89b0-41cd-be04-e1efb5336e27\" (UID: \"c047a103-89b0-41cd-be04-e1efb5336e27\") "
May 25 06:15:27.174928 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.174893    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dbaa0d4-8af2-40c6-b370-5be68f191124-feast-data" (OuterVolumeSpecName: "feast-data") pod "7dbaa0d4-8af2-40c6-b370-5be68f191124" (UID: "7dbaa0d4-8af2-40c6-b370-5be68f191124"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:15:27.176393 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.176366    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7dbaa0d4-8af2-40c6-b370-5be68f191124" (UID: "7dbaa0d4-8af2-40c6-b370-5be68f191124"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:15:27.176506 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.176475    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c047a103-89b0-41cd-be04-e1efb5336e27" (UID: "c047a103-89b0-41cd-be04-e1efb5336e27"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:15:27.176506 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.176485    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-online-tls" (OuterVolumeSpecName: "online-tls") pod "c047a103-89b0-41cd-be04-e1efb5336e27" (UID: "c047a103-89b0-41cd-be04-e1efb5336e27"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:15:27.176627 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.176524    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls" (OuterVolumeSpecName: "online-tls") pod "7dbaa0d4-8af2-40c6-b370-5be68f191124" (UID: "7dbaa0d4-8af2-40c6-b370-5be68f191124"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 06:15:27.177040 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.177019    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c047a103-89b0-41cd-be04-e1efb5336e27-kube-api-access-fs4kf" (OuterVolumeSpecName: "kube-api-access-fs4kf") pod "c047a103-89b0-41cd-be04-e1efb5336e27" (UID: "c047a103-89b0-41cd-be04-e1efb5336e27"). InnerVolumeSpecName "kube-api-access-fs4kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:15:27.177381 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.177359    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dbaa0d4-8af2-40c6-b370-5be68f191124-kube-api-access-vn7v4" (OuterVolumeSpecName: "kube-api-access-vn7v4") pod "7dbaa0d4-8af2-40c6-b370-5be68f191124" (UID: "7dbaa0d4-8af2-40c6-b370-5be68f191124"). InnerVolumeSpecName "kube-api-access-vn7v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:15:27.183490 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.183471    2556 scope.go:117] "RemoveContainer" containerID="2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f"
May 25 06:15:27.183928 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.183905    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c047a103-89b0-41cd-be04-e1efb5336e27-feast-data" (OuterVolumeSpecName: "feast-data") pod "c047a103-89b0-41cd-be04-e1efb5336e27" (UID: "c047a103-89b0-41cd-be04-e1efb5336e27"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:15:27.190329 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.190318    2556 scope.go:117] "RemoveContainer" containerID="5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1"
May 25 06:15:27.197233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197104    2556 scope.go:117] "RemoveContainer" containerID="92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44"
May 25 06:15:27.197352 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.197333    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44\": container with ID starting with 92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44 not found: ID does not exist" containerID="92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44"
May 25 06:15:27.197402 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197364    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44"} err="failed to get container status \"92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44\": rpc error: code = NotFound desc = could not find container \"92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44\": container with ID starting with 92c584513978645385c0d530053ad979cb829120a4a622e8d869984b7da5da44 not found: ID does not exist"
May 25 06:15:27.197402 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197390    2556 scope.go:117] "RemoveContainer" containerID="4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d"
May 25 06:15:27.197625 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.197597    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d\": container with ID starting with 4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d not found: ID does not exist" containerID="4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d"
May 25 06:15:27.197739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197630    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d"} err="failed to get container status \"4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d\": rpc error: code = NotFound desc = could not find container \"4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d\": container with ID starting with 4eca7e8614ee64e57385cb087ebe00176aa75739d309685be4827e7ac35ad36d not found: ID does not exist"
May 25 06:15:27.197739 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197644    2556 scope.go:117] "RemoveContainer" containerID="2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f"
May 25 06:15:27.197880 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.197859    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f\": container with ID starting with 2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f not found: ID does not exist" containerID="2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f"
May 25 06:15:27.197924 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197887    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f"} err="failed to get container status \"2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f\": rpc error: code = NotFound desc = could not find container \"2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f\": container with ID starting with 2fc5c6781397cfe1d746d0d6e67a243038faf11450a99654eb1a4cc1023bde3f not found: ID does not exist"
May 25 06:15:27.197924 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.197905    2556 scope.go:117] "RemoveContainer" containerID="5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1"
May 25 06:15:27.198142 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.198128    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1\": container with ID starting with 5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1 not found: ID does not exist" containerID="5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1"
May 25 06:15:27.198188 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.198144    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1"} err="failed to get container status \"5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1\": rpc error: code = NotFound desc = could not find container \"5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1\": container with ID starting with 5bb81aa7e5170d0915e15d3b409968a7ea8d9c90122e652a94b2ef2f209692f1 not found: ID does not exist"
May 25 06:15:27.198188 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.198156    2556 scope.go:117] "RemoveContainer" containerID="fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280"
May 25 06:15:27.204613 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.204595    2556 scope.go:117] "RemoveContainer" containerID="fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b"
May 25 06:15:27.211365 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.211347    2556 scope.go:117] "RemoveContainer" containerID="8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2"
May 25 06:15:27.219458 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.219432    2556 scope.go:117] "RemoveContainer" containerID="1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560"
May 25 06:15:27.226272 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.226214    2556 scope.go:117] "RemoveContainer" containerID="fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280"
May 25 06:15:27.226471 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.226452    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280\": container with ID starting with fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280 not found: ID does not exist" containerID="fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280"
May 25 06:15:27.226526 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.226477    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280"} err="failed to get container status \"fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280\": rpc error: code = NotFound desc = could not find container \"fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280\": container with ID starting with fbfc9aa9af18ec648008df14b72342c038f876b4733780f1ba6b4ad49737d280 not found: ID does not exist"
May 25 06:15:27.226526 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.226495    2556 scope.go:117] "RemoveContainer" containerID="fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b"
May 25 06:15:27.226766 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.226747    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b\": container with ID starting with fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b not found: ID does not exist" containerID="fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b"
May 25 06:15:27.226824 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.226770    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b"} err="failed to get container status \"fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b\": rpc error: code = NotFound desc = could not find container \"fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b\": container with ID starting with fd59c5d95e05920bf14604ff045a4cbf250465d93b9da4b0a7a80ef688683a0b not found: ID does not exist"
May 25 06:15:27.226824 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.226785    2556 scope.go:117] "RemoveContainer" containerID="8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2"
May 25 06:15:27.227009 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.226990    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2\": container with ID starting with 8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2 not found: ID does not exist" containerID="8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2"
May 25 06:15:27.227080 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.227016    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2"} err="failed to get container status \"8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2\": rpc error: code = NotFound desc = could not find container \"8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2\": container with ID starting with 8fcc6db2f868b0c0f0cf9b79bf619f0b992ed7096bd23c2338edb059953c89d2 not found: ID does not exist"
May 25 06:15:27.227080 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.227042    2556 scope.go:117] "RemoveContainer" containerID="1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560"
May 25 06:15:27.227251 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:15:27.227236    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560\": container with ID starting with 1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560 not found: ID does not exist" containerID="1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560"
May 25 06:15:27.227304 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.227259    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560"} err="failed to get container status \"1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560\": rpc error: code = NotFound desc = could not find container \"1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560\": container with ID starting with 1262d83a14c931d83e0608f2b6b0303ad69acb9d081f45b479f8181840390560 not found: ID does not exist"
May 25 06:15:27.274961 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.274923    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs4kf\" (UniqueName: \"kubernetes.io/projected/c047a103-89b0-41cd-be04-e1efb5336e27-kube-api-access-fs4kf\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.274961 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.274964    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c047a103-89b0-41cd-be04-e1efb5336e27-feast-data\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.275162 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.274975    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-online-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.275162 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.274984    2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-online-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.275162 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.274992    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7dbaa0d4-8af2-40c6-b370-5be68f191124-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.275162 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.275000    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c047a103-89b0-41cd-be04-e1efb5336e27-registry-tls\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.275162 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.275008    2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7dbaa0d4-8af2-40c6-b370-5be68f191124-feast-data\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.275162 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.275016    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn7v4\" (UniqueName: \"kubernetes.io/projected/7dbaa0d4-8af2-40c6-b370-5be68f191124-kube-api-access-vn7v4\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:15:27.492354 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.492325    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"]
May 25 06:15:27.496093 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.496067    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-5dd7bd7499-fjw4d"]
May 25 06:15:27.504514 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.504485    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"]
May 25 06:15:27.506461 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.506440    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-567d5bc98d-nvfc5"]
May 25 06:15:27.702969 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.702936    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" path="/var/lib/kubelet/pods/7dbaa0d4-8af2-40c6-b370-5be68f191124/volumes"
May 25 06:15:27.703429 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:15:27.703417    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" path="/var/lib/kubelet/pods/c047a103-89b0-41cd-be04-e1efb5336e27/volumes"
May 25 06:17:15.638506 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:17:15.638480    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:17:15.642355 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:17:15.642330    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:17:15.644688 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:17:15.644667    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:17:15.648152 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:17:15.648135    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:22:15.658885 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:22:15.658851    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:22:15.663146 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:22:15.663126    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:22:15.664934 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:22:15.664915    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:22:15.669271 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:22:15.669255    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:25:49.654980 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.654881    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ktbrq/must-gather-96klf"]
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655256    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="feast-init"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655270    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="feast-init"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655279    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="feast-apply"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655287    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="feast-apply"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655296    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655303    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655311    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba3783ab-c5e6-4869-93ba-20f81639f462" containerName="postgres"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655317    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba3783ab-c5e6-4869-93ba-20f81639f462" containerName="postgres"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655326    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655332    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655337    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="feast-apply"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655344    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="feast-apply"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655354    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655359    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655371    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="407fd5a4-173f-40ab-8ec1-7f01ccc4d922" containerName="redis"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655378    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="407fd5a4-173f-40ab-8ec1-7f01ccc4d922" containerName="redis"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655383    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="feast-init"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655388    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="feast-init"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655398    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655405    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655451    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba3783ab-c5e6-4869-93ba-20f81639f462" containerName="postgres"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655462    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="registry"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655468    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="online"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655478    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="c047a103-89b0-41cd-be04-e1efb5336e27" containerName="online"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655487    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="407fd5a4-173f-40ab-8ec1-7f01ccc4d922" containerName="redis"
May 25 06:25:49.655590 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.655494    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="7dbaa0d4-8af2-40c6-b370-5be68f191124" containerName="registry"
May 25 06:25:49.658540 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.658517    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.660572 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.660545    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ktbrq\"/\"default-dockercfg-htbbs\""
May 25 06:25:49.660858 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.660570    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ktbrq\"/\"openshift-service-ca.crt\""
May 25 06:25:49.660858 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.660546    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ktbrq\"/\"kube-root-ca.crt\""
May 25 06:25:49.669271 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.669249    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ktbrq/must-gather-96klf"]
May 25 06:25:49.744024 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.743991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bec46a40-5962-46a2-b083-9841a36a7f6c-must-gather-output\") pod \"must-gather-96klf\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") " pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.744213 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.744055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pb9\" (UniqueName: \"kubernetes.io/projected/bec46a40-5962-46a2-b083-9841a36a7f6c-kube-api-access-s5pb9\") pod \"must-gather-96klf\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") " pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.845008 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.844971    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bec46a40-5962-46a2-b083-9841a36a7f6c-must-gather-output\") pod \"must-gather-96klf\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") " pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.845215 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.845046    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pb9\" (UniqueName: \"kubernetes.io/projected/bec46a40-5962-46a2-b083-9841a36a7f6c-kube-api-access-s5pb9\") pod \"must-gather-96klf\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") " pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.845393 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.845363    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bec46a40-5962-46a2-b083-9841a36a7f6c-must-gather-output\") pod \"must-gather-96klf\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") " pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.852482 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.852453    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pb9\" (UniqueName: \"kubernetes.io/projected/bec46a40-5962-46a2-b083-9841a36a7f6c-kube-api-access-s5pb9\") pod \"must-gather-96klf\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") " pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:49.968470 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:49.968376    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:25:50.099261 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:50.099214    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ktbrq/must-gather-96klf"]
May 25 06:25:50.102389 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:25:50.102359    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbec46a40_5962_46a2_b083_9841a36a7f6c.slice/crio-df38b61fb7a432af9a69aaabc288e87795df4075667a2919a0d22ecd25694647 WatchSource:0}: Error finding container df38b61fb7a432af9a69aaabc288e87795df4075667a2919a0d22ecd25694647: Status 404 returned error can't find the container with id df38b61fb7a432af9a69aaabc288e87795df4075667a2919a0d22ecd25694647
May 25 06:25:50.103999 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:50.103982    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 06:25:50.938720 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:50.938662    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ktbrq/must-gather-96klf" event={"ID":"bec46a40-5962-46a2-b083-9841a36a7f6c","Type":"ContainerStarted","Data":"df38b61fb7a432af9a69aaabc288e87795df4075667a2919a0d22ecd25694647"}
May 25 06:25:56.959214 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:56.959171    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ktbrq/must-gather-96klf" event={"ID":"bec46a40-5962-46a2-b083-9841a36a7f6c","Type":"ContainerStarted","Data":"c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307"}
May 25 06:25:56.959214 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:56.959218    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ktbrq/must-gather-96klf" event={"ID":"bec46a40-5962-46a2-b083-9841a36a7f6c","Type":"ContainerStarted","Data":"3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"}
May 25 06:25:56.974673 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:25:56.974612    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-ktbrq/must-gather-96klf" podStartSLOduration=1.501873844 podStartE2EDuration="7.974595963s" podCreationTimestamp="2026-05-25 06:25:49 +0000 UTC" firstStartedPulling="2026-05-25 06:25:50.104101006 +0000 UTC m=+1715.009869037" lastFinishedPulling="2026-05-25 06:25:56.576823112 +0000 UTC m=+1721.482591156" observedRunningTime="2026-05-25 06:25:56.972770639 +0000 UTC m=+1721.878538695" watchObservedRunningTime="2026-05-25 06:25:56.974595963 +0000 UTC m=+1721.880364013"
May 25 06:26:06.989170 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:06.989132    2556 generic.go:358] "Generic (PLEG): container finished" podID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerID="3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a" exitCode=0
May 25 06:26:06.989637 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:06.989206    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ktbrq/must-gather-96klf" event={"ID":"bec46a40-5962-46a2-b083-9841a36a7f6c","Type":"ContainerDied","Data":"3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"}
May 25 06:26:06.989637 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:06.989511    2556 scope.go:117] "RemoveContainer" containerID="3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"
May 25 06:26:07.309039 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:07.308952    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ktbrq_must-gather-96klf_bec46a40-5962-46a2-b083-9841a36a7f6c/gather/0.log"
May 25 06:26:10.271485 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:10.271450    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d5ct2_6a7d6a71-9978-4998-b703-176132d5c7ac/global-pull-secret-syncer/0.log"
May 25 06:26:10.406273 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:10.406239    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mhq5_40486405-21ff-427b-b442-cbad172fc783/konnectivity-agent/0.log"
May 25 06:26:10.488047 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:10.488017    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-119.ec2.internal_d83abb9bcd1d3d50106c4ed78bb9e511/haproxy/0.log"
May 25 06:26:12.630172 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:12.630133    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-ktbrq/must-gather-96klf"]
May 25 06:26:12.630670 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:12.630346    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-ktbrq/must-gather-96klf" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="copy" containerID="cri-o://c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307" gracePeriod=2
May 25 06:26:12.633588 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:12.633561    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-ktbrq/must-gather-96klf"]
May 25 06:26:12.861096 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:12.861073    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ktbrq_must-gather-96klf_bec46a40-5962-46a2-b083-9841a36a7f6c/copy/0.log"
May 25 06:26:12.861433 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:12.861417    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:26:12.863052 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:12.863026    2556 status_manager.go:895] "Failed to get status for pod" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" pod="openshift-must-gather-ktbrq/must-gather-96klf" err="pods \"must-gather-96klf\" is forbidden: User \"system:node:ip-10-0-128-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ktbrq\": no relationship found between node 'ip-10-0-128-119.ec2.internal' and this object"
May 25 06:26:13.008065 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.007983    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-ktbrq_must-gather-96klf_bec46a40-5962-46a2-b083-9841a36a7f6c/copy/0.log"
May 25 06:26:13.008296 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.008276    2556 generic.go:358] "Generic (PLEG): container finished" podID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerID="c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307" exitCode=143
May 25 06:26:13.008361 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.008326    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ktbrq/must-gather-96klf"
May 25 06:26:13.008398 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.008376    2556 scope.go:117] "RemoveContainer" containerID="c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307"
May 25 06:26:13.009971 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.009948    2556 status_manager.go:895] "Failed to get status for pod" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" pod="openshift-must-gather-ktbrq/must-gather-96klf" err="pods \"must-gather-96klf\" is forbidden: User \"system:node:ip-10-0-128-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ktbrq\": no relationship found between node 'ip-10-0-128-119.ec2.internal' and this object"
May 25 06:26:13.015461 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.015446    2556 scope.go:117] "RemoveContainer" containerID="3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"
May 25 06:26:13.026769 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.026753    2556 scope.go:117] "RemoveContainer" containerID="c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307"
May 25 06:26:13.027033 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:26:13.027015    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307\": container with ID starting with c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307 not found: ID does not exist" containerID="c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307"
May 25 06:26:13.027083 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.027042    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307"} err="failed to get container status \"c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307\": rpc error: code = NotFound desc = could not find container \"c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307\": container with ID starting with c0235012809527cec633d421db67be8ab2e86e869e90238147a4b64035e92307 not found: ID does not exist"
May 25 06:26:13.027083 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.027061    2556 scope.go:117] "RemoveContainer" containerID="3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"
May 25 06:26:13.027269 ip-10-0-128-119 kubenswrapper[2556]: E0525 06:26:13.027255    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a\": container with ID starting with 3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a not found: ID does not exist" containerID="3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"
May 25 06:26:13.027308 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.027273    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a"} err="failed to get container status \"3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a\": rpc error: code = NotFound desc = could not find container \"3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a\": container with ID starting with 3acaa49e18eaf9e07cabebfd1655d958862772a3fe4e1192fb4d690bad596d3a not found: ID does not exist"
May 25 06:26:13.043325 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.043301    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5pb9\" (UniqueName: \"kubernetes.io/projected/bec46a40-5962-46a2-b083-9841a36a7f6c-kube-api-access-s5pb9\") pod \"bec46a40-5962-46a2-b083-9841a36a7f6c\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") "
May 25 06:26:13.043424 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.043376    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bec46a40-5962-46a2-b083-9841a36a7f6c-must-gather-output\") pod \"bec46a40-5962-46a2-b083-9841a36a7f6c\" (UID: \"bec46a40-5962-46a2-b083-9841a36a7f6c\") "
May 25 06:26:13.043747 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.043698    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec46a40-5962-46a2-b083-9841a36a7f6c-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "bec46a40-5962-46a2-b083-9841a36a7f6c" (UID: "bec46a40-5962-46a2-b083-9841a36a7f6c"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 06:26:13.045376 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.045353    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec46a40-5962-46a2-b083-9841a36a7f6c-kube-api-access-s5pb9" (OuterVolumeSpecName: "kube-api-access-s5pb9") pod "bec46a40-5962-46a2-b083-9841a36a7f6c" (UID: "bec46a40-5962-46a2-b083-9841a36a7f6c"). InnerVolumeSpecName "kube-api-access-s5pb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 06:26:13.143998 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.143954    2556 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bec46a40-5962-46a2-b083-9841a36a7f6c-must-gather-output\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:26:13.143998 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.143994    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5pb9\" (UniqueName: \"kubernetes.io/projected/bec46a40-5962-46a2-b083-9841a36a7f6c-kube-api-access-s5pb9\") on node \"ip-10-0-128-119.ec2.internal\" DevicePath \"\""
May 25 06:26:13.318034 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.318001    2556 status_manager.go:895] "Failed to get status for pod" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" pod="openshift-must-gather-ktbrq/must-gather-96klf" err="pods \"must-gather-96klf\" is forbidden: User \"system:node:ip-10-0-128-119.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-ktbrq\": no relationship found between node 'ip-10-0-128-119.ec2.internal' and this object"
May 25 06:26:13.702609 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.702564    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" path="/var/lib/kubelet/pods/bec46a40-5962-46a2-b083-9841a36a7f6c/volumes"
May 25 06:26:13.988240 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:13.988167    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d9d74b559-6jf4m_02c24180-2349-48e3-a395-7c970d2ebcbc/metrics-server/0.log"
May 25 06:26:14.010347 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.010315    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-8pg7q_de6b9de1-5387-4e27-99b3-6e6a8ebdf3ed/monitoring-plugin/0.log"
May 25 06:26:14.102470 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.102440    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9lxq_b0f14f4b-c70f-4f29-b117-3a3eaad9d48b/node-exporter/0.log"
May 25 06:26:14.122689 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.122669    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9lxq_b0f14f4b-c70f-4f29-b117-3a3eaad9d48b/kube-rbac-proxy/0.log"
May 25 06:26:14.145291 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.145262    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p9lxq_b0f14f4b-c70f-4f29-b117-3a3eaad9d48b/init-textfile/0.log"
May 25 06:26:14.231541 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.231513    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-hfrgm_250f659c-e544-4f66-a751-2584e77dfc00/kube-rbac-proxy-main/0.log"
May 25 06:26:14.254823 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.254758    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-hfrgm_250f659c-e544-4f66-a751-2584e77dfc00/kube-rbac-proxy-self/0.log"
May 25 06:26:14.274294 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.274256    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-hfrgm_250f659c-e544-4f66-a751-2584e77dfc00/openshift-state-metrics/0.log"
May 25 06:26:14.454953 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.454924    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-ls4rz_fb1d5983-f430-4380-8684-57575fb00ae7/prometheus-operator/0.log"
May 25 06:26:14.470948 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.470922    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-ls4rz_fb1d5983-f430-4380-8684-57575fb00ae7/kube-rbac-proxy/0.log"
May 25 06:26:14.492932 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.492907    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-4886j_09152d19-e7ae-4779-ad6a-4186b1118941/prometheus-operator-admission-webhook/0.log"
May 25 06:26:14.585575 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.585546    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89bb44f4b-kdcgb_5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4/thanos-query/0.log"
May 25 06:26:14.617690 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.617663    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89bb44f4b-kdcgb_5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4/kube-rbac-proxy-web/0.log"
May 25 06:26:14.642604 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.642569    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89bb44f4b-kdcgb_5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4/kube-rbac-proxy/0.log"
May 25 06:26:14.674537 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.674509    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89bb44f4b-kdcgb_5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4/prom-label-proxy/0.log"
May 25 06:26:14.707615 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.707584    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89bb44f4b-kdcgb_5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4/kube-rbac-proxy-rules/0.log"
May 25 06:26:14.747761 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:14.747728    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89bb44f4b-kdcgb_5dbdbb81-9bb5-4059-9f08-1d120cfbaeb4/kube-rbac-proxy-metrics/0.log"
May 25 06:26:15.738298 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:15.738269    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-t5nmh_8870eb81-f20a-4a7c-a86b-109ebbbb80e1/networking-console-plugin/0.log"
May 25 06:26:16.107577 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.107545    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/1.log"
May 25 06:26:16.111829 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.111807    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-lm7hc_6e833df1-55eb-489d-9489-6bae2662c9bf/console-operator/2.log"
May 25 06:26:16.660440 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660405    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"]
May 25 06:26:16.660699 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660687    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="copy"
May 25 06:26:16.660771 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660700    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="copy"
May 25 06:26:16.660805 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660772    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="gather"
May 25 06:26:16.660805 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660778    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="gather"
May 25 06:26:16.660865 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660828    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="gather"
May 25 06:26:16.660865 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.660839    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="bec46a40-5962-46a2-b083-9841a36a7f6c" containerName="copy"
May 25 06:26:16.664269 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.664246    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.666154 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.666135    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpb87\"/\"kube-root-ca.crt\""
May 25 06:26:16.666610 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.666591    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rpb87\"/\"default-dockercfg-p2tf5\""
May 25 06:26:16.666688 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.666599    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rpb87\"/\"openshift-service-ca.crt\""
May 25 06:26:16.670376 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.670353    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"]
May 25 06:26:16.774313 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.774267    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-podres\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.774683 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.774364    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-sys\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.774683 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.774416    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-lib-modules\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.774683 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.774440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-proc\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.774683 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.774527    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktpfd\" (UniqueName: \"kubernetes.io/projected/10a482e2-428b-444a-954f-d75376467ab2-kube-api-access-ktpfd\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.809507 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.809480    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-mgh9j_27e030e6-eaed-4775-851d-e3e326593e8b/volume-data-source-validator/0.log"
May 25 06:26:16.875051 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875017    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ktpfd\" (UniqueName: \"kubernetes.io/projected/10a482e2-428b-444a-954f-d75376467ab2-kube-api-access-ktpfd\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875062    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-podres\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875094    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-sys\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875120    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-lib-modules\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875140    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-proc\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875215    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-proc\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875233 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875214    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-sys\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875476 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875289    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-lib-modules\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.875476 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.875293    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/10a482e2-428b-444a-954f-d75376467ab2-podres\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.882380 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.882357    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktpfd\" (UniqueName: \"kubernetes.io/projected/10a482e2-428b-444a-954f-d75376467ab2-kube-api-access-ktpfd\") pod \"perf-node-gather-daemonset-bbxqf\" (UID: \"10a482e2-428b-444a-954f-d75376467ab2\") " pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:16.974540 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:16.974449    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:17.100673 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:17.100526    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"]
May 25 06:26:17.103496 ip-10-0-128-119 kubenswrapper[2556]: W0525 06:26:17.103466    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod10a482e2_428b_444a_954f_d75376467ab2.slice/crio-8c43524fb9e81a1aed9d0d305e212a4e0e39d4975964c0cab175e141184b9a56 WatchSource:0}: Error finding container 8c43524fb9e81a1aed9d0d305e212a4e0e39d4975964c0cab175e141184b9a56: Status 404 returned error can't find the container with id 8c43524fb9e81a1aed9d0d305e212a4e0e39d4975964c0cab175e141184b9a56
May 25 06:26:17.464402 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:17.464373    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kcb49_f7e08bd3-fbfa-4ff7-860a-ef6b8637188f/dns/0.log"
May 25 06:26:17.481184 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:17.481160    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kcb49_f7e08bd3-fbfa-4ff7-860a-ef6b8637188f/kube-rbac-proxy/0.log"
May 25 06:26:17.557035 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:17.557008    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ls4sm_e19a06ea-d401-4ebf-8145-7f362b31ee97/dns-node-resolver/0.log"
May 25 06:26:17.955087 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:17.955054    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f95589667-d8wdc_971bb522-68df-46e4-bc1c-6f99171e49c6/registry/0.log"
May 25 06:26:17.972878 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:17.972848    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2j2ks_ce1aa8a8-bacb-420d-af6b-e3335f2b4866/node-ca/0.log"
May 25 06:26:18.026533 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:18.026494    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf" event={"ID":"10a482e2-428b-444a-954f-d75376467ab2","Type":"ContainerStarted","Data":"7f09d34b48d16708cf90ccf1ca8b744d779639237f343954c74a4a87176e1d20"}
May 25 06:26:18.026770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:18.026533    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf" event={"ID":"10a482e2-428b-444a-954f-d75376467ab2","Type":"ContainerStarted","Data":"8c43524fb9e81a1aed9d0d305e212a4e0e39d4975964c0cab175e141184b9a56"}
May 25 06:26:18.026770 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:18.026638    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:18.043301 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:18.043251    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf" podStartSLOduration=2.043234684 podStartE2EDuration="2.043234684s" podCreationTimestamp="2026-05-25 06:26:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 06:26:18.041910082 +0000 UTC m=+1742.947678134" watchObservedRunningTime="2026-05-25 06:26:18.043234684 +0000 UTC m=+1742.949002735"
May 25 06:26:18.966131 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:18.966100    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t7bbl_f8a05f75-30d2-4ec1-92d3-6136ae7d0b4f/serve-healthcheck-canary/0.log"
May 25 06:26:19.442833 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:19.442804    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zcxj8_9d310832-0ca4-4967-b189-d289f27d4d88/kube-rbac-proxy/0.log"
May 25 06:26:19.461620 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:19.461593    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zcxj8_9d310832-0ca4-4967-b189-d289f27d4d88/exporter/0.log"
May 25 06:26:19.479472 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:19.479445    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zcxj8_9d310832-0ca4-4967-b189-d289f27d4d88/extractor/0.log"
May 25 06:26:23.584341 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:23.584311    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-npqqf_fb464081-c56d-4e6e-be54-928b37f50e7d/kube-storage-version-migrator-operator/1.log"
May 25 06:26:23.585222 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:23.585199    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-npqqf_fb464081-c56d-4e6e-be54-928b37f50e7d/kube-storage-version-migrator-operator/0.log"
May 25 06:26:24.038539 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.038465    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rpb87/perf-node-gather-daemonset-bbxqf"
May 25 06:26:24.340216 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.340192    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/kube-multus-additional-cni-plugins/0.log"
May 25 06:26:24.357939 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.357913    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/egress-router-binary-copy/0.log"
May 25 06:26:24.384804 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.384779    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/cni-plugins/0.log"
May 25 06:26:24.403756 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.403730    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/bond-cni-plugin/0.log"
May 25 06:26:24.421191 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.421167    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/routeoverride-cni/0.log"
May 25 06:26:24.438010 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.437987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/whereabouts-cni-bincopy/0.log"
May 25 06:26:24.455239 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.455215    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4cc5d_438670a2-3747-433b-8387-78a11257ee45/whereabouts-cni/0.log"
May 25 06:26:24.771486 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.771412    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ncsps_593f693a-e362-44a6-b492-2003cc4a489f/kube-multus/0.log"
May 25 06:26:24.906630 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.906600    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tcxw8_cb9f7217-4ee1-4d73-a997-ee78a2570a46/network-metrics-daemon/0.log"
May 25 06:26:24.929004 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:24.928975    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tcxw8_cb9f7217-4ee1-4d73-a997-ee78a2570a46/kube-rbac-proxy/0.log"
May 25 06:26:26.070042 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.070009    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-controller/0.log"
May 25 06:26:26.088550 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.088516    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/0.log"
May 25 06:26:26.097091 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.097067    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovn-acl-logging/1.log"
May 25 06:26:26.119957 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.119928    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/kube-rbac-proxy-node/0.log"
May 25 06:26:26.157972 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.157942    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/kube-rbac-proxy-ovn-metrics/0.log"
May 25 06:26:26.176225 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.176201    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/northd/0.log"
May 25 06:26:26.196885 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.196858    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/nbdb/0.log"
May 25 06:26:26.221001 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.220967    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/sbdb/0.log"
May 25 06:26:26.309801 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:26.309696    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pk6gn_3272da78-8f57-42ec-97a7-50317f36f542/ovnkube-controller/0.log"
May 25 06:26:27.586000 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:27.585975    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-kv55l_0d7cc01a-ee7f-48da-9d98-40cf4bf9dec7/check-endpoints/0.log"
May 25 06:26:27.657362 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:27.657287    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q4tlp_f9a1ee32-5081-4d51-8ef9-383d9b9b39e8/network-check-target-container/0.log"
May 25 06:26:28.449959 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:28.449923    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5cffg_bea83059-ff15-484c-a69d-b98f584285cc/iptables-alerter/0.log"
May 25 06:26:29.023383 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:29.023355    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9qv84_660fbf23-48e2-48d3-98f5-3c3ff4e9caed/tuned/0.log"
May 25 06:26:32.190067 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:32.190033    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wnl2v_428c9d01-c18d-4104-9039-b610d2d52a35/csi-driver/0.log"
May 25 06:26:32.208666 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:32.208639    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wnl2v_428c9d01-c18d-4104-9039-b610d2d52a35/csi-node-driver-registrar/0.log"
May 25 06:26:32.228104 ip-10-0-128-119 kubenswrapper[2556]: I0525 06:26:32.228073    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-wnl2v_428c9d01-c18d-4104-9039-b610d2d52a35/csi-liveness-probe/0.log"