May 26 06:19:43.568675 ip-10-0-136-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 06:19:43.568689 ip-10-0-136-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 06:19:43.568699 ip-10-0-136-226 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 06:19:43.569006 ip-10-0-136-226 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 06:19:53.646369 ip-10-0-136-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 06:19:53.646385 ip-10-0-136-226 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7adcc1b3111442e8ba4c31aa4011fadc --
May 26 06:22:15.539854 ip-10-0-136-226 systemd[1]: Starting Kubernetes Kubelet...
May 26 06:22:16.010779 ip-10-0-136-226 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:22:16.010779 ip-10-0-136-226 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 06:22:16.010779 ip-10-0-136-226 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:22:16.010779 ip-10-0-136-226 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 06:22:16.010779 ip-10-0-136-226 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 06:22:16.014178 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.014070    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 06:22:16.019531 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019515    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:22:16.019531 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019530    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019534    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019538    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019541    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019543    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019546    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019549    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019551    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019554    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019557    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019559    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019562    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019565    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019567    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019571    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019573    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019576    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019579    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019582    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019584    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:22:16.019596 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019587    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019590    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019592    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019595    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019597    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019612    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019617    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019621    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019626    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019628    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019632    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019634    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019637    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019640    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019642    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019645    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019648    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019651    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019654    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:22:16.020083 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019656    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019659    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019663    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019668    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019671    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019673    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019676    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019679    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019682    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019684    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019687    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019690    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019692    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019695    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019697    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019701    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019704    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019706    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019709    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:22:16.020543 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019711    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019714    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019717    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019719    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019722    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019724    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019727    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019730    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019735    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019738    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019741    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019743    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019746    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019748    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019751    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019753    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019756    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019758    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019761    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019763    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:22:16.021113 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019766    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019769    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019771    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019774    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019776    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019780    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.019784    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020153    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020158    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020162    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020164    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020167    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020171    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020173    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020176    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020179    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020181    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020184    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020187    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020190    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:22:16.021655 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020193    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020195    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020198    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020201    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020203    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020206    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020209    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020212    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020214    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020216    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020219    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020221    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020224    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020227    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020229    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020232    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020234    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020237    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020240    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020242    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:22:16.022142 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020246    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020251    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020255    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020257    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020260    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020263    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020265    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020268    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020270    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020273    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020275    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020278    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020281    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020283    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020285    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020288    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020290    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020293    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020295    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020298    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:22:16.022675 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020300    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020303    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020305    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020307    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020310    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020312    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020315    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020317    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020320    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020322    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020324    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020327    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020330    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020333    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020336    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020339    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020341    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020344    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020346    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020349    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:22:16.023178 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020351    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020354    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020356    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020360    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020364    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020372    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020375    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020378    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020381    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020383    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020386    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020389    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.020392    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021066    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021075    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021081    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021086    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021095    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021098    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021102    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 06:22:16.023681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021107    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021110    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021113    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021117    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021121    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021124    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021128    2557 flags.go:64] FLAG: --cgroup-root=""
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021131    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021134    2557 flags.go:64] FLAG: --client-ca-file=""
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021137    2557 flags.go:64] FLAG: --cloud-config=""
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021140    2557 flags.go:64] FLAG: --cloud-provider="external"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021143    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021147    2557 flags.go:64] FLAG: --cluster-domain=""
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021149    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021153    2557 flags.go:64] FLAG: --config-dir=""
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021155    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021159    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021162    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021166    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021170    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021173    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021176    2557 flags.go:64] FLAG: --contention-profiling="false"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021179    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021182    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021186    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 06:22:16.024166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021189    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021193    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021196    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021199    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021202    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021205    2557 flags.go:64] FLAG: --enable-server="true"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021208    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021212    2557 flags.go:64] FLAG: --event-burst="100"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021215    2557 flags.go:64] FLAG: --event-qps="50"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021218    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021221    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021225    2557 flags.go:64] FLAG: --eviction-hard=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021229    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021232    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021235    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021238    2557 flags.go:64] FLAG: --eviction-soft=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021241    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021244    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021247    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021249    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021252    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021255    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021258    2557 flags.go:64] FLAG: --feature-gates=""
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021262    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021264    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 06:22:16.024797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021268    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021271    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021275    2557 flags.go:64] FLAG: --healthz-port="10248"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021277    2557 flags.go:64] FLAG: --help="false"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021280    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-136-226.ec2.internal"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021283    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021286    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021290    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021293    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021296    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021300    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021303    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021306    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021309    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021312    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021315    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021318    2557 flags.go:64] FLAG: --kube-reserved=""
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021321    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021323    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021326    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021329    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021332    2557 flags.go:64] FLAG: --lock-file=""
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021335    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021338    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 06:22:16.025403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021341    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021346    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021349    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021352    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021354    2557 flags.go:64] FLAG: --logging-format="text"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021357    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021361    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021364    2557 flags.go:64] FLAG: --manifest-url=""
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021366    2557 flags.go:64] FLAG: --manifest-url-header=""
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021370    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021374    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021378    2557 flags.go:64] FLAG: --max-pods="110"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021381    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021384    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021388    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021391    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021394    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021397    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021402    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021409    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021412    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021415    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021418    2557 flags.go:64] FLAG: --pod-cidr=""
May 26 06:22:16.025982 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021421    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021427    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021430    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021433    2557 flags.go:64] FLAG: --pods-per-core="0"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021436    2557 flags.go:64] FLAG: --port="10250"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021439    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021442    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c5662f430368d8d"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021445    2557 flags.go:64] FLAG: --qos-reserved=""
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021448    2557 flags.go:64] FLAG: --read-only-port="10255"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021451    2557 flags.go:64] FLAG: --register-node="true"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021454    2557 flags.go:64] FLAG: --register-schedulable="true"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021457    2557 flags.go:64] FLAG: --register-with-taints=""
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021460    2557 flags.go:64] FLAG: --registry-burst="10"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021463    2557 flags.go:64] FLAG: --registry-qps="5"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021466    2557 flags.go:64] FLAG: --reserved-cpus=""
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021469    2557 flags.go:64] FLAG: --reserved-memory=""
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021473    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021476    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021479    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021481    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021485    2557 flags.go:64] FLAG: --runonce="false"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021488    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021494    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021497    2557 flags.go:64] FLAG: --seccomp-default="false"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021500    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021503    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 06:22:16.026583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021506    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021511    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021514    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021517    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021520    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021523    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021526    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021529    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021532    2557 flags.go:64] FLAG: --system-cgroups=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021535    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021540    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021543    2557 flags.go:64] FLAG: --tls-cert-file=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021546    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021550    2557 flags.go:64] FLAG: --tls-min-version=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021553    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021555    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021558    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021562    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021565    2557 flags.go:64] FLAG: --v="2"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021569    2557 flags.go:64] FLAG: --version="false"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021573    2557 flags.go:64] FLAG: --vmodule=""
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021578    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021581    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021698    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021703    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:22:16.027266 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021706    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021709    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021712    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021715    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021718    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021720    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021723    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021725    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021729    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021732    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021734    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021737    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021739    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021742    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021744    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021747    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021750    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021752    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021755    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021757    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:22:16.027883 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021760    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021762    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021764    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021767    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021769    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021772    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021776    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021780    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021782    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021785    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021789    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021792    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021795    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021798    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021801    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021804    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021807    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021809    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021812    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:22:16.028570 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021815    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021819    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021822    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021824    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021827    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021829    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021832    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021834    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021837    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021839    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021842    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021844    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021847    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021850    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021852    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021854    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021857    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021859    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021862    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021865    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:22:16.029271 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021867    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021870    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021872    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021875    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021877    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021880    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021882    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021885    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021888    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021891    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021894    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021896    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021899    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021904    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021907    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021909    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021912    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021914    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021917    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:22:16.029921 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021919    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021922    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021925    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021927    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021930    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.021932    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.021937    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.028388    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.028408    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028550    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028566    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028571    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028576    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028581    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028586    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028592    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:22:16.030435 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028596    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028618    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028623    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028627    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028632    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028637    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028646    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028651    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028655    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028660    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028664    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028668    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028673    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028678    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028682    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028687    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028691    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028696    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028700    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028710    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:22:16.030871 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028714    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028718    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028722    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028726    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028732    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028736    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028741    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028745    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028749    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028754    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028758    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028762    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028771    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028775    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028780    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028785    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028789    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028793    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028798    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028802    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:22:16.031354 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028806    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028810    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028814    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028819    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028828    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028832    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028836    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028840    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028844    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028848    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028852    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028857    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028861    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028866    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028870    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028874    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028879    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028890    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028895    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028899    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:22:16.031867 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028904    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028908    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028913    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028917    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028921    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028925    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028930    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028934    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028938    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028947    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028951    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028955    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028961    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028968    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028973    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028979    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028986    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028991    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:22:16.032355 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.028995    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.029003    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029423    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029438    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029442    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029445    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029448    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029452    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029454    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029457    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029460    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029462    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029466    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029469    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029472    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 06:22:16.032909 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029474    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029477    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029479    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029482    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029485    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029487    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029490    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029493    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029496    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029499    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029501    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029504    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029507    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029509    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029512    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029514    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029517    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029519    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029522    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029524    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 06:22:16.033282 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029528    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029531    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029533    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029536    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029539    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029542    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029544    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029547    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029549    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029552    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029555    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029559    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029564    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029567    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029570    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029572    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029575    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029579    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029583    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 06:22:16.033891 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029586    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029589    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029592    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029595    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029599    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029621    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029624    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029627    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029630    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029633    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029636    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029639    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029641    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029644    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029647    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029649    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029652    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029654    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029657    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 06:22:16.034378 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029660    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029662    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029665    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029667    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029670    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029672    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029675    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029677    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029680    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029682    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029685    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029687    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029690    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029692    2557 feature_gate.go:328] unrecognized feature gate: Example
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:16.029695    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.029700    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 06:22:16.034888 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.030500    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 06:22:16.035282 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.033548    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 06:22:16.035282 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.034653    2557 server.go:1019] "Starting client certificate rotation"
May 26 06:22:16.035282 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.034749    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 06:22:16.035282 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.034779    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 06:22:16.058890 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.058873    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 06:22:16.064774 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.064756    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 06:22:16.079584 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.079566    2557 log.go:25] "Validated CRI v1 runtime API"
May 26 06:22:16.084631 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.084614    2557 log.go:25] "Validated CRI v1 image API"
May 26 06:22:16.085762 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.085748    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 06:22:16.088116 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.088097    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bac245f9-8d22-482b-aceb-df8e4a639184:/dev/nvme0n1p3 eaa3bc92-76c1-46cb-a9ee-f1c3a96c9003:/dev/nvme0n1p4]
May 26 06:22:16.088204 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.088116    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 06:22:16.092442 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.092422    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 06:22:16.093983 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.093863    2557 manager.go:217] Machine: {Timestamp:2026-05-26 06:22:16.093358046 +0000 UTC m=+0.429924393 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100242 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26f18576cbe7d80e955eedc5b7b755 SystemUUID:ec26f185-76cb-e7d8-0e95-5eedc5b7b755 BootID:7adcc1b3-1114-42e8-ba4c-31aa4011fadc Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:32:99:6d:ae:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:32:99:6d:ae:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:c1:29:fe:9e:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 06:22:16.093983 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.093981    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 06:22:16.094102 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.094061    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 06:22:16.097270 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.097246    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 06:22:16.097406 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.097273    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 06:22:16.097453 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.097416    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 26 06:22:16.097453 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.097424    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 26 06:22:16.097453 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.097431    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 06:22:16.097453 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.097446    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 06:22:16.099185 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.099174    2557 state_mem.go:36] "Initialized new in-memory state store"
May 26 06:22:16.099289 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.099280    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 06:22:16.101652 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.101643    2557 kubelet.go:491] "Attempting to sync node with API server"
May 26 06:22:16.101694 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.101656    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 06:22:16.102570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.102561    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 06:22:16.102619 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.102573    2557 kubelet.go:397] "Adding apiserver pod source"
May 26 06:22:16.102619 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.102583    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 06:22:16.103758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.103747    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 06:22:16.103809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.103765    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 06:22:16.107099 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.107086    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 06:22:16.109026 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.109013    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 06:22:16.110010 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.109996    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 06:22:16.110048 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110019    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 06:22:16.110048 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110028    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 06:22:16.110048 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110045    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 06:22:16.110132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110066    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 06:22:16.110132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110079    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 06:22:16.110132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110094    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 06:22:16.110132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110104    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 06:22:16.110132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110114    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 06:22:16.110132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110123    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 06:22:16.110291 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110136    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 06:22:16.110521 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.110508    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 06:22:16.111447 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.111435    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 06:22:16.111489 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.111449    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 06:22:16.112458 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.112440    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zd97z"
May 26 06:22:16.114625 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.114594    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 06:22:16.114688 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.114647    2557 server.go:1295] "Started kubelet"
May 26 06:22:16.114779 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.114752    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 06:22:16.114879 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.114865    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 06:22:16.115587 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.115558    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 06:22:16.115687 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.115571    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 06:22:16.115742 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.115656    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 06:22:16.115742 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.115734    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 06:22:16.115929 ip-10-0-136-226 systemd[1]: Started Kubernetes Kubelet.
May 26 06:22:16.117309 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.117294    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 06:22:16.117615 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.117590    2557 server.go:317] "Adding debug handlers to kubelet server"
May 26 06:22:16.119860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.119839    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zd97z"
May 26 06:22:16.122086 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.121015    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-226.ec2.internal.18b3095476aff8b6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-226.ec2.internal,UID:ip-10-0-136-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-226.ec2.internal,},FirstTimestamp:2026-05-26 06:22:16.114624694 +0000 UTC m=+0.451191040,LastTimestamp:2026-05-26 06:22:16.114624694 +0000 UTC m=+0.451191040,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-226.ec2.internal,}"
May 26 06:22:16.123647 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.123628    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 06:22:16.124471 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.124458    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 06:22:16.124971 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.124954    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 06:22:16.125152 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.125134    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 06:22:16.125152 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.125148    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 06:22:16.125315 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.125304    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 06:22:16.125363 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.125355    2557 reconstruct.go:97] "Volume reconstruction finished"
May 26 06:22:16.125363 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.125360    2557 reconciler.go:26] "Reconciler: start to sync state"
May 26 06:22:16.126040 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.125959    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.127391 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127376    2557 factory.go:55] Registering systemd factory
May 26 06:22:16.127391 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127393    2557 factory.go:223] Registration of the systemd container factory successfully
May 26 06:22:16.127614 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127588    2557 factory.go:153] Registering CRI-O factory
May 26 06:22:16.127614 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127615    2557 factory.go:223] Registration of the crio container factory successfully
May 26 06:22:16.127728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127664    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 06:22:16.127728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127681    2557 factory.go:103] Registering Raw factory
May 26 06:22:16.127728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.127695    2557 manager.go:1196] Started watching for new ooms in manager
May 26 06:22:16.128328 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.128316    2557 manager.go:319] Starting recovery of all containers
May 26 06:22:16.133950 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.133921    2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-226.ec2.internal\" not found" node="ip-10-0-136-226.ec2.internal"
May 26 06:22:16.135194 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.135177    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:22:16.142176 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.142163    2557 manager.go:324] Recovery completed
May 26 06:22:16.146081 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.146068    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:22:16.147665 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.147649    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:22:16.147737 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.147685    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:22:16.147737 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.147700    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientPID"
May 26 06:22:16.148196 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.148184    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 06:22:16.148250 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.148196    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 06:22:16.148250 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.148215    2557 state_mem.go:36] "Initialized new in-memory state store"
May 26 06:22:16.150352 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.150341    2557 policy_none.go:49] "None policy: Start"
May 26 06:22:16.150386 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.150356    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 06:22:16.150386 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.150367    2557 state_mem.go:35] "Initializing new in-memory state store"
May 26 06:22:16.195274 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195167    2557 manager.go:341] "Starting Device Plugin manager"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.195295    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195308    2557 server.go:85] "Starting device plugin registration server"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195519    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195537    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195655    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195716    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.195736    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.196188    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 06:22:16.198234 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.196231    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.257420 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.257385    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 06:22:16.258664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.258644    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 06:22:16.261496 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.261449    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 06:22:16.261496 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.261486    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 06:22:16.261496 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.261494    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 06:22:16.261662 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.261530    2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 06:22:16.264038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.264023    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:22:16.296048 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.296025    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:22:16.296940 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.296923    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:22:16.297030 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.296953    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:22:16.297030 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.296962    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientPID"
May 26 06:22:16.297030 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.296987    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-226.ec2.internal"
May 26 06:22:16.304591 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.304578    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-226.ec2.internal"
May 26 06:22:16.304660 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.304597    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-226.ec2.internal\": node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.315340 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.315318    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.361961 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.361933    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"]
May 26 06:22:16.362041 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.362003    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:22:16.362884 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.362869    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:22:16.362954 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.362895    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:22:16.362954 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.362905    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientPID"
May 26 06:22:16.364101 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364090    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:22:16.364261 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364247    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.364307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364282    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:22:16.364819 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364804    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:22:16.364891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364834    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:22:16.364891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364805    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:22:16.364891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364869    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:22:16.364891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364881    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientPID"
May 26 06:22:16.364891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.364849    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientPID"
May 26 06:22:16.365916 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.365904    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.365974 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.365925    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 06:22:16.366838 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.366824    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientMemory"
May 26 06:22:16.366894 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.366853    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasNoDiskPressure"
May 26 06:22:16.366894 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.366867    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeHasSufficientPID"
May 26 06:22:16.390059 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.390041    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-226.ec2.internal\" not found" node="ip-10-0-136-226.ec2.internal"
May 26 06:22:16.394143 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.394130    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-226.ec2.internal\" not found" node="ip-10-0-136-226.ec2.internal"
May 26 06:22:16.415935 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.415918    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.516683 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.516630    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.526941 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.526923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6aa00cc60d2f0297adb81e9a002f98aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal\" (UID: \"6aa00cc60d2f0297adb81e9a002f98aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.526992 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.526947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aa00cc60d2f0297adb81e9a002f98aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal\" (UID: \"6aa00cc60d2f0297adb81e9a002f98aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.526992 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.526963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bdef92636052986ed01d0acb1a884835-config\") pod \"kube-apiserver-proxy-ip-10-0-136-226.ec2.internal\" (UID: \"bdef92636052986ed01d0acb1a884835\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.617221 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.617202    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.627543 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.627519    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6aa00cc60d2f0297adb81e9a002f98aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal\" (UID: \"6aa00cc60d2f0297adb81e9a002f98aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.627633 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.627555    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aa00cc60d2f0297adb81e9a002f98aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal\" (UID: \"6aa00cc60d2f0297adb81e9a002f98aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.627633 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.627581    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bdef92636052986ed01d0acb1a884835-config\") pod \"kube-apiserver-proxy-ip-10-0-136-226.ec2.internal\" (UID: \"bdef92636052986ed01d0acb1a884835\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.627726 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.627639    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6aa00cc60d2f0297adb81e9a002f98aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal\" (UID: \"6aa00cc60d2f0297adb81e9a002f98aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.627726 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.627660    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bdef92636052986ed01d0acb1a884835-config\") pod \"kube-apiserver-proxy-ip-10-0-136-226.ec2.internal\" (UID: \"bdef92636052986ed01d0acb1a884835\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.627726 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.627661    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aa00cc60d2f0297adb81e9a002f98aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal\" (UID: \"6aa00cc60d2f0297adb81e9a002f98aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.692671 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.692643    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.697321 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:16.697307    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"
May 26 06:22:16.717661 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.717628    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.818156 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.818082    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:16.918642 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:16.918615    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:17.019095 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.019070    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-136-226.ec2.internal\" not found"
May 26 06:22:17.034564 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.034541    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 06:22:17.034726 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.034708    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 06:22:17.034767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.034709    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 06:22:17.048244 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.048224    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:22:17.102814 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.102753    2557 apiserver.go:52] "Watching apiserver"
May 26 06:22:17.111067 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.111046    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 06:22:17.111395 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.111373    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-tvfh8","kube-system/konnectivity-agent-zf96s","openshift-dns/node-resolver-t72t4","openshift-multus/multus-cqnml","openshift-ovn-kubernetes/ovnkube-node-775ks","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj","openshift-cluster-node-tuning-operator/tuned-p8zgb","openshift-image-registry/node-ca-ct9nk","openshift-multus/multus-additional-cni-plugins-kmlcg","openshift-multus/network-metrics-daemon-cxsbh","openshift-network-diagnostics/network-check-target-mqcmb"]
May 26 06:22:17.113547 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.113522    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.114538 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.114509    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.115329 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.115308    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 06:22:17.115456 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.115417    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c2g4q\""
May 26 06:22:17.115542 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.115463    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 06:22:17.115542 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.115509    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.115542 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.115533    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 06:22:17.115730 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.115624    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqnml"
May 26 06:22:17.116260 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.116243    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 06:22:17.116339 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.116289    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zkhb8\""
May 26 06:22:17.116974 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.116751    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.116974 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.116780    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 06:22:17.117417 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117401    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 06:22:17.117549 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117536    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 06:22:17.117763 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117597    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ts64k\""
May 26 06:22:17.117763 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117648    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 06:22:17.117763 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117666    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 06:22:17.117763 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117695    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2wdc\""
May 26 06:22:17.117763 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.117749    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 06:22:17.118024 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118007    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.118024 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118016    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 06:22:17.118513 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118492    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 06:22:17.118620 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118573    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 06:22:17.118841 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118825    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g4rth\""
May 26 06:22:17.118899 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118862    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 06:22:17.118948 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.118911    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 06:22:17.119085 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.119071    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 06:22:17.119135 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.119101    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 06:22:17.119387 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.119349    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 06:22:17.119554 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.119539    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.119664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.119651    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 06:22:17.119819 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.119800    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 06:22:17.120080 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.120062    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zf9gq\""
May 26 06:22:17.120910 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.120885    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.120980 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.120955    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 06:22:17.121321 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.121307    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 06:22:17.121321 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.121315    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6l57g\""
May 26 06:22:17.121885 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.121865    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 06:17:16 +0000 UTC" deadline="2028-02-28 07:14:36.096335342 +0000 UTC"
May 26 06:22:17.121932 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.121885    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15432h52m18.974452286s"
May 26 06:22:17.122013 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.122003    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.122476 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.122460    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 06:22:17.122739 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.122726    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 06:22:17.122807 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.122769    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w7qh9\""
May 26 06:22:17.122907 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.122893    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 06:22:17.123018 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.122991    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.123098 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.123069    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:17.123366 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.123352    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 06:22:17.123744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.123731    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 06:22:17.123804 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.123745    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m8rp7\""
May 26 06:22:17.124259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.124245    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:17.124303 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.124290    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:17.124894 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.124880    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 06:22:17.125177 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.125165    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"
May 26 06:22:17.129507 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129489    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 06:22:17.129634 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:17.129634 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5b84\" (UniqueName: \"kubernetes.io/projected/190a73cc-9e56-42fe-8d88-6760d0b5ec69-kube-api-access-d5b84\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.129749 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.129749 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovnkube-script-lib\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.129749 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f8848e7-b881-4c6a-8b3f-065fca5100a0-hosts-file\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.129897 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f8848e7-b881-4c6a-8b3f-065fca5100a0-tmp-dir\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.129897 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129778    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-cni-netd\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.129897 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndjjq\" (UniqueName: \"kubernetes.io/projected/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-kube-api-access-ndjjq\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.129897 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m27km\" (UniqueName: \"kubernetes.io/projected/d7529446-02e9-4a69-8ae6-9134bf3b7bda-kube-api-access-m27km\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.129897 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysctl-conf\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.129897 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-run\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6zr\" (UniqueName: \"kubernetes.io/projected/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-kube-api-access-xp6zr\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129925    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-run-netns\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-device-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.129982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-etc-kubernetes\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130028    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130050    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-env-overrides\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jj6\" (UniqueName: \"kubernetes.io/projected/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-kube-api-access-t8jj6\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-socket-dir-parent\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-registration-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-sys-fs\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e069bd11-87f4-4aec-bec6-2a8dab6eeadf-konnectivity-ca\") pod \"konnectivity-agent-zf96s\" (UID: \"e069bd11-87f4-4aec-bec6-2a8dab6eeadf\") " pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-hostroot\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-daemon-config\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130282    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9lgm\" (UniqueName: \"kubernetes.io/projected/2cbb447f-ec05-4a9e-aefc-87810df1b166-kube-api-access-k9lgm\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130301    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36ddea7d-2bc9-40a3-a670-1be374220adc-host\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130315    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r66z7\" (UniqueName: \"kubernetes.io/projected/36ddea7d-2bc9-40a3-a670-1be374220adc-kube-api-access-r66z7\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-socket-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130373    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-system-cni-dir\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-var-lib-kubelet\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130442    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-ovn\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130464    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysconfig\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-k8s-cni-cncf-io\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-cni-bin\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-conf-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.130527 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysctl-d\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-kubelet\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-cnibin\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-sys\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130632    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190a73cc-9e56-42fe-8d88-6760d0b5ec69-tmp\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130658    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-systemd\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130677    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-log-socket\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-kubelet\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-os-release\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130800    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-system-cni-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-lib-modules\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130873    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36ddea7d-2bc9-40a3-a670-1be374220adc-serviceca\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-node-log\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.131164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130968    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-modprobe-d\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.130992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-os-release\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131027    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-multus-certs\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-systemd\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-etc-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131080    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovn-node-metrics-cert\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-cnibin\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7529446-02e9-4a69-8ae6-9134bf3b7bda-iptables-alerter-script\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cbb447f-ec05-4a9e-aefc-87810df1b166-cni-binary-copy\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131192    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-tuned\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b624\" (UniqueName: \"kubernetes.io/projected/5f8848e7-b881-4c6a-8b3f-065fca5100a0-kube-api-access-6b624\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-var-lib-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-cni-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.132038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-netns\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-host\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-systemd-units\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-run-ovn-kubernetes\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovnkube-config\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx2sc\" (UniqueName: \"kubernetes.io/projected/2684635f-8b95-4dee-a43f-21dc59707299-kube-api-access-qx2sc\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-cni-multus\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-kubernetes\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131569    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-slash\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-cni-bin\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131630    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7529446-02e9-4a69-8ae6-9134bf3b7bda-host-slash\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.132482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.131644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e069bd11-87f4-4aec-bec6-2a8dab6eeadf-agent-certs\") pod \"konnectivity-agent-zf96s\" (UID: \"e069bd11-87f4-4aec-bec6-2a8dab6eeadf\") " pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.133189 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.133173    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 06:22:17.136614 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.136592    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 06:22:17.136664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.136656    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"
May 26 06:22:17.136727 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.136710    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal"]
May 26 06:22:17.145052 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.145027    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 06:22:17.145140 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.145102    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal"]
May 26 06:22:17.157000 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.156983    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-njmct"
May 26 06:22:17.162615 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.162570    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa00cc60d2f0297adb81e9a002f98aa.slice/crio-06e9449790412899d228cb130ff051855daa0a9bedcf05bab84b8485c6966803 WatchSource:0}: Error finding container 06e9449790412899d228cb130ff051855daa0a9bedcf05bab84b8485c6966803: Status 404 returned error can't find the container with id 06e9449790412899d228cb130ff051855daa0a9bedcf05bab84b8485c6966803
May 26 06:22:17.162863 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.162839    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdef92636052986ed01d0acb1a884835.slice/crio-2fe76c2ced7143d5c18ad772b1e8e85c07851e20d798f7e139c9dbe8d71a8945 WatchSource:0}: Error finding container 2fe76c2ced7143d5c18ad772b1e8e85c07851e20d798f7e139c9dbe8d71a8945: Status 404 returned error can't find the container with id 2fe76c2ced7143d5c18ad772b1e8e85c07851e20d798f7e139c9dbe8d71a8945
May 26 06:22:17.165415 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.165327    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-njmct"
May 26 06:22:17.166260 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.166247    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 06:22:17.232014 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.231986    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-run-ovn-kubernetes\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232019    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovnkube-config\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232043    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx2sc\" (UniqueName: \"kubernetes.io/projected/2684635f-8b95-4dee-a43f-21dc59707299-kube-api-access-qx2sc\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.232125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232068    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-cni-multus\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.232125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232091    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-kubernetes\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.232125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232092    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-run-ovn-kubernetes\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232114    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-slash\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232136    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-cni-bin\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232151    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-cni-multus\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232189    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-cni-bin\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232216    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-slash\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232216    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-kubernetes\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232254    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7529446-02e9-4a69-8ae6-9134bf3b7bda-host-slash\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232306    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7529446-02e9-4a69-8ae6-9134bf3b7bda-host-slash\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232307    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e069bd11-87f4-4aec-bec6-2a8dab6eeadf-agent-certs\") pod \"konnectivity-agent-zf96s\" (UID: \"e069bd11-87f4-4aec-bec6-2a8dab6eeadf\") " pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232343    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232366    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d5b84\" (UniqueName: \"kubernetes.io/projected/190a73cc-9e56-42fe-8d88-6760d0b5ec69-kube-api-access-d5b84\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.232405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232413    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovnkube-script-lib\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232437    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f8848e7-b881-4c6a-8b3f-065fca5100a0-hosts-file\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232462    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f8848e7-b881-4c6a-8b3f-065fca5100a0-tmp-dir\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232487    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-cni-netd\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232485    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232566    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5f8848e7-b881-4c6a-8b3f-065fca5100a0-hosts-file\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232647    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-cni-netd\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232657    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232685    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovnkube-config\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232679    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndjjq\" (UniqueName: \"kubernetes.io/projected/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-kube-api-access-ndjjq\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232733    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m27km\" (UniqueName: \"kubernetes.io/projected/d7529446-02e9-4a69-8ae6-9134bf3b7bda-kube-api-access-m27km\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232758    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysctl-conf\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232781    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-run\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232807    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6zr\" (UniqueName: \"kubernetes.io/projected/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-kube-api-access-xp6zr\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232825    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f8848e7-b881-4c6a-8b3f-065fca5100a0-tmp-dir\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232831    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-run-netns\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232855    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-device-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.232906 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232879    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232901    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-etc-kubernetes\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232915    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysctl-conf\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232925    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232921    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-run-netns\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232947    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-env-overrides\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232972    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jj6\" (UniqueName: \"kubernetes.io/projected/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-kube-api-access-t8jj6\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.232998    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-socket-dir-parent\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233017    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovnkube-script-lib\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233023    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-registration-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233048    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-run\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.233025    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233050    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-sys-fs\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233069    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-etc-kubernetes\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233096    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e069bd11-87f4-4aec-bec6-2a8dab6eeadf-konnectivity-ca\") pod \"konnectivity-agent-zf96s\" (UID: \"e069bd11-87f4-4aec-bec6-2a8dab6eeadf\") " pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233109    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-device-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233120    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-sys-fs\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233129    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-hostroot\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.233568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233165    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-socket-dir-parent\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.233172    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:17.733151908 +0000 UTC m=+2.069718269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233192    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-hostroot\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233195    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-daemon-config\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233226    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k9lgm\" (UniqueName: \"kubernetes.io/projected/2cbb447f-ec05-4a9e-aefc-87810df1b166-kube-api-access-k9lgm\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233249    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36ddea7d-2bc9-40a3-a670-1be374220adc-host\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233261    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-etc-selinux\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233275    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r66z7\" (UniqueName: \"kubernetes.io/projected/36ddea7d-2bc9-40a3-a670-1be374220adc-kube-api-access-r66z7\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233300    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-socket-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233324    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-system-cni-dir\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233350    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-var-lib-kubelet\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233397    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-ovn\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233407    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-env-overrides\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233421    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysconfig\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233463    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-k8s-cni-cncf-io\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233478    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/36ddea7d-2bc9-40a3-a670-1be374220adc-host\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233490    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-cni-bin\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.234341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233495    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-system-cni-dir\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233165    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-registration-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233548    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-ovn\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233555    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-k8s-cni-cncf-io\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233562    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-conf-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233591    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysctl-d\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233638    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-kubelet\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233596    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-cni-bin\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233639    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-socket-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233650    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysconfig\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233691    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e069bd11-87f4-4aec-bec6-2a8dab6eeadf-konnectivity-ca\") pod \"konnectivity-agent-zf96s\" (UID: \"e069bd11-87f4-4aec-bec6-2a8dab6eeadf\") " pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233701    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-kubelet\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233710    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-var-lib-kubelet\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233644    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-conf-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233706    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233771    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-cnibin\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233787    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-sys\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233771    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-sysctl-d\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233787    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-daemon-config\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233809    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-cnibin\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233809    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190a73cc-9e56-42fe-8d88-6760d0b5ec69-tmp\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233847    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-sys\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233859    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-systemd\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233892    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-log-socket\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233914    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-kubelet\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233930    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233939    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-log-socket\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233955    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-os-release\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233983    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233893    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-run-systemd\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233986    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-var-lib-kubelet\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.233998    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234010    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-system-cni-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234043    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-lib-modules\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234055    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-system-cni-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234068    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36ddea7d-2bc9-40a3-a670-1be374220adc-serviceca\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.235891 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234091    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-node-log\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234114    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234147    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-lib-modules\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234140    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-modprobe-d\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234177    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-cni-binary-copy\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234187    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-node-log\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234199    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-os-release\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234226    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-multus-certs\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234266    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-systemd\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234267    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-modprobe-d\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234283    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-os-release\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234227    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234305    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-multus-certs\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234326    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-systemd\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234346    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-etc-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234375    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovn-node-metrics-cert\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234400    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-cnibin\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.236511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234428    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7529446-02e9-4a69-8ae6-9134bf3b7bda-iptables-alerter-script\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234444    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-os-release\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234452    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cbb447f-ec05-4a9e-aefc-87810df1b166-cni-binary-copy\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234476    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-tuned\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234500    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b624\" (UniqueName: \"kubernetes.io/projected/5f8848e7-b881-4c6a-8b3f-065fca5100a0-kube-api-access-6b624\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234525    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234545    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/36ddea7d-2bc9-40a3-a670-1be374220adc-serviceca\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234618    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-cnibin\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234667    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-etc-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234943    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-var-lib-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.234987    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235019    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235026    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d7529446-02e9-4a69-8ae6-9134bf3b7bda-iptables-alerter-script\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235046    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-cni-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235081    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-netns\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235117    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cbb447f-ec05-4a9e-aefc-87810df1b166-cni-binary-copy\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235152    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2684635f-8b95-4dee-a43f-21dc59707299-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-var-lib-openvswitch\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235206    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-multus-cni-dir\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235194    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-host\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235246    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-systemd-units\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-systemd-units\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235324    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cbb447f-ec05-4a9e-aefc-87810df1b166-host-run-netns\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235364    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/190a73cc-9e56-42fe-8d88-6760d0b5ec69-host\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.235552    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2684635f-8b95-4dee-a43f-21dc59707299-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.236281    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190a73cc-9e56-42fe-8d88-6760d0b5ec69-tmp\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.236567    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-ovn-node-metrics-cert\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.236633    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e069bd11-87f4-4aec-bec6-2a8dab6eeadf-agent-certs\") pod \"konnectivity-agent-zf96s\" (UID: \"e069bd11-87f4-4aec-bec6-2a8dab6eeadf\") " pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.236901    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/190a73cc-9e56-42fe-8d88-6760d0b5ec69-etc-tuned\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.237258    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.237272    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.237281    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:17.237540 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.237331    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:17.737319438 +0000 UTC m=+2.073885772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:17.241859 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.241808    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx2sc\" (UniqueName: \"kubernetes.io/projected/2684635f-8b95-4dee-a43f-21dc59707299-kube-api-access-qx2sc\") pod \"multus-additional-cni-plugins-kmlcg\" (UID: \"2684635f-8b95-4dee-a43f-21dc59707299\") " pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.241968 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.241858    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5b84\" (UniqueName: \"kubernetes.io/projected/190a73cc-9e56-42fe-8d88-6760d0b5ec69-kube-api-access-d5b84\") pod \"tuned-p8zgb\" (UID: \"190a73cc-9e56-42fe-8d88-6760d0b5ec69\") " pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.241968 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.241858    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jj6\" (UniqueName: \"kubernetes.io/projected/5c687cd4-2e6b-4f16-a7eb-573663e9f9dd-kube-api-access-t8jj6\") pod \"aws-ebs-csi-driver-node-78nvj\" (UID: \"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.242583 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.242562    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m27km\" (UniqueName: \"kubernetes.io/projected/d7529446-02e9-4a69-8ae6-9134bf3b7bda-kube-api-access-m27km\") pod \"iptables-alerter-tvfh8\" (UID: \"d7529446-02e9-4a69-8ae6-9134bf3b7bda\") " pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.242998 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.242969    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9lgm\" (UniqueName: \"kubernetes.io/projected/2cbb447f-ec05-4a9e-aefc-87810df1b166-kube-api-access-k9lgm\") pod \"multus-cqnml\" (UID: \"2cbb447f-ec05-4a9e-aefc-87810df1b166\") " pod="openshift-multus/multus-cqnml"
May 26 06:22:17.243080 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.243006    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r66z7\" (UniqueName: \"kubernetes.io/projected/36ddea7d-2bc9-40a3-a670-1be374220adc-kube-api-access-r66z7\") pod \"node-ca-ct9nk\" (UID: \"36ddea7d-2bc9-40a3-a670-1be374220adc\") " pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.243391 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.243370    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndjjq\" (UniqueName: \"kubernetes.io/projected/f395fbd7-6f0a-4a08-a6d0-c711ad3a323a-kube-api-access-ndjjq\") pod \"ovnkube-node-775ks\" (UID: \"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a\") " pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.243941 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.243923    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6zr\" (UniqueName: \"kubernetes.io/projected/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-kube-api-access-xp6zr\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.244110 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.244093    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b624\" (UniqueName: \"kubernetes.io/projected/5f8848e7-b881-4c6a-8b3f-065fca5100a0-kube-api-access-6b624\") pod \"node-resolver-t72t4\" (UID: \"5f8848e7-b881-4c6a-8b3f-065fca5100a0\") " pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.264803 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.264769    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal" event={"ID":"6aa00cc60d2f0297adb81e9a002f98aa","Type":"ContainerStarted","Data":"06e9449790412899d228cb130ff051855daa0a9bedcf05bab84b8485c6966803"}
May 26 06:22:17.265744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.265719    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal" event={"ID":"bdef92636052986ed01d0acb1a884835","Type":"ContainerStarted","Data":"2fe76c2ced7143d5c18ad772b1e8e85c07851e20d798f7e139c9dbe8d71a8945"}
May 26 06:22:17.268134 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.268119    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:22:17.445700 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.445635    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tvfh8"
May 26 06:22:17.451914 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.451893    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7529446_02e9_4a69_8ae6_9134bf3b7bda.slice/crio-663a24a66a41fc89148f5e2723c90c30c70b669c90ef8bdd07a73a39946fe180 WatchSource:0}: Error finding container 663a24a66a41fc89148f5e2723c90c30c70b669c90ef8bdd07a73a39946fe180: Status 404 returned error can't find the container with id 663a24a66a41fc89148f5e2723c90c30c70b669c90ef8bdd07a73a39946fe180
May 26 06:22:17.464302 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.464283    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:17.469703 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.469683    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode069bd11_87f4_4aec_bec6_2a8dab6eeadf.slice/crio-dc07d7954ecd723dcf5931e4bd1f903574f25c534a3d97916530df1694f3161e WatchSource:0}: Error finding container dc07d7954ecd723dcf5931e4bd1f903574f25c534a3d97916530df1694f3161e: Status 404 returned error can't find the container with id dc07d7954ecd723dcf5931e4bd1f903574f25c534a3d97916530df1694f3161e
May 26 06:22:17.470157 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.470140    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t72t4"
May 26 06:22:17.474658 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.474643    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cqnml"
May 26 06:22:17.476715 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.476679    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8848e7_b881_4c6a_8b3f_065fca5100a0.slice/crio-370f170b380d6d218a83a2e4d029e85b592dda48518473820696a3813c2a587f WatchSource:0}: Error finding container 370f170b380d6d218a83a2e4d029e85b592dda48518473820696a3813c2a587f: Status 404 returned error can't find the container with id 370f170b380d6d218a83a2e4d029e85b592dda48518473820696a3813c2a587f
May 26 06:22:17.480588 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.480553    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:17.482063 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.482044    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbb447f_ec05_4a9e_aefc_87810df1b166.slice/crio-863ad48cf0ed258df91f4429d5b7f326a10b2f0e2854aa79ba5fb39a6fc919d6 WatchSource:0}: Error finding container 863ad48cf0ed258df91f4429d5b7f326a10b2f0e2854aa79ba5fb39a6fc919d6: Status 404 returned error can't find the container with id 863ad48cf0ed258df91f4429d5b7f326a10b2f0e2854aa79ba5fb39a6fc919d6
May 26 06:22:17.486094 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.486075    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj"
May 26 06:22:17.486343 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.486317    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf395fbd7_6f0a_4a08_a6d0_c711ad3a323a.slice/crio-8cb37c296653e4408741e010c8a480b9d587dbc140fb81e2e2be3163c7bdb566 WatchSource:0}: Error finding container 8cb37c296653e4408741e010c8a480b9d587dbc140fb81e2e2be3163c7bdb566: Status 404 returned error can't find the container with id 8cb37c296653e4408741e010c8a480b9d587dbc140fb81e2e2be3163c7bdb566
May 26 06:22:17.491277 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.491258    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-p8zgb"
May 26 06:22:17.491746 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.491725    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c687cd4_2e6b_4f16_a7eb_573663e9f9dd.slice/crio-332731f387a5a0a3447167402852ef0d223e9c70d34d78aa6991b2e6a8d14a7b WatchSource:0}: Error finding container 332731f387a5a0a3447167402852ef0d223e9c70d34d78aa6991b2e6a8d14a7b: Status 404 returned error can't find the container with id 332731f387a5a0a3447167402852ef0d223e9c70d34d78aa6991b2e6a8d14a7b
May 26 06:22:17.496294 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.496269    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ct9nk"
May 26 06:22:17.496910 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.496801    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190a73cc_9e56_42fe_8d88_6760d0b5ec69.slice/crio-d1da0e7dad111cf7714b977edb2de861f768d3c367df39bb6ffdeb76a3d8b6eb WatchSource:0}: Error finding container d1da0e7dad111cf7714b977edb2de861f768d3c367df39bb6ffdeb76a3d8b6eb: Status 404 returned error can't find the container with id d1da0e7dad111cf7714b977edb2de861f768d3c367df39bb6ffdeb76a3d8b6eb
May 26 06:22:17.502224 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.502200    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ddea7d_2bc9_40a3_a670_1be374220adc.slice/crio-04eb8ed686a70e9767316d3ee67dd0ccb91ed10fb3fc0858e88523e6eef57ef7 WatchSource:0}: Error finding container 04eb8ed686a70e9767316d3ee67dd0ccb91ed10fb3fc0858e88523e6eef57ef7: Status 404 returned error can't find the container with id 04eb8ed686a70e9767316d3ee67dd0ccb91ed10fb3fc0858e88523e6eef57ef7
May 26 06:22:17.507892 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.507877    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kmlcg"
May 26 06:22:17.513338 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:17.513314    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2684635f_8b95_4dee_a43f_21dc59707299.slice/crio-d97be86954e7fb914f4dec4dd6baa9ea46db0a2584986082d5e1e65eafc953e8 WatchSource:0}: Error finding container d97be86954e7fb914f4dec4dd6baa9ea46db0a2584986082d5e1e65eafc953e8: Status 404 returned error can't find the container with id d97be86954e7fb914f4dec4dd6baa9ea46db0a2584986082d5e1e65eafc953e8
May 26 06:22:17.739138 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.739108    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:17.739285 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.739161    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:17.739347 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.739304    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:17.739347 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.739327    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:17.739438 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.739347    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:17.739438 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.739359    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:18.739341106 +0000 UTC m=+3.075907454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:17.739438 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.739362    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:17.739438 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:17.739418    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:18.739398288 +0000 UTC m=+3.075964625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:17.958434 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:17.958358    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:22:18.167074 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.166995    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 06:17:17 +0000 UTC" deadline="2028-02-25 15:24:02.870510418 +0000 UTC"
May 26 06:22:18.167074 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.167028    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15369h1m44.703485594s"
May 26 06:22:18.285801 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.285717    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"8cb37c296653e4408741e010c8a480b9d587dbc140fb81e2e2be3163c7bdb566"}
May 26 06:22:18.293218 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.293119    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zf96s" event={"ID":"e069bd11-87f4-4aec-bec6-2a8dab6eeadf","Type":"ContainerStarted","Data":"dc07d7954ecd723dcf5931e4bd1f903574f25c534a3d97916530df1694f3161e"}
May 26 06:22:18.303302 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.303272    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tvfh8" event={"ID":"d7529446-02e9-4a69-8ae6-9134bf3b7bda","Type":"ContainerStarted","Data":"663a24a66a41fc89148f5e2723c90c30c70b669c90ef8bdd07a73a39946fe180"}
May 26 06:22:18.309332 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.309279    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerStarted","Data":"d97be86954e7fb914f4dec4dd6baa9ea46db0a2584986082d5e1e65eafc953e8"}
May 26 06:22:18.331689 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.331656    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqnml" event={"ID":"2cbb447f-ec05-4a9e-aefc-87810df1b166","Type":"ContainerStarted","Data":"863ad48cf0ed258df91f4429d5b7f326a10b2f0e2854aa79ba5fb39a6fc919d6"}
May 26 06:22:18.342126 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.342098    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t72t4" event={"ID":"5f8848e7-b881-4c6a-8b3f-065fca5100a0","Type":"ContainerStarted","Data":"370f170b380d6d218a83a2e4d029e85b592dda48518473820696a3813c2a587f"}
May 26 06:22:18.361762 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.361731    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ct9nk" event={"ID":"36ddea7d-2bc9-40a3-a670-1be374220adc","Type":"ContainerStarted","Data":"04eb8ed686a70e9767316d3ee67dd0ccb91ed10fb3fc0858e88523e6eef57ef7"}
May 26 06:22:18.372821 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.372795    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p8zgb" event={"ID":"190a73cc-9e56-42fe-8d88-6760d0b5ec69","Type":"ContainerStarted","Data":"d1da0e7dad111cf7714b977edb2de861f768d3c367df39bb6ffdeb76a3d8b6eb"}
May 26 06:22:18.377215 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.377190    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj" event={"ID":"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd","Type":"ContainerStarted","Data":"332731f387a5a0a3447167402852ef0d223e9c70d34d78aa6991b2e6a8d14a7b"}
May 26 06:22:18.631116 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.630875    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 06:22:18.747711 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.747675    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:18.747867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:18.747731    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:18.747867 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:18.747850    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:18.747976 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:18.747908    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:20.747888725 +0000 UTC m=+5.084455073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:18.748344 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:18.748324    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:18.748344 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:18.748347    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:18.748504 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:18.748359    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:18.748504 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:18.748402    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:20.74838731 +0000 UTC m=+5.084953647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:19.168087 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:19.168045    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 06:17:17 +0000 UTC" deadline="2028-02-29 02:55:48.300037642 +0000 UTC"
May 26 06:22:19.168087 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:19.168083    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15452h33m29.131958196s"
May 26 06:22:19.262231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:19.262204    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:19.262447 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:19.262327    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:19.262800 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:19.262781    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:19.262931 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:19.262888    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:20.765877    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:20.765939    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:20.766106    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:20.766202    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:24.766165472 +0000 UTC m=+9.102731823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:20.766640    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:20.766658    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:20.766673    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:20.766767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:20.766719    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:24.766704559 +0000 UTC m=+9.103270899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:21.262231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.262150    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:21.262432 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:21.262302    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:21.262737 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.262714    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:21.262870 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:21.262808    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:21.844285 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.843512    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8zwbx"]
May 26 06:22:21.849765 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.849732    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.849912 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:21.849813    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:21.876451 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.876418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/854814a8-d769-443f-9c2a-f9bbb8647689-dbus\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.876582 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.876466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.876666 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.876598    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/854814a8-d769-443f-9c2a-f9bbb8647689-kubelet-config\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.977333 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.977176    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.977750 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.977724    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/854814a8-d769-443f-9c2a-f9bbb8647689-kubelet-config\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.977823 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.977799    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/854814a8-d769-443f-9c2a-f9bbb8647689-dbus\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.985466 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:21.985421    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:22:21.985621 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.985422    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/854814a8-d769-443f-9c2a-f9bbb8647689-kubelet-config\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:21.985621 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:21.985567    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret podName:854814a8-d769-443f-9c2a-f9bbb8647689 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:22.485544512 +0000 UTC m=+6.822110852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret") pod "global-pull-secret-syncer-8zwbx" (UID: "854814a8-d769-443f-9c2a-f9bbb8647689") : object "kube-system"/"original-pull-secret" not registered
May 26 06:22:21.986158 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:21.986137    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/854814a8-d769-443f-9c2a-f9bbb8647689-dbus\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:22.583899 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:22.583866    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:22.584082 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:22.584014    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:22:22.584146 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:22.584087    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret podName:854814a8-d769-443f-9c2a-f9bbb8647689 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:23.584066207 +0000 UTC m=+7.920632557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret") pod "global-pull-secret-syncer-8zwbx" (UID: "854814a8-d769-443f-9c2a-f9bbb8647689") : object "kube-system"/"original-pull-secret" not registered
May 26 06:22:23.262505 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:23.262466    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:23.262969 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:23.262467    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:23.262969 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:23.262619    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:23.262969 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:23.262727    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:23.591495 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:23.591413    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:23.591666 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:23.591640    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:22:23.591727 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:23.591712    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret podName:854814a8-d769-443f-9c2a-f9bbb8647689 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:25.591692381 +0000 UTC m=+9.928258721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret") pod "global-pull-secret-syncer-8zwbx" (UID: "854814a8-d769-443f-9c2a-f9bbb8647689") : object "kube-system"/"original-pull-secret" not registered
May 26 06:22:24.262165 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:24.262131    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:24.262346 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.262260    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:24.799984 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:24.799876    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:24.799984 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:24.799936    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:24.800479 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.800049    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:24.800479 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.800062    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:24.800479 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.800071    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:24.800479 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.800086    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:24.800479 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.800117    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:32.8000988 +0000 UTC m=+17.136665153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:24.800479 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:24.800135    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:32.800125914 +0000 UTC m=+17.136692252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:25.262515 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:25.262438    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:25.262515 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:25.262472    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:25.262749 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:25.262559    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:25.262749 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:25.262697    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:25.606337 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:25.606296    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:25.606508 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:25.606409    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:22:25.606508 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:25.606473    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret podName:854814a8-d769-443f-9c2a-f9bbb8647689 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:29.606456039 +0000 UTC m=+13.943022388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret") pod "global-pull-secret-syncer-8zwbx" (UID: "854814a8-d769-443f-9c2a-f9bbb8647689") : object "kube-system"/"original-pull-secret" not registered
May 26 06:22:26.265317 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:26.265284    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:26.265705 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:26.265408    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:27.262673 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:27.262635    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:27.262863 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:27.262635    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:27.262863 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:27.262752    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:27.262863 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:27.262796    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:28.262740 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:28.262706    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:28.263188 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:28.262840    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:29.262150 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:29.262119    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:29.262150 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:29.262145    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:29.262347 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:29.262246    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:29.262419 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:29.262376    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:29.637254 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:29.637154    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:29.637618 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:29.637311    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:22:29.637618 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:29.637377    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret podName:854814a8-d769-443f-9c2a-f9bbb8647689 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:37.637357824 +0000 UTC m=+21.973924161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret") pod "global-pull-secret-syncer-8zwbx" (UID: "854814a8-d769-443f-9c2a-f9bbb8647689") : object "kube-system"/"original-pull-secret" not registered
May 26 06:22:30.264733 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:30.264701    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:30.264905 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:30.264833    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:31.262266 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:31.262230    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:31.262689 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:31.262350    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:31.262689 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:31.262438    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:31.262689 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:31.262557    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:32.262666 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.262426    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:32.263117 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.262713    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:32.406420 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.406382    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-p8zgb" event={"ID":"190a73cc-9e56-42fe-8d88-6760d0b5ec69","Type":"ContainerStarted","Data":"2b6327afb3c682488ca0560b8b21989fc4d303517c4fb5feac7908fd2d984106"}
May 26 06:22:32.408038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.408007    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal" event={"ID":"bdef92636052986ed01d0acb1a884835","Type":"ContainerStarted","Data":"b99fac97fe16dbb35376f3a141f28fafc023eee4bb008c9ad3a7b34382e42d1b"}
May 26 06:22:32.409645 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.409615    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cqnml" event={"ID":"2cbb447f-ec05-4a9e-aefc-87810df1b166","Type":"ContainerStarted","Data":"88549a524faea804788bf195a15895e838b1f3488069b33e4153b6fa90e4d50a"}
May 26 06:22:32.423760 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.423692    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-p8zgb" podStartSLOduration=2.518172017 podStartE2EDuration="16.423676148s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.498049359 +0000 UTC m=+1.834615699" lastFinishedPulling="2026-05-26 06:22:31.403553497 +0000 UTC m=+15.740119830" observedRunningTime="2026-05-26 06:22:32.423110402 +0000 UTC m=+16.759676761" watchObservedRunningTime="2026-05-26 06:22:32.423676148 +0000 UTC m=+16.760242506"
May 26 06:22:32.436825 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.436781    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-cqnml" podStartSLOduration=2.007646076 podStartE2EDuration="16.436767978s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.483545902 +0000 UTC m=+1.820112240" lastFinishedPulling="2026-05-26 06:22:31.912667809 +0000 UTC m=+16.249234142" observedRunningTime="2026-05-26 06:22:32.436352748 +0000 UTC m=+16.772919112" watchObservedRunningTime="2026-05-26 06:22:32.436767978 +0000 UTC m=+16.773334333"
May 26 06:22:32.447784 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.447737    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-226.ec2.internal" podStartSLOduration=15.447722137 podStartE2EDuration="15.447722137s" podCreationTimestamp="2026-05-26 06:22:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:22:32.447146357 +0000 UTC m=+16.783712716" watchObservedRunningTime="2026-05-26 06:22:32.447722137 +0000 UTC m=+16.784288493"
May 26 06:22:32.864787 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.864749    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:32.864939 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:32.864800    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:32.864939 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.864913    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:32.865027 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.864943    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:32.865027 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.864917    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:32.865027 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.864956    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:32.865027 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.864995    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:48.864980761 +0000 UTC m=+33.201547095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:32.865027 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:32.865016    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:48.865001488 +0000 UTC m=+33.201567822 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:33.262016 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.261798    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:33.262183 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.261872    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:33.262183 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:33.262114    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:33.262278 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:33.262189    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:33.413240 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.413139    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal" event={"ID":"6aa00cc60d2f0297adb81e9a002f98aa","Type":"ContainerStarted","Data":"93900003cecf46147c12e958d43a143b8f75218f9eba0b6c21369ce713f4d6dc"}
May 26 06:22:33.414648 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.414621    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerStarted","Data":"0cd51ac807ca37f2616563fd5dfa2c3cc92858d3d6c215c800e55ce98378aaad"}
May 26 06:22:33.416022 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.415998    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t72t4" event={"ID":"5f8848e7-b881-4c6a-8b3f-065fca5100a0","Type":"ContainerStarted","Data":"9d66a82842a5bc79842105f5d52b6b131da98fed51fb20cd07190c99732ac292"}
May 26 06:22:33.417377 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.417350    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ct9nk" event={"ID":"36ddea7d-2bc9-40a3-a670-1be374220adc","Type":"ContainerStarted","Data":"2794a9b3154aaa7254642d4d0f5acc824b4e258a4df2319f6e4cba5ce8ad169f"}
May 26 06:22:33.418730 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.418708    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj" event={"ID":"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd","Type":"ContainerStarted","Data":"8adfa5bd09a63cbfd0ec1c3b1a570cfa91ab9c69d87bcfe37efa775108c58665"}
May 26 06:22:33.419998 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.419976    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zf96s" event={"ID":"e069bd11-87f4-4aec-bec6-2a8dab6eeadf","Type":"ContainerStarted","Data":"48f57957ef1eb43379de25cbe9da9f17decb512a22b56a5f0b4194d809953eb6"}
May 26 06:22:33.421314 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.421279    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tvfh8" event={"ID":"d7529446-02e9-4a69-8ae6-9134bf3b7bda","Type":"ContainerStarted","Data":"8982a5fc45102509fcbca1ae670549210e44f54e0b8029b521d438077fe0db5f"}
May 26 06:22:33.436811 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.436762    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-t72t4" podStartSLOduration=3.515878483 podStartE2EDuration="17.436748933s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.480427999 +0000 UTC m=+1.816994336" lastFinishedPulling="2026-05-26 06:22:31.401298452 +0000 UTC m=+15.737864786" observedRunningTime="2026-05-26 06:22:33.436275646 +0000 UTC m=+17.772842004" watchObservedRunningTime="2026-05-26 06:22:33.436748933 +0000 UTC m=+17.773315289"
May 26 06:22:33.447568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.447527    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ct9nk" podStartSLOduration=7.287578047 podStartE2EDuration="17.447512442s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.503656338 +0000 UTC m=+1.840222676" lastFinishedPulling="2026-05-26 06:22:27.663590721 +0000 UTC m=+12.000157071" observedRunningTime="2026-05-26 06:22:33.447116588 +0000 UTC m=+17.783682944" watchObservedRunningTime="2026-05-26 06:22:33.447512442 +0000 UTC m=+17.784078798"
May 26 06:22:33.475050 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.475015    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tvfh8" podStartSLOduration=3.527172212 podStartE2EDuration="17.474998827s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.453419109 +0000 UTC m=+1.789985457" lastFinishedPulling="2026-05-26 06:22:31.401245733 +0000 UTC m=+15.737812072" observedRunningTime="2026-05-26 06:22:33.474420051 +0000 UTC m=+17.810986408" watchObservedRunningTime="2026-05-26 06:22:33.474998827 +0000 UTC m=+17.811565183"
May 26 06:22:33.486092 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:33.486050    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zf96s" podStartSLOduration=3.6091605700000002 podStartE2EDuration="17.486036445s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.471241332 +0000 UTC m=+1.807807669" lastFinishedPulling="2026-05-26 06:22:31.34811721 +0000 UTC m=+15.684683544" observedRunningTime="2026-05-26 06:22:33.485909258 +0000 UTC m=+17.822475615" watchObservedRunningTime="2026-05-26 06:22:33.486036445 +0000 UTC m=+17.822602803"
May 26 06:22:34.265738 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:34.265705    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:34.265918 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:34.265821    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:35.262725 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:35.262686    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:35.262725 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:35.262703    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:35.263281 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:35.262793    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:35.263281 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:35.262937    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:35.525620 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:35.525514    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:35.526196 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:35.526174    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:36.265460 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:36.265431    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:36.265927 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:36.265559    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:36.428418 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:36.428389    2557 generic.go:358] "Generic (PLEG): container finished" podID="6aa00cc60d2f0297adb81e9a002f98aa" containerID="93900003cecf46147c12e958d43a143b8f75218f9eba0b6c21369ce713f4d6dc" exitCode=0
May 26 06:22:36.428568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:36.428465    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal" event={"ID":"6aa00cc60d2f0297adb81e9a002f98aa","Type":"ContainerDied","Data":"93900003cecf46147c12e958d43a143b8f75218f9eba0b6c21369ce713f4d6dc"}
May 26 06:22:36.429717 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:36.429695    2557 generic.go:358] "Generic (PLEG): container finished" podID="2684635f-8b95-4dee-a43f-21dc59707299" containerID="0cd51ac807ca37f2616563fd5dfa2c3cc92858d3d6c215c800e55ce98378aaad" exitCode=0
May 26 06:22:36.429834 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:36.429777    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerDied","Data":"0cd51ac807ca37f2616563fd5dfa2c3cc92858d3d6c215c800e55ce98378aaad"}
May 26 06:22:37.027987 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.027633    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 06:22:37.206868 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.206722    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T06:22:37.027985736Z","UUID":"d62c7b81-fb24-43a6-b0c5-9e8a531b6827","Handler":null,"Name":"","Endpoint":""}
May 26 06:22:37.208290 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.208265    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 06:22:37.208426 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.208314    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 06:22:37.262458 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.262430    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:37.262589 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.262433    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:37.262589 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:37.262534    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:37.262683 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:37.262634    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:37.433456 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.433418    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj" event={"ID":"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd","Type":"ContainerStarted","Data":"24be0371b316d5bef5412b62663d454286402a43d286c0038c413cd53c3db226"}
May 26 06:22:37.436826 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.436620    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"d05d53741c4e58e224d378944cf1018a4f5b51f31fcc50eae29c81d686b7f988"}
May 26 06:22:37.436826 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.436655    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"65f15a7e973b025356d0d4f932fdd22937a2c95d446eb2a5e5340e0c01716c0c"}
May 26 06:22:37.436826 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.436671    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"8230634373f7e67180debe89292edfb1138d5a2efa81813e02824419591d717a"}
May 26 06:22:37.436826 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.436684    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"517dffd2a78abed65c31bc4b6d333e865808d87950ae0d24aa7b8650e2f32d9c"}
May 26 06:22:37.436826 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.436698    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"72b302f38f96cd1262e7b5dfe589e6fc45628b88459defca1f989c70670c8116"}
May 26 06:22:37.436826 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.436710    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"8d39589c2ceaaa90aaf2d2aa7b2003b0f460e4b5f41c594cd34bac7f47ab2b80"}
May 26 06:22:37.438694 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.438667    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal" event={"ID":"6aa00cc60d2f0297adb81e9a002f98aa","Type":"ContainerStarted","Data":"1cfb755fae450d46de116b231684b13bfd50aad448e76362c9668a5f2eef28e9"}
May 26 06:22:37.704535 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:37.704432    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:37.704720 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:37.704697    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 06:22:37.704800 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:37.704786    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret podName:854814a8-d769-443f-9c2a-f9bbb8647689 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:53.70476482 +0000 UTC m=+38.041331155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret") pod "global-pull-secret-syncer-8zwbx" (UID: "854814a8-d769-443f-9c2a-f9bbb8647689") : object "kube-system"/"original-pull-secret" not registered
May 26 06:22:38.262663 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:38.262621    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:38.262860 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:38.262737    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:38.442582 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:38.442544    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj" event={"ID":"5c687cd4-2e6b-4f16-a7eb-573663e9f9dd","Type":"ContainerStarted","Data":"4dfd080de5c59276bf26285e5caf31244ce38cca3293adf7662eb679e2cfbc35"}
May 26 06:22:38.459903 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:38.459848    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-78nvj" podStartSLOduration=2.150823081 podStartE2EDuration="22.45982994s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.494090075 +0000 UTC m=+1.830656409" lastFinishedPulling="2026-05-26 06:22:37.803096925 +0000 UTC m=+22.139663268" observedRunningTime="2026-05-26 06:22:38.459769933 +0000 UTC m=+22.796336300" watchObservedRunningTime="2026-05-26 06:22:38.45982994 +0000 UTC m=+22.796396297"
May 26 06:22:38.460685 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:38.460653    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-226.ec2.internal" podStartSLOduration=21.460641974 podStartE2EDuration="21.460641974s" podCreationTimestamp="2026-05-26 06:22:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:22:37.452668567 +0000 UTC m=+21.789234964" watchObservedRunningTime="2026-05-26 06:22:38.460641974 +0000 UTC m=+22.797208352"
May 26 06:22:39.262657 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:39.262627    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:39.262838 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:39.262637    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:39.262838 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:39.262745    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:39.262967 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:39.262855    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:39.448185 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:39.448103    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"61766f8e588a3ad376aa78d0747d4c95e9e5e5bf18e33a4972a7141636d8a501"}
May 26 06:22:39.501370 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:39.501337    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:39.501535 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:39.501493    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 06:22:39.501989 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:39.501912    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zf96s"
May 26 06:22:40.264935 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:40.264906    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:40.265100 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:40.265006    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:41.262681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.262541    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:41.263225 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.262537    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:41.263225 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:41.262785    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:41.263225 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:41.262827    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:41.454634 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.454510    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" event={"ID":"f395fbd7-6f0a-4a08-a6d0-c711ad3a323a","Type":"ContainerStarted","Data":"cb91fea429024a1fd181fbe4d0bd4191693dfc025bcd2cf74b4d6db980a156bc"}
May 26 06:22:41.454797 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.454716    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:41.454855 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.454824    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:41.454898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.454864    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:41.456229 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.456201    2557 generic.go:358] "Generic (PLEG): container finished" podID="2684635f-8b95-4dee-a43f-21dc59707299" containerID="18664cb384fe94c77963c71551d59e5650447df12d23863814d832329a22807d" exitCode=0
May 26 06:22:41.456345 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.456246    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerDied","Data":"18664cb384fe94c77963c71551d59e5650447df12d23863814d832329a22807d"}
May 26 06:22:41.470158 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.470137    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:41.470251 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.470199    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:22:41.476252 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:41.476214    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-775ks" podStartSLOduration=6.523338009 podStartE2EDuration="25.476203378s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.488879442 +0000 UTC m=+1.825445779" lastFinishedPulling="2026-05-26 06:22:36.441744799 +0000 UTC m=+20.778311148" observedRunningTime="2026-05-26 06:22:41.475321564 +0000 UTC m=+25.811887919" watchObservedRunningTime="2026-05-26 06:22:41.476203378 +0000 UTC m=+25.812769734"
May 26 06:22:42.266839 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:42.266812    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:42.267168 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:42.266918    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:42.460211 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:42.460129    2557 generic.go:358] "Generic (PLEG): container finished" podID="2684635f-8b95-4dee-a43f-21dc59707299" containerID="8d8f353177f498f6d76217ea131f5bfafdcf31cdeac8b50ee618bf4433966842" exitCode=0
May 26 06:22:42.460347 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:42.460213    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerDied","Data":"8d8f353177f498f6d76217ea131f5bfafdcf31cdeac8b50ee618bf4433966842"}
May 26 06:22:43.072955 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:43.072911    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqcmb"]
May 26 06:22:43.073177 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:43.073073    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:43.073257 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:43.073173    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:43.075723 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:43.075694    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8zwbx"]
May 26 06:22:43.075842 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:43.075796    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:43.075903 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:43.075886    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:43.076335 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:43.076308    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxsbh"]
May 26 06:22:43.076457 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:43.076421    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:43.076559 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:43.076523    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:44.262526 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:44.262297    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:44.262945 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:44.262652    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:44.466570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:44.466542    2557 generic.go:358] "Generic (PLEG): container finished" podID="2684635f-8b95-4dee-a43f-21dc59707299" containerID="06c3720807ef12ff7a46bc053ac19ccd9a186a304cad769a4f56bcc5935ab738" exitCode=0
May 26 06:22:44.466761 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:44.466588    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerDied","Data":"06c3720807ef12ff7a46bc053ac19ccd9a186a304cad769a4f56bcc5935ab738"}
May 26 06:22:45.262757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:45.262725    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:45.263101 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:45.262856    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:45.263101 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:45.262909    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:45.263101 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:45.263003    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:46.263550 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:46.263519    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:46.264020 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:46.263658    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:47.261838 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:47.261813    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:47.261962 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:47.261813    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:47.261962 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:47.261919    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:47.262075 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:47.261990    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:48.262481 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:48.262396    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:48.263104 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.262546    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:22:48.889406 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:48.889351    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:48.889629 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:48.889417    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:48.889629 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.889544    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 06:22:48.889629 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.889572    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 06:22:48.889629 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.889582    2557 projected.go:194] Error preparing data for projected volume kube-api-access-5qswz for pod openshift-network-diagnostics/network-check-target-mqcmb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:48.889629 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.889591    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:48.889887 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.889651    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz podName:3fdb5f4e-efbb-4102-a30c-756008053b56 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:20.889635548 +0000 UTC m=+65.226201882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5qswz" (UniqueName: "kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz") pod "network-check-target-mqcmb" (UID: "3fdb5f4e-efbb-4102-a30c-756008053b56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 06:22:48.889887 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:48.889667    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:20.889660109 +0000 UTC m=+65.226226443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 06:22:49.261919 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:49.261834    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:49.262071 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:49.261834    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:49.262071 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:49.261953    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mqcmb" podUID="3fdb5f4e-efbb-4102-a30c-756008053b56"
May 26 06:22:49.262186 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:49.262067    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8zwbx" podUID="854814a8-d769-443f-9c2a-f9bbb8647689"
May 26 06:22:50.016744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.016719    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-136-226.ec2.internal" event="NodeReady"
May 26 06:22:50.017125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.016819    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 06:22:50.048249 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.048214    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-584588465c-ndkn6"]
May 26 06:22:50.061757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.061589    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-p87p8"]
May 26 06:22:50.061757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.061747    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.063813 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.063792    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 06:22:50.063895 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.063797    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jpfbb\""
May 26 06:22:50.064200 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.064183    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 06:22:50.064415 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.064395    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 06:22:50.068619 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.068583    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 06:22:50.077027 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.076965    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x9k28"]
May 26 06:22:50.077131 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.077090    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.082409 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.079803    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 06:22:50.082409 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.080060    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4k6pb\""
May 26 06:22:50.082409 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.080502    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 06:22:50.091850 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.091806    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584588465c-ndkn6"]
May 26 06:22:50.091850 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.091831    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p87p8"]
May 26 06:22:50.091850 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.091845    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x9k28"]
May 26 06:22:50.092037 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.091960    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.093827 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.093810    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 06:22:50.093920 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.093809    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 06:22:50.093920 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.093909    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hb4dz\""
May 26 06:22:50.094016 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.093950    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 06:22:50.199635 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-installation-pull-secrets\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.199816 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddgjx\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-kube-api-access-ddgjx\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.199816 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-ca-trust-extracted\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.199816 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.199816 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d979-0aeb-4405-8da0-7e46bfc82076-tmp-dir\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199821    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-image-registry-private-configuration\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199862    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-certificates\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199916    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-bound-sa-token\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-trusted-ca\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.199972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9p8\" (UniqueName: \"kubernetes.io/projected/71f9d979-0aeb-4405-8da0-7e46bfc82076-kube-api-access-fz9p8\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.200019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.200004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.200242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.200037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf27f\" (UniqueName: \"kubernetes.io/projected/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-kube-api-access-lf27f\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.200242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.200059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71f9d979-0aeb-4405-8da0-7e46bfc82076-config-volume\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.262021 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.261965    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:22:50.264012 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.263990    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 06:22:50.264125 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.264013    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5zglb\""
May 26 06:22:50.301282 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301264    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.301380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301291    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lf27f\" (UniqueName: \"kubernetes.io/projected/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-kube-api-access-lf27f\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.301380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301308    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71f9d979-0aeb-4405-8da0-7e46bfc82076-config-volume\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.301380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301344    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-installation-pull-secrets\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.301380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301362    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddgjx\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-kube-api-access-ddgjx\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.301380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301380    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-ca-trust-extracted\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301407    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301419    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301427    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d979-0aeb-4405-8da0-7e46bfc82076-tmp-dir\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301438    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301459    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-image-registry-private-configuration\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301506    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:22:50.80148575 +0000 UTC m=+35.138052091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301523    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301533    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-certificates\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301568    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301599    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:50.801569376 +0000 UTC m=+35.138135711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:22:50.301664 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301654    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301675    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-bound-sa-token\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.301691    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:50.801678385 +0000 UTC m=+35.138244734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301729    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-trusted-ca\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301756    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9p8\" (UniqueName: \"kubernetes.io/projected/71f9d979-0aeb-4405-8da0-7e46bfc82076-kube-api-access-fz9p8\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.301989    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71f9d979-0aeb-4405-8da0-7e46bfc82076-tmp-dir\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.302055    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/71f9d979-0aeb-4405-8da0-7e46bfc82076-config-volume\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.302209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.302190    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-certificates\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.302581 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.302234    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-ca-trust-extracted\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.302780 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.302761    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-trusted-ca\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.305198 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.305174    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-image-registry-private-configuration\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.305276 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.305213    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-installation-pull-secrets\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.309281 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.309236    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf27f\" (UniqueName: \"kubernetes.io/projected/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-kube-api-access-lf27f\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.309986 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.309961    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddgjx\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-kube-api-access-ddgjx\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.310094 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.310080    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-bound-sa-token\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.310474 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.310447    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9p8\" (UniqueName: \"kubernetes.io/projected/71f9d979-0aeb-4405-8da0-7e46bfc82076-kube-api-access-fz9p8\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.479956 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.479930    2557 generic.go:358] "Generic (PLEG): container finished" podID="2684635f-8b95-4dee-a43f-21dc59707299" containerID="62e8bb6ad26045a221b7f59ddc3f0311f97dab39474b3cda854e8d00dd3d1a68" exitCode=0
May 26 06:22:50.480108 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.479967    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerDied","Data":"62e8bb6ad26045a221b7f59ddc3f0311f97dab39474b3cda854e8d00dd3d1a68"}
May 26 06:22:50.805443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.805378    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:50.805443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.805441    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:50.805468    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805511    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805530    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805559    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805570    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805586    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:22:51.805571648 +0000 UTC m=+36.142137983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:22:50.805698 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805599    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:51.805592725 +0000 UTC m=+36.142159060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:22:50.806272 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:50.805626    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:51.805620301 +0000 UTC m=+36.142186635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:22:51.262694 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.262599    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:22:51.263190 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.262599    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:51.264886 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.264866    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r4vrz\""
May 26 06:22:51.264986 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.264896    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 06:22:51.264986 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.264911    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 06:22:51.265136 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.265123    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 06:22:51.484245 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.484217    2557 generic.go:358] "Generic (PLEG): container finished" podID="2684635f-8b95-4dee-a43f-21dc59707299" containerID="3b2dc430a0e7a4404f1482b17e9a16bb0d8691342d133544f110e74ad0406459" exitCode=0
May 26 06:22:51.484393 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.484283    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerDied","Data":"3b2dc430a0e7a4404f1482b17e9a16bb0d8691342d133544f110e74ad0406459"}
May 26 06:22:51.814364 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.814283    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:51.814364 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.814344    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:51.814506 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:51.814394    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:51.814506 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814433    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:22:51.814506 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814486    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:22:51.814506 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814498    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:22:51.814506 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814504    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:53.814484759 +0000 UTC m=+38.151051113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:22:51.814720 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814435    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:22:51.814720 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814538    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:22:53.814528794 +0000 UTC m=+38.151095130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:22:51.814720 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:51.814585    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:53.814570268 +0000 UTC m=+38.151136601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:22:52.489278 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:52.489242    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" event={"ID":"2684635f-8b95-4dee-a43f-21dc59707299","Type":"ContainerStarted","Data":"4467864b04648225fde1b28e6088225f451cdb5a232d436c197e6679a2b1069e"}
May 26 06:22:52.509201 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:52.509159    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kmlcg" podStartSLOduration=4.022910762 podStartE2EDuration="36.509146971s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:22:17.514820959 +0000 UTC m=+1.851387293" lastFinishedPulling="2026-05-26 06:22:50.001057158 +0000 UTC m=+34.337623502" observedRunningTime="2026-05-26 06:22:52.508126992 +0000 UTC m=+36.844693348" watchObservedRunningTime="2026-05-26 06:22:52.509146971 +0000 UTC m=+36.845713327"
May 26 06:22:53.727819 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:53.727785    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:53.729996 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:53.729979    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/854814a8-d769-443f-9c2a-f9bbb8647689-original-pull-secret\") pod \"global-pull-secret-syncer-8zwbx\" (UID: \"854814a8-d769-443f-9c2a-f9bbb8647689\") " pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:53.828054 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:53.828028    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:53.828169 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:53.828083    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:53.828169 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:53.828157    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:53.828255 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828163    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:22:53.828255 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828192    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:22:53.828255 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828202    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:22:53.828255 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828247    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:22:53.828379 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828249    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:57.828227428 +0000 UTC m=+42.164793761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:22:53.828379 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828299    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:22:57.828287417 +0000 UTC m=+42.164853751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:22:53.828379 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:53.828310    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:22:57.828304237 +0000 UTC m=+42.164870571 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:22:53.976788 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:53.976756    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8zwbx"
May 26 06:22:54.136419 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:54.136392    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8zwbx"]
May 26 06:22:54.140363 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:22:54.140331    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854814a8_d769_443f_9c2a_f9bbb8647689.slice/crio-0f17288f8195432fbcf4bfb80345d761c158dd0fa290bff5db408e8e150f67ad WatchSource:0}: Error finding container 0f17288f8195432fbcf4bfb80345d761c158dd0fa290bff5db408e8e150f67ad: Status 404 returned error can't find the container with id 0f17288f8195432fbcf4bfb80345d761c158dd0fa290bff5db408e8e150f67ad
May 26 06:22:54.493537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:54.493505    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8zwbx" event={"ID":"854814a8-d769-443f-9c2a-f9bbb8647689","Type":"ContainerStarted","Data":"0f17288f8195432fbcf4bfb80345d761c158dd0fa290bff5db408e8e150f67ad"}
May 26 06:22:57.855616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:57.855558    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:57.855718    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:57.855755    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855717    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855821    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:05.855806294 +0000 UTC m=+50.192372628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855760    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855864    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855877    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855902    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:05.855885695 +0000 UTC m=+50.192452047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:22:57.856011 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:22:57.855918    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:23:05.855911872 +0000 UTC m=+50.192478205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:22:58.503017 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:58.502976    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8zwbx" event={"ID":"854814a8-d769-443f-9c2a-f9bbb8647689","Type":"ContainerStarted","Data":"6ee365b3eb7a6f887c2b802706b756acb7db7e2d645b3b4d83c8850a97aadc37"}
May 26 06:22:58.515578 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:22:58.515530    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8zwbx" podStartSLOduration=33.622314445 podStartE2EDuration="37.515516005s" podCreationTimestamp="2026-05-26 06:22:21 +0000 UTC" firstStartedPulling="2026-05-26 06:22:54.142054101 +0000 UTC m=+38.478620435" lastFinishedPulling="2026-05-26 06:22:58.035255655 +0000 UTC m=+42.371821995" observedRunningTime="2026-05-26 06:22:58.5153749 +0000 UTC m=+42.851941256" watchObservedRunningTime="2026-05-26 06:22:58.515516005 +0000 UTC m=+42.852082361"
May 26 06:23:05.908769 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:05.908723    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:23:05.908769 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:05.908785    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:05.908822    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.908887    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.908932    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.908935    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.908960    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:21.908940228 +0000 UTC m=+66.245506583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.908944    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.909014    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:21.908995495 +0000 UTC m=+66.245561832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:23:05.909243 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:05.909076    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:23:21.90905807 +0000 UTC m=+66.245624405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:23:13.472924 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:13.472896    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-775ks"
May 26 06:23:20.915772 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.915727    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:23:20.916209 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.915807    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:23:20.917846 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.917813    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 06:23:20.917846 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.917816    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 06:23:20.926335 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:20.926312    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 06:23:20.926396 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:20.926377    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:24.926361099 +0000 UTC m=+129.262927433 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : secret "metrics-daemon-secret" not found
May 26 06:23:20.927905 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.927890    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 06:23:20.938721 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.938699    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qswz\" (UniqueName: \"kubernetes.io/projected/3fdb5f4e-efbb-4102-a30c-756008053b56-kube-api-access-5qswz\") pod \"network-check-target-mqcmb\" (UID: \"3fdb5f4e-efbb-4102-a30c-756008053b56\") " pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:23:20.973205 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.973185    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r4vrz\""
May 26 06:23:20.982549 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:20.982534    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:23:21.117733 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:21.117705    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mqcmb"]
May 26 06:23:21.121005 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:23:21.120967    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fdb5f4e_efbb_4102_a30c_756008053b56.slice/crio-c243d05c97e16d5c36da81cbfba0e0dcb8ca4be5f258278c290cb68102072f17 WatchSource:0}: Error finding container c243d05c97e16d5c36da81cbfba0e0dcb8ca4be5f258278c290cb68102072f17: Status 404 returned error can't find the container with id c243d05c97e16d5c36da81cbfba0e0dcb8ca4be5f258278c290cb68102072f17
May 26 06:23:21.544787 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:21.544757    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqcmb" event={"ID":"3fdb5f4e-efbb-4102-a30c-756008053b56","Type":"ContainerStarted","Data":"c243d05c97e16d5c36da81cbfba0e0dcb8ca4be5f258278c290cb68102072f17"}
May 26 06:23:21.923561 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:21.923526    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:21.923574    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:21.923629    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923728    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923748    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923760    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923775    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923799    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:53.923780652 +0000 UTC m=+98.260347007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923818    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:23:53.923808192 +0000 UTC m=+98.260374526 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:23:21.924029 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:21.923832    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:23:53.923824516 +0000 UTC m=+98.260390851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:23:24.552866 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:24.552760    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mqcmb" event={"ID":"3fdb5f4e-efbb-4102-a30c-756008053b56","Type":"ContainerStarted","Data":"07cf01056baf2ed440dc519b50a79ebdfdc449919843dc0d93bf9695ac5e8391"}
May 26 06:23:24.553295 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:24.552931    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:23:24.566518 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:24.566470    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mqcmb" podStartSLOduration=65.486398531 podStartE2EDuration="1m8.566456523s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:23:21.122837325 +0000 UTC m=+65.459403664" lastFinishedPulling="2026-05-26 06:23:24.202895322 +0000 UTC m=+68.539461656" observedRunningTime="2026-05-26 06:23:24.566255714 +0000 UTC m=+68.902822069" watchObservedRunningTime="2026-05-26 06:23:24.566456523 +0000 UTC m=+68.903022876"
May 26 06:23:53.941740 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:53.941706    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:23:53.941740 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:53.941750    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") pod \"image-registry-584588465c-ndkn6\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") " pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941846    2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941857    2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584588465c-ndkn6: secret "image-registry-tls" not found
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:53.941880    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941909    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls podName:9ea43a5b-4a14-4f7a-a50f-ca57726596ad nodeName:}" failed. No retries permitted until 2026-05-26 06:24:57.941895282 +0000 UTC m=+162.278461624 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls") pod "image-registry-584588465c-ndkn6" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad") : secret "image-registry-tls" not found
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941846    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941948    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941972    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert podName:97e82fce-5c69-4787-bcfe-bf4a6e2317c8 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:57.941957873 +0000 UTC m=+162.278524224 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert") pod "ingress-canary-x9k28" (UID: "97e82fce-5c69-4787-bcfe-bf4a6e2317c8") : secret "canary-serving-cert" not found
May 26 06:23:53.942190 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:23:53.941986    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls podName:71f9d979-0aeb-4405-8da0-7e46bfc82076 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:57.94198052 +0000 UTC m=+162.278546853 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls") pod "dns-default-p87p8" (UID: "71f9d979-0aeb-4405-8da0-7e46bfc82076") : secret "dns-default-metrics-tls" not found
May 26 06:23:55.556504 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:23:55.556472    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mqcmb"
May 26 06:24:13.215339 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.215307    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-568c577cb4-nt5lh"]
May 26 06:24:13.217399 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.217382    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.219524 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219499    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 26 06:24:13.219675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219528    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 26 06:24:13.219675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219569    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 06:24:13.219675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219645    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 06:24:13.219675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219666    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wbb9x\""
May 26 06:24:13.219911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219894    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 26 06:24:13.219969 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.219901    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 26 06:24:13.226644 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.226625    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-568c577cb4-nt5lh"]
May 26 06:24:13.372157 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.372119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnts\" (UniqueName: \"kubernetes.io/projected/2fa0e2ca-97a8-400b-9103-6ca95838a915-kube-api-access-kpnts\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.372329 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.372171    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.372329 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.372216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-stats-auth\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.372329 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.372263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-default-certificate\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.372329 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.372280    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.472757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.472690    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnts\" (UniqueName: \"kubernetes.io/projected/2fa0e2ca-97a8-400b-9103-6ca95838a915-kube-api-access-kpnts\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.472757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.472731    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.472757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.472752    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-stats-auth\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.472963 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:13.472840    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 06:24:13.472963 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:13.472909    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:13.972889893 +0000 UTC m=+118.309456248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : secret "router-metrics-certs-default" not found
May 26 06:24:13.472963 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.472956    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-default-certificate\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.473097 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.472983    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.473262 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:13.473109    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:13.973098603 +0000 UTC m=+118.309664938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : configmap references non-existent config key: service-ca.crt
May 26 06:24:13.477109 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.475966    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-default-certificate\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.477820 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.477801    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-stats-auth\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.480469 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.480447    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnts\" (UniqueName: \"kubernetes.io/projected/2fa0e2ca-97a8-400b-9103-6ca95838a915-kube-api-access-kpnts\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.976853 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.976816    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.977026 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:13.976885    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:13.977026 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:13.976956    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 06:24:13.977026 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:13.977006    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:14.976989384 +0000 UTC m=+119.313555725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : configmap references non-existent config key: service-ca.crt
May 26 06:24:13.977026 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:13.977027    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:14.977020909 +0000 UTC m=+119.313587243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : secret "router-metrics-certs-default" not found
May 26 06:24:14.983894 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:14.983860    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:14.984257 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:14.983932    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:14.984257 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:14.984010    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 06:24:14.984257 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:14.984065    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:16.984047997 +0000 UTC m=+121.320614330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : configmap references non-existent config key: service-ca.crt
May 26 06:24:14.984257 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:14.984097    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:16.984089332 +0000 UTC m=+121.320655665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : secret "router-metrics-certs-default" not found
May 26 06:24:17.000649 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:17.000595    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:17.001015 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:17.000680    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:17.001015 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:17.000779    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 06:24:17.001015 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:17.000788    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:21.00077081 +0000 UTC m=+125.337337168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : configmap references non-existent config key: service-ca.crt
May 26 06:24:17.001015 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:17.000819    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:21.000805842 +0000 UTC m=+125.337372179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : secret "router-metrics-certs-default" not found
May 26 06:24:18.628353 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:18.628328    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t72t4_5f8848e7-b881-4c6a-8b3f-065fca5100a0/dns-node-resolver/0.log"
May 26 06:24:19.628508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:19.628482    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ct9nk_36ddea7d-2bc9-40a3-a670-1be374220adc/node-ca/0.log"
May 26 06:24:21.036443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:21.036386    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:21.036922 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:21.036545    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 06:24:21.036922 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:21.036571    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:21.036922 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:21.036624    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:29.036593237 +0000 UTC m=+133.373159570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : secret "router-metrics-certs-default" not found
May 26 06:24:21.036922 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:21.036690    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:29.03667743 +0000 UTC m=+133.373243763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : configmap references non-existent config key: service-ca.crt
May 26 06:24:24.963038 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:24.963002    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:24:24.963429 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:24.963148    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 06:24:24.963429 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:24.963221    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs podName:f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5 nodeName:}" failed. No retries permitted until 2026-05-26 06:26:26.963204592 +0000 UTC m=+251.299770927 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs") pod "network-metrics-daemon-cxsbh" (UID: "f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5") : secret "metrics-daemon-secret" not found
May 26 06:24:28.057090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.057057    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"]
May 26 06:24:28.058977 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.058961    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"
May 26 06:24:28.061572 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.061549    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2jb2r\""
May 26 06:24:28.061710 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.061547    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 26 06:24:28.061710 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.061549    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 26 06:24:28.067662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.067641    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"]
May 26 06:24:28.184746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.184708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwmg4\" (UniqueName: \"kubernetes.io/projected/ff5c686b-b3c2-444a-9f0b-051795ba913a-kube-api-access-rwmg4\") pod \"migrator-b985f5d89-jr9jn\" (UID: \"ff5c686b-b3c2-444a-9f0b-051795ba913a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"
May 26 06:24:28.285406 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.285375    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmg4\" (UniqueName: \"kubernetes.io/projected/ff5c686b-b3c2-444a-9f0b-051795ba913a-kube-api-access-rwmg4\") pod \"migrator-b985f5d89-jr9jn\" (UID: \"ff5c686b-b3c2-444a-9f0b-051795ba913a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"
May 26 06:24:28.292630 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.292588    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwmg4\" (UniqueName: \"kubernetes.io/projected/ff5c686b-b3c2-444a-9f0b-051795ba913a-kube-api-access-rwmg4\") pod \"migrator-b985f5d89-jr9jn\" (UID: \"ff5c686b-b3c2-444a-9f0b-051795ba913a\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"
May 26 06:24:28.367774 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.367673    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"
May 26 06:24:28.483921 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.483887    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn"]
May 26 06:24:28.487259 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:28.487230    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5c686b_b3c2_444a_9f0b_051795ba913a.slice/crio-b1373dac6240151a5f9f8fca03d3b3917e32b82217501a2647fef398db3be83d WatchSource:0}: Error finding container b1373dac6240151a5f9f8fca03d3b3917e32b82217501a2647fef398db3be83d: Status 404 returned error can't find the container with id b1373dac6240151a5f9f8fca03d3b3917e32b82217501a2647fef398db3be83d
May 26 06:24:28.669075 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:28.669043    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn" event={"ID":"ff5c686b-b3c2-444a-9f0b-051795ba913a","Type":"ContainerStarted","Data":"b1373dac6240151a5f9f8fca03d3b3917e32b82217501a2647fef398db3be83d"}
May 26 06:24:29.090857 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.090767    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:29.091321 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.090874    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:29.091321 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:29.090960    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:45.090928628 +0000 UTC m=+149.427494976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : configmap references non-existent config key: service-ca.crt
May 26 06:24:29.091321 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:29.091033    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 06:24:29.091321 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:29.091090    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs podName:2fa0e2ca-97a8-400b-9103-6ca95838a915 nodeName:}" failed. No retries permitted until 2026-05-26 06:24:45.091072986 +0000 UTC m=+149.427639338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs") pod "router-default-568c577cb4-nt5lh" (UID: "2fa0e2ca-97a8-400b-9103-6ca95838a915") : secret "router-metrics-certs-default" not found
May 26 06:24:29.875436 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.875399    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mhjjw"]
May 26 06:24:29.877388 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.877366    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:29.879466 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.879413    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 06:24:29.879549 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.879451    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 06:24:29.880049 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.879924    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 06:24:29.880196 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.880064    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 06:24:29.881292 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.880321    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-czv7d\""
May 26 06:24:29.886171 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.886148    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mhjjw"]
May 26 06:24:29.999392 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.999350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af31bdea-bd6f-42a5-ae97-8518aeeae01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:29.999392 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.999402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af31bdea-bd6f-42a5-ae97-8518aeeae01e-crio-socket\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:29.999587 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.999452    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31bdea-bd6f-42a5-ae97-8518aeeae01e-data-volume\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:29.999587 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.999522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vdpt\" (UniqueName: \"kubernetes.io/projected/af31bdea-bd6f-42a5-ae97-8518aeeae01e-kube-api-access-8vdpt\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:29.999587 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:29.999547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100092 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100047    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vdpt\" (UniqueName: \"kubernetes.io/projected/af31bdea-bd6f-42a5-ae97-8518aeeae01e-kube-api-access-8vdpt\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100107    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100403 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:30.100195    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 06:24:30.100403 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:30.100270    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls podName:af31bdea-bd6f-42a5-ae97-8518aeeae01e nodeName:}" failed. No retries permitted until 2026-05-26 06:24:30.600248768 +0000 UTC m=+134.936815122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mhjjw" (UID: "af31bdea-bd6f-42a5-ae97-8518aeeae01e") : secret "insights-runtime-extractor-tls" not found
May 26 06:24:30.100508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100471    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af31bdea-bd6f-42a5-ae97-8518aeeae01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100544 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100516    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af31bdea-bd6f-42a5-ae97-8518aeeae01e-crio-socket\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100544 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100532    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31bdea-bd6f-42a5-ae97-8518aeeae01e-data-volume\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100637 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100595    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af31bdea-bd6f-42a5-ae97-8518aeeae01e-crio-socket\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.100902 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100888    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af31bdea-bd6f-42a5-ae97-8518aeeae01e-data-volume\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.101009 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.100989    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af31bdea-bd6f-42a5-ae97-8518aeeae01e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.107841 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.107826    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vdpt\" (UniqueName: \"kubernetes.io/projected/af31bdea-bd6f-42a5-ae97-8518aeeae01e-kube-api-access-8vdpt\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.604953 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.604912    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:30.605129 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:30.605025    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 06:24:30.605129 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:30.605104    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls podName:af31bdea-bd6f-42a5-ae97-8518aeeae01e nodeName:}" failed. No retries permitted until 2026-05-26 06:24:31.605088177 +0000 UTC m=+135.941654517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mhjjw" (UID: "af31bdea-bd6f-42a5-ae97-8518aeeae01e") : secret "insights-runtime-extractor-tls" not found
May 26 06:24:30.645477 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.645450    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-p9jt4"]
May 26 06:24:30.647496 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.647481    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.649267 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.649248    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 26 06:24:30.649370 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.649337    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 26 06:24:30.649413 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.649388    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 26 06:24:30.649453 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.649433    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 26 06:24:30.649855 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.649838    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5vg8x\""
May 26 06:24:30.654036 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.654018    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-p9jt4"]
May 26 06:24:30.674378 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.674348    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn" event={"ID":"ff5c686b-b3c2-444a-9f0b-051795ba913a","Type":"ContainerStarted","Data":"e01643e2d9e8852edb4bf5c37c352dffbbaaa4456c1fa508a014cbcd0e0c9a1a"}
May 26 06:24:30.674504 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.674385    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn" event={"ID":"ff5c686b-b3c2-444a-9f0b-051795ba913a","Type":"ContainerStarted","Data":"76d934cc6568d40a9b98f2a1f212b814ea3f44a00e227fbd8c920ee4a90bcc9f"}
May 26 06:24:30.688516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.688465    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jr9jn" podStartSLOduration=1.546305073 podStartE2EDuration="2.688450781s" podCreationTimestamp="2026-05-26 06:24:28 +0000 UTC" firstStartedPulling="2026-05-26 06:24:28.488910212 +0000 UTC m=+132.825476560" lastFinishedPulling="2026-05-26 06:24:29.63105593 +0000 UTC m=+133.967622268" observedRunningTime="2026-05-26 06:24:30.688072708 +0000 UTC m=+135.024639066" watchObservedRunningTime="2026-05-26 06:24:30.688450781 +0000 UTC m=+135.025017140"
May 26 06:24:30.806476 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.806433    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q954\" (UniqueName: \"kubernetes.io/projected/b491182c-d078-4db8-bf98-806cfe137fed-kube-api-access-8q954\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.806652 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.806512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b491182c-d078-4db8-bf98-806cfe137fed-signing-cabundle\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.806652 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.806547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b491182c-d078-4db8-bf98-806cfe137fed-signing-key\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.907273 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.907230    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8q954\" (UniqueName: \"kubernetes.io/projected/b491182c-d078-4db8-bf98-806cfe137fed-kube-api-access-8q954\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.907367 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.907308    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b491182c-d078-4db8-bf98-806cfe137fed-signing-cabundle\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.907367 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.907345    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b491182c-d078-4db8-bf98-806cfe137fed-signing-key\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.907966 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.907940    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b491182c-d078-4db8-bf98-806cfe137fed-signing-cabundle\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.909809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.909789    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b491182c-d078-4db8-bf98-806cfe137fed-signing-key\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.914572 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.914550    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q954\" (UniqueName: \"kubernetes.io/projected/b491182c-d078-4db8-bf98-806cfe137fed-kube-api-access-8q954\") pod \"service-ca-67d667c7d-p9jt4\" (UID: \"b491182c-d078-4db8-bf98-806cfe137fed\") " pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:30.956500 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:30.956467    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-p9jt4"
May 26 06:24:31.071374 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:31.071342    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-p9jt4"]
May 26 06:24:31.074560 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:31.074532    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb491182c_d078_4db8_bf98_806cfe137fed.slice/crio-33aeceeb031a72cda0e50de54a16b7aaa8a7185fbfb7a59d47f1906ed45cdfd5 WatchSource:0}: Error finding container 33aeceeb031a72cda0e50de54a16b7aaa8a7185fbfb7a59d47f1906ed45cdfd5: Status 404 returned error can't find the container with id 33aeceeb031a72cda0e50de54a16b7aaa8a7185fbfb7a59d47f1906ed45cdfd5
May 26 06:24:31.614761 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:31.614720    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:31.615225 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:31.614878    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 06:24:31.615225 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:31.614948    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls podName:af31bdea-bd6f-42a5-ae97-8518aeeae01e nodeName:}" failed. No retries permitted until 2026-05-26 06:24:33.614930813 +0000 UTC m=+137.951497153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mhjjw" (UID: "af31bdea-bd6f-42a5-ae97-8518aeeae01e") : secret "insights-runtime-extractor-tls" not found
May 26 06:24:31.677320 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:31.677286    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-p9jt4" event={"ID":"b491182c-d078-4db8-bf98-806cfe137fed","Type":"ContainerStarted","Data":"33aeceeb031a72cda0e50de54a16b7aaa8a7185fbfb7a59d47f1906ed45cdfd5"}
May 26 06:24:33.631558 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:33.631524    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:33.632019 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:33.631655    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 06:24:33.632019 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:33.631711    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls podName:af31bdea-bd6f-42a5-ae97-8518aeeae01e nodeName:}" failed. No retries permitted until 2026-05-26 06:24:37.631694574 +0000 UTC m=+141.968260911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mhjjw" (UID: "af31bdea-bd6f-42a5-ae97-8518aeeae01e") : secret "insights-runtime-extractor-tls" not found
May 26 06:24:33.682258 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:33.682222    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-p9jt4" event={"ID":"b491182c-d078-4db8-bf98-806cfe137fed","Type":"ContainerStarted","Data":"952ecce52fa82a49af04e92c4234c5c78e7b883c4b1632e59012351eed6147cc"}
May 26 06:24:33.699312 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:33.699256    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-p9jt4" podStartSLOduration=2.073007873 podStartE2EDuration="3.699239332s" podCreationTimestamp="2026-05-26 06:24:30 +0000 UTC" firstStartedPulling="2026-05-26 06:24:31.076308158 +0000 UTC m=+135.412874497" lastFinishedPulling="2026-05-26 06:24:32.702539607 +0000 UTC m=+137.039105956" observedRunningTime="2026-05-26 06:24:33.697643394 +0000 UTC m=+138.034209751" watchObservedRunningTime="2026-05-26 06:24:33.699239332 +0000 UTC m=+138.035805690"
May 26 06:24:37.662542 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:37.662505    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:37.663006 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:37.662648    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 06:24:37.663006 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:37.662734    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls podName:af31bdea-bd6f-42a5-ae97-8518aeeae01e nodeName:}" failed. No retries permitted until 2026-05-26 06:24:45.662709942 +0000 UTC m=+149.999276282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mhjjw" (UID: "af31bdea-bd6f-42a5-ae97-8518aeeae01e") : secret "insights-runtime-extractor-tls" not found
May 26 06:24:45.118568 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.118534    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:45.118952 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.118625    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:45.119138 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.119118    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fa0e2ca-97a8-400b-9103-6ca95838a915-service-ca-bundle\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:45.120886 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.120869    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fa0e2ca-97a8-400b-9103-6ca95838a915-metrics-certs\") pod \"router-default-568c577cb4-nt5lh\" (UID: \"2fa0e2ca-97a8-400b-9103-6ca95838a915\") " pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:45.328289 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.328261    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wbb9x\""
May 26 06:24:45.336939 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.336915    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:45.453863 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.453834    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-568c577cb4-nt5lh"]
May 26 06:24:45.456413 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:45.456388    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa0e2ca_97a8_400b_9103_6ca95838a915.slice/crio-8501490b6826bc7abb2b8a95e16697695e76c8a3c617b51094466623c2af7b38 WatchSource:0}: Error finding container 8501490b6826bc7abb2b8a95e16697695e76c8a3c617b51094466623c2af7b38: Status 404 returned error can't find the container with id 8501490b6826bc7abb2b8a95e16697695e76c8a3c617b51094466623c2af7b38
May 26 06:24:45.707472 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.707434    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-568c577cb4-nt5lh" event={"ID":"2fa0e2ca-97a8-400b-9103-6ca95838a915","Type":"ContainerStarted","Data":"9d3c861dbd0bd0b3fc496be0093cf8d30fdc3eeb23fd9e0393ad9b8b45ae0633"}
May 26 06:24:45.707472 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.707476    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-568c577cb4-nt5lh" event={"ID":"2fa0e2ca-97a8-400b-9103-6ca95838a915","Type":"ContainerStarted","Data":"8501490b6826bc7abb2b8a95e16697695e76c8a3c617b51094466623c2af7b38"}
May 26 06:24:45.723799 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.723765    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:45.723925 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.723780    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-568c577cb4-nt5lh" podStartSLOduration=32.723766379 podStartE2EDuration="32.723766379s" podCreationTimestamp="2026-05-26 06:24:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:24:45.722637522 +0000 UTC m=+150.059203878" watchObservedRunningTime="2026-05-26 06:24:45.723766379 +0000 UTC m=+150.060332735"
May 26 06:24:45.725964 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.725940    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af31bdea-bd6f-42a5-ae97-8518aeeae01e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mhjjw\" (UID: \"af31bdea-bd6f-42a5-ae97-8518aeeae01e\") " pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:45.787458 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.787436    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mhjjw"
May 26 06:24:45.902462 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:45.902434    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mhjjw"]
May 26 06:24:45.905668 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:45.905643    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf31bdea_bd6f_42a5_ae97_8518aeeae01e.slice/crio-d936487781b17b07345ecb2f426bf605e3af0ffff3f3ebb82947f1ead82a6aff WatchSource:0}: Error finding container d936487781b17b07345ecb2f426bf605e3af0ffff3f3ebb82947f1ead82a6aff: Status 404 returned error can't find the container with id d936487781b17b07345ecb2f426bf605e3af0ffff3f3ebb82947f1ead82a6aff
May 26 06:24:46.338174 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.338091    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:46.340516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.340493    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:46.711473 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.711441    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mhjjw" event={"ID":"af31bdea-bd6f-42a5-ae97-8518aeeae01e","Type":"ContainerStarted","Data":"aeac0d9cf20f8af7ed9b6959fe39c3c6db5e710f1241a7cf8038eac45c4d2c49"}
May 26 06:24:46.711571 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.711486    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mhjjw" event={"ID":"af31bdea-bd6f-42a5-ae97-8518aeeae01e","Type":"ContainerStarted","Data":"b812e6cd1acbf8cd7a9319a7e3d516065a3f157af6fc80d4e91f42e1898d27cd"}
May 26 06:24:46.711571 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.711498    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mhjjw" event={"ID":"af31bdea-bd6f-42a5-ae97-8518aeeae01e","Type":"ContainerStarted","Data":"d936487781b17b07345ecb2f426bf605e3af0ffff3f3ebb82947f1ead82a6aff"}
May 26 06:24:46.711691 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.711674    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:46.712820 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:46.712801    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-568c577cb4-nt5lh"
May 26 06:24:48.718542 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:48.718511    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mhjjw" event={"ID":"af31bdea-bd6f-42a5-ae97-8518aeeae01e","Type":"ContainerStarted","Data":"06749d32f2546faf3d732f2db87ef9184f39045d288bce4ecfe8b9c110d8eede"}
May 26 06:24:48.735388 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:48.735344    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mhjjw" podStartSLOduration=17.474173451 podStartE2EDuration="19.735331056s" podCreationTimestamp="2026-05-26 06:24:29 +0000 UTC" firstStartedPulling="2026-05-26 06:24:45.958747751 +0000 UTC m=+150.295314088" lastFinishedPulling="2026-05-26 06:24:48.219905355 +0000 UTC m=+152.556471693" observedRunningTime="2026-05-26 06:24:48.734331319 +0000 UTC m=+153.070897674" watchObservedRunningTime="2026-05-26 06:24:48.735331056 +0000 UTC m=+153.071897414"
May 26 06:24:52.526540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.526511    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584588465c-ndkn6"]
May 26 06:24:52.526915 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:52.526692    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-584588465c-ndkn6" podUID="9ea43a5b-4a14-4f7a-a50f-ca57726596ad"
May 26 06:24:52.727099 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.727072    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:24:52.731074 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.731055    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:24:52.776012 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.775959    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-certificates\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776012 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.775989    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-bound-sa-token\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776145 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776016    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-image-registry-private-configuration\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776145 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776040    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-installation-pull-secrets\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776145 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776097    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-ca-trust-extracted\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776269 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776142    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-trusted-ca\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776269 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776171    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddgjx\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-kube-api-access-ddgjx\") pod \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\" (UID: \"9ea43a5b-4a14-4f7a-a50f-ca57726596ad\") "
May 26 06:24:52.776417 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776394    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:24:52.776628 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776582    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:24:52.776770 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.776743    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:24:52.778300 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.778274    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:24:52.778380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.778362    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:24:52.778510 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.778486    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:24:52.778582 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.778560    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-kube-api-access-ddgjx" (OuterVolumeSpecName: "kube-api-access-ddgjx") pod "9ea43a5b-4a14-4f7a-a50f-ca57726596ad" (UID: "9ea43a5b-4a14-4f7a-a50f-ca57726596ad"). InnerVolumeSpecName "kube-api-access-ddgjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:24:52.877331 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877301    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-image-registry-private-configuration\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.877331 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877330    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-installation-pull-secrets\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.877520 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877344    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-ca-trust-extracted\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.877520 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877358    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-trusted-ca\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.877520 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877372    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddgjx\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-kube-api-access-ddgjx\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.877520 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877384    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-certificates\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.877520 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.877397    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-bound-sa-token\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:52.891236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.891211    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5c4b6d85-vqnsc"]
May 26 06:24:52.893715 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.893699    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:52.896878 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.896849    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 06:24:52.896983 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.896875    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 06:24:52.896983 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.896854    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 06:24:52.897099 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.897032    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 06:24:52.897274 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.897257    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 06:24:52.897399 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.897380    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kb84q\""
May 26 06:24:52.897521 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.897506    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 06:24:52.897937 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.897923    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 06:24:52.910113 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.910094    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5c4b6d85-vqnsc"]
May 26 06:24:52.978550 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.978529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-service-ca\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:52.978662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.978589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-serving-cert\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:52.978662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.978631    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-oauth-serving-cert\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:52.978662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.978648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-oauth-config\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:52.978791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.978665    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-config\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:52.978791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:52.978696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkf4k\" (UniqueName: \"kubernetes.io/projected/fd14f188-58ad-4f1f-9e42-63057ecffabe-kube-api-access-vkf4k\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079201 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079115    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-serving-cert\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079201 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079148    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-oauth-serving-cert\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079201 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079168    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-oauth-config\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079423 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079264    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-config\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079423 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079314    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkf4k\" (UniqueName: \"kubernetes.io/projected/fd14f188-58ad-4f1f-9e42-63057ecffabe-kube-api-access-vkf4k\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079423 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079397    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-service-ca\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079852 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079826    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-oauth-serving-cert\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.079964 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.079934    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-config\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.080064 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.080046    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-service-ca\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.081567 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.081541    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-oauth-config\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.081693 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.081622    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-serving-cert\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.086273 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.086147    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkf4k\" (UniqueName: \"kubernetes.io/projected/fd14f188-58ad-4f1f-9e42-63057ecffabe-kube-api-access-vkf4k\") pod \"console-5c5c4b6d85-vqnsc\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") " pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.094887 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:53.094862    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-p87p8" podUID="71f9d979-0aeb-4405-8da0-7e46bfc82076"
May 26 06:24:53.100992 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:53.100968    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-x9k28" podUID="97e82fce-5c69-4787-bcfe-bf4a6e2317c8"
May 26 06:24:53.202570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.202535    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:24:53.294717 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:53.294683    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-cxsbh" podUID="f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5"
May 26 06:24:53.322364 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.322334    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5c4b6d85-vqnsc"]
May 26 06:24:53.325850 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:53.325826    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd14f188_58ad_4f1f_9e42_63057ecffabe.slice/crio-eda9f799fe13c2297f6f6de587650d1c1a550ab01f9c7c437474d5bdbebd357a WatchSource:0}: Error finding container eda9f799fe13c2297f6f6de587650d1c1a550ab01f9c7c437474d5bdbebd357a: Status 404 returned error can't find the container with id eda9f799fe13c2297f6f6de587650d1c1a550ab01f9c7c437474d5bdbebd357a
May 26 06:24:53.730484 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.730459    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p87p8"
May 26 06:24:53.730484 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.730487    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584588465c-ndkn6"
May 26 06:24:53.730887 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.730456    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5c4b6d85-vqnsc" event={"ID":"fd14f188-58ad-4f1f-9e42-63057ecffabe","Type":"ContainerStarted","Data":"eda9f799fe13c2297f6f6de587650d1c1a550ab01f9c7c437474d5bdbebd357a"}
May 26 06:24:53.774918 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.774888    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584588465c-ndkn6"]
May 26 06:24:53.778027 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.778007    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-584588465c-ndkn6"]
May 26 06:24:53.887166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:53.887146    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ea43a5b-4a14-4f7a-a50f-ca57726596ad-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:24:54.265973 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:54.265941    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea43a5b-4a14-4f7a-a50f-ca57726596ad" path="/var/lib/kubelet/pods/9ea43a5b-4a14-4f7a-a50f-ca57726596ad/volumes"
May 26 06:24:56.722298 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.722269    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"]
May 26 06:24:56.724102 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.724087    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.726642 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.726616    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 06:24:56.726642 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.726631    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 06:24:56.726836 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.726620    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 26 06:24:56.726836 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.726656    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 26 06:24:56.726836 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.726672    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9mxvn\""
May 26 06:24:56.726836 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.726619    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 06:24:56.738235 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.738200    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"]
May 26 06:24:56.741582 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.741550    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5c4b6d85-vqnsc" event={"ID":"fd14f188-58ad-4f1f-9e42-63057ecffabe","Type":"ContainerStarted","Data":"a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3"}
May 26 06:24:56.770986 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.770944    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5c5c4b6d85-vqnsc" podStartSLOduration=1.9357969800000001 podStartE2EDuration="4.770931934s" podCreationTimestamp="2026-05-26 06:24:52 +0000 UTC" firstStartedPulling="2026-05-26 06:24:53.327701719 +0000 UTC m=+157.664268054" lastFinishedPulling="2026-05-26 06:24:56.162836674 +0000 UTC m=+160.499403008" observedRunningTime="2026-05-26 06:24:56.770118157 +0000 UTC m=+161.106684514" watchObservedRunningTime="2026-05-26 06:24:56.770931934 +0000 UTC m=+161.107498289"
May 26 06:24:56.811382 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.811345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6979db8-5826-4664-82b3-2ef62d6d792b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.811526 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.811391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.811618 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.811583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t4xr\" (UniqueName: \"kubernetes.io/projected/d6979db8-5826-4664-82b3-2ef62d6d792b-kube-api-access-2t4xr\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.811678 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.811643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.912623 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.912577    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2t4xr\" (UniqueName: \"kubernetes.io/projected/d6979db8-5826-4664-82b3-2ef62d6d792b-kube-api-access-2t4xr\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.912758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.912629    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.912758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.912687    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6979db8-5826-4664-82b3-2ef62d6d792b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.912758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.912712    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.912863 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:56.912801    2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 26 06:24:56.912905 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:24:56.912883    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-tls podName:d6979db8-5826-4664-82b3-2ef62d6d792b nodeName:}" failed. No retries permitted until 2026-05-26 06:24:57.412860826 +0000 UTC m=+161.749427170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-gxjpm" (UID: "d6979db8-5826-4664-82b3-2ef62d6d792b") : secret "prometheus-operator-tls" not found
May 26 06:24:56.913334 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.913310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6979db8-5826-4664-82b3-2ef62d6d792b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.915043 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.915021    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:56.920130 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:56.920113    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t4xr\" (UniqueName: \"kubernetes.io/projected/d6979db8-5826-4664-82b3-2ef62d6d792b-kube-api-access-2t4xr\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:57.417087 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:57.417056    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:57.419359 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:57.419341    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d6979db8-5826-4664-82b3-2ef62d6d792b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-gxjpm\" (UID: \"d6979db8-5826-4664-82b3-2ef62d6d792b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:57.632695 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:57.632660    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"
May 26 06:24:57.748524 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:57.748492    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm"]
May 26 06:24:57.751447 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:57.751421    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6979db8_5826_4664_82b3_2ef62d6d792b.slice/crio-f92fc34a6cf8fbfd33753dba13276488d5cd720b820e8fb8ac84ef853866d2dd WatchSource:0}: Error finding container f92fc34a6cf8fbfd33753dba13276488d5cd720b820e8fb8ac84ef853866d2dd: Status 404 returned error can't find the container with id f92fc34a6cf8fbfd33753dba13276488d5cd720b820e8fb8ac84ef853866d2dd
May 26 06:24:58.021798 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.021689    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:24:58.021798 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.021783    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:24:58.024155 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.024129    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/71f9d979-0aeb-4405-8da0-7e46bfc82076-metrics-tls\") pod \"dns-default-p87p8\" (UID: \"71f9d979-0aeb-4405-8da0-7e46bfc82076\") " pod="openshift-dns/dns-default-p87p8"
May 26 06:24:58.024155 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.024144    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97e82fce-5c69-4787-bcfe-bf4a6e2317c8-cert\") pod \"ingress-canary-x9k28\" (UID: \"97e82fce-5c69-4787-bcfe-bf4a6e2317c8\") " pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:24:58.232536 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.232508    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4k6pb\""
May 26 06:24:58.240865 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.240847    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-p87p8"
May 26 06:24:58.360294 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.360266    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-p87p8"]
May 26 06:24:58.363372 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:24:58.363345    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71f9d979_0aeb_4405_8da0_7e46bfc82076.slice/crio-820d2ab8e432a6cccdd298ac38e434786922e9e0e84d17dbefcea692953acdc9 WatchSource:0}: Error finding container 820d2ab8e432a6cccdd298ac38e434786922e9e0e84d17dbefcea692953acdc9: Status 404 returned error can't find the container with id 820d2ab8e432a6cccdd298ac38e434786922e9e0e84d17dbefcea692953acdc9
May 26 06:24:58.747994 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.747962    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm" event={"ID":"d6979db8-5826-4664-82b3-2ef62d6d792b","Type":"ContainerStarted","Data":"f92fc34a6cf8fbfd33753dba13276488d5cd720b820e8fb8ac84ef853866d2dd"}
May 26 06:24:58.748778 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:58.748756    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p87p8" event={"ID":"71f9d979-0aeb-4405-8da0-7e46bfc82076","Type":"ContainerStarted","Data":"820d2ab8e432a6cccdd298ac38e434786922e9e0e84d17dbefcea692953acdc9"}
May 26 06:24:59.752656 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:59.752628    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm" event={"ID":"d6979db8-5826-4664-82b3-2ef62d6d792b","Type":"ContainerStarted","Data":"3e27c70c1e5f983d453335b7ead8642da01386aa4beaab57833d085b89457ae7"}
May 26 06:24:59.752983 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:59.752664    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm" event={"ID":"d6979db8-5826-4664-82b3-2ef62d6d792b","Type":"ContainerStarted","Data":"0857136aa204131c2087ebe9f0cbdcbe6774a8c63eeade2f93568a70cea17d68"}
May 26 06:24:59.766898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:24:59.766859    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-gxjpm" podStartSLOduration=2.405957642 podStartE2EDuration="3.766846508s" podCreationTimestamp="2026-05-26 06:24:56 +0000 UTC" firstStartedPulling="2026-05-26 06:24:57.75382808 +0000 UTC m=+162.090394414" lastFinishedPulling="2026-05-26 06:24:59.114716915 +0000 UTC m=+163.451283280" observedRunningTime="2026-05-26 06:24:59.766384968 +0000 UTC m=+164.102951324" watchObservedRunningTime="2026-05-26 06:24:59.766846508 +0000 UTC m=+164.103412863"
May 26 06:25:00.757926 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:00.757887    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p87p8" event={"ID":"71f9d979-0aeb-4405-8da0-7e46bfc82076","Type":"ContainerStarted","Data":"7b01d33dae11aae38e612df979e9f1b4e4d5d699409ae3da5e34135d471ac182"}
May 26 06:25:00.757926 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:00.757934    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-p87p8" event={"ID":"71f9d979-0aeb-4405-8da0-7e46bfc82076","Type":"ContainerStarted","Data":"3d7390b71e0ed0f48829581c9fa4bb09359c675f08c1bb9b8d95e8466322b0de"}
May 26 06:25:00.758438 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:00.758183    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-p87p8"
May 26 06:25:00.775466 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:00.775419    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-p87p8" podStartSLOduration=129.456845686 podStartE2EDuration="2m10.775406118s" podCreationTimestamp="2026-05-26 06:22:50 +0000 UTC" firstStartedPulling="2026-05-26 06:24:58.365250611 +0000 UTC m=+162.701816949" lastFinishedPulling="2026-05-26 06:24:59.683811047 +0000 UTC m=+164.020377381" observedRunningTime="2026-05-26 06:25:00.77390565 +0000 UTC m=+165.110472006" watchObservedRunningTime="2026-05-26 06:25:00.775406118 +0000 UTC m=+165.111972473"
May 26 06:25:02.056495 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.056460    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"]
May 26 06:25:02.058934 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.058914    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.061064 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.060877    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 26 06:25:02.061064 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.060889    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ck26f\""
May 26 06:25:02.061064 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.060946    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 26 06:25:02.069288 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.069267    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"]
May 26 06:25:02.072454 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.072427    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"]
May 26 06:25:02.074857 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.074837    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.077380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.076700    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 26 06:25:02.077380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.076793    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 26 06:25:02.077380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.077013    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zcqx5\""
May 26 06:25:02.077380 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.077227    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 26 06:25:02.087555 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.087533    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"]
May 26 06:25:02.095854 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.095834    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zqrxf"]
May 26 06:25:02.098043 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.098024    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.106272 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.106249    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sw4f7\""
May 26 06:25:02.106469 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.106314    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 06:25:02.106538 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.106466    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 06:25:02.107080 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.107059    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 06:25:02.158863 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.158830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f89a2d-4308-4089-915d-9724284fccf4-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.159001 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.158878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.159001 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.158908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzqs\" (UniqueName: \"kubernetes.io/projected/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-kube-api-access-qzzqs\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159001 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.158933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-tls\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159001 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.158963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.159001 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.158987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-root\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159024    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.159234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-textfile\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159138    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.159234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-sys\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159234 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159260    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-wtmp\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159354    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/70f89a2d-4308-4089-915d-9724284fccf4-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99wr9\" (UniqueName: \"kubernetes.io/projected/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-kube-api-access-99wr9\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-metrics-client-ca\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.159488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.159465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zts\" (UniqueName: \"kubernetes.io/projected/70f89a2d-4308-4089-915d-9724284fccf4-kube-api-access-42zts\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260440 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260410    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260448    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-textfile\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260465    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260488    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.260616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260528    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-sys\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260551    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260581    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260624    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-wtmp\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260645    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-sys\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260669    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/70f89a2d-4308-4089-915d-9724284fccf4-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260726    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99wr9\" (UniqueName: \"kubernetes.io/projected/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-kube-api-access-99wr9\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260750    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-metrics-client-ca\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260758    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-wtmp\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260780    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42zts\" (UniqueName: \"kubernetes.io/projected/70f89a2d-4308-4089-915d-9724284fccf4-kube-api-access-42zts\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260811    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f89a2d-4308-4089-915d-9724284fccf4-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260836    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260840    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-textfile\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260866    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzqs\" (UniqueName: \"kubernetes.io/projected/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-kube-api-access-qzzqs\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.260911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260895    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-tls\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.261560 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260927    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.261560 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.260950    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-root\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.261560 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.261039    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-root\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.261560 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.261257    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.261560 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.261400    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.261838 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.261736    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70f89a2d-4308-4089-915d-9724284fccf4-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.262065 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.262043    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.262518 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.262439    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-metrics-client-ca\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.263825 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.263773    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.263929 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.263857    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.264382 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.264099    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/70f89a2d-4308-4089-915d-9724284fccf4-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.264382 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.264342    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.264737 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.264715    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.265882 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.265860    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/70f89a2d-4308-4089-915d-9724284fccf4-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.266274 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.266254    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-node-exporter-tls\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.270924 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.270905    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzqs\" (UniqueName: \"kubernetes.io/projected/002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6-kube-api-access-qzzqs\") pod \"node-exporter-zqrxf\" (UID: \"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6\") " pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.271035 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.271015    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99wr9\" (UniqueName: \"kubernetes.io/projected/cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d-kube-api-access-99wr9\") pod \"openshift-state-metrics-9c959559f-6kw68\" (UID: \"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.271166 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.271146    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zts\" (UniqueName: \"kubernetes.io/projected/70f89a2d-4308-4089-915d-9724284fccf4-kube-api-access-42zts\") pod \"kube-state-metrics-54fd6bc5c4-9zpbq\" (UID: \"70f89a2d-4308-4089-915d-9724284fccf4\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.370256 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.370176    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"
May 26 06:25:02.388929 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.388877    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"
May 26 06:25:02.417589 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.417221    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqrxf"
May 26 06:25:02.430107 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:02.430055    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002cdadb_acfc_4a2b_9bea_f4a4ae79d0c6.slice/crio-22e578cac4ddcedf0fea212892de69c66cea2b52c5f72e84806df686c0a81d51 WatchSource:0}: Error finding container 22e578cac4ddcedf0fea212892de69c66cea2b52c5f72e84806df686c0a81d51: Status 404 returned error can't find the container with id 22e578cac4ddcedf0fea212892de69c66cea2b52c5f72e84806df686c0a81d51
May 26 06:25:02.516332 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.516302    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-6kw68"]
May 26 06:25:02.520449 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:02.520418    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc3b5a9_8660_4e8d_bcf1_5f38bde2908d.slice/crio-0443245ddaab5512bd650235fd5cf261a76fae12980b6eb21237c65860942c00 WatchSource:0}: Error finding container 0443245ddaab5512bd650235fd5cf261a76fae12980b6eb21237c65860942c00: Status 404 returned error can't find the container with id 0443245ddaab5512bd650235fd5cf261a76fae12980b6eb21237c65860942c00
May 26 06:25:02.547911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.547887    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq"]
May 26 06:25:02.562684 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:02.562660    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f89a2d_4308_4089_915d_9724284fccf4.slice/crio-90142b74f9f264b06c56388ada09a78de43fa5033a03b3d1d5c9f6e6e5730c3b WatchSource:0}: Error finding container 90142b74f9f264b06c56388ada09a78de43fa5033a03b3d1d5c9f6e6e5730c3b: Status 404 returned error can't find the container with id 90142b74f9f264b06c56388ada09a78de43fa5033a03b3d1d5c9f6e6e5730c3b
May 26 06:25:02.763737 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.763699    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqrxf" event={"ID":"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6","Type":"ContainerStarted","Data":"22e578cac4ddcedf0fea212892de69c66cea2b52c5f72e84806df686c0a81d51"}
May 26 06:25:02.765297 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.765265    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68" event={"ID":"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d","Type":"ContainerStarted","Data":"5f17894cce85db3b710239534fb944ae5ee623a8d5153d2b2c91f3092b306eb6"}
May 26 06:25:02.765428 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.765305    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68" event={"ID":"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d","Type":"ContainerStarted","Data":"8f1bc5e1e0099ba352d5b81363a3a5877a9e3c70269b7cd6b29f792a532d548c"}
May 26 06:25:02.765428 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.765320    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68" event={"ID":"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d","Type":"ContainerStarted","Data":"0443245ddaab5512bd650235fd5cf261a76fae12980b6eb21237c65860942c00"}
May 26 06:25:02.766268 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:02.766242    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq" event={"ID":"70f89a2d-4308-4089-915d-9724284fccf4","Type":"ContainerStarted","Data":"90142b74f9f264b06c56388ada09a78de43fa5033a03b3d1d5c9f6e6e5730c3b"}
May 26 06:25:03.202820 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:03.202784    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:25:03.202820 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:03.202830    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:25:03.210236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:03.209979    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:25:03.771252 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:03.771160    2557 generic.go:358] "Generic (PLEG): container finished" podID="002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6" containerID="adfabf6cc52081e7c391dc5f8b27ff4e35ba6eb5147511227d3fac0cefd7b0f2" exitCode=0
May 26 06:25:03.771252 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:03.771231    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqrxf" event={"ID":"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6","Type":"ContainerDied","Data":"adfabf6cc52081e7c391dc5f8b27ff4e35ba6eb5147511227d3fac0cefd7b0f2"}
May 26 06:25:03.776929 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:03.776906    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:25:04.776361 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.776324    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqrxf" event={"ID":"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6","Type":"ContainerStarted","Data":"e6d60cf4b10dc17a15c5dad8067278e314997a40ce6e0459cf44be236309ccea"}
May 26 06:25:04.776813 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.776368    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqrxf" event={"ID":"002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6","Type":"ContainerStarted","Data":"4c9c6eba833c9b390023e81ea3aa2e56914e94dd37fbdc06be574274a1a64e92"}
May 26 06:25:04.778095 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.778073    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68" event={"ID":"cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d","Type":"ContainerStarted","Data":"745d922b5f1b23557a1042d256aeb803c2d148cb9bd3d47c6b57dce62038c32f"}
May 26 06:25:04.779903 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.779877    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq" event={"ID":"70f89a2d-4308-4089-915d-9724284fccf4","Type":"ContainerStarted","Data":"bd8465f1da2ee9821b25a104142e1fb0a9818a3a0a5150ce919e3ba4979b8b1f"}
May 26 06:25:04.779999 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.779908    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq" event={"ID":"70f89a2d-4308-4089-915d-9724284fccf4","Type":"ContainerStarted","Data":"00149b9159ed3aeb90fd6edfbabed4713be309dce71f021c92d1726d8c6f04b4"}
May 26 06:25:04.779999 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.779917    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq" event={"ID":"70f89a2d-4308-4089-915d-9724284fccf4","Type":"ContainerStarted","Data":"3e1db328be093eaa6c3821229d2ee460124bee91e606eadeddd335887e6ff5d0"}
May 26 06:25:04.793768 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.793731    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zqrxf" podStartSLOduration=1.950252575 podStartE2EDuration="2.793718152s" podCreationTimestamp="2026-05-26 06:25:02 +0000 UTC" firstStartedPulling="2026-05-26 06:25:02.432648188 +0000 UTC m=+166.769214532" lastFinishedPulling="2026-05-26 06:25:03.276113767 +0000 UTC m=+167.612680109" observedRunningTime="2026-05-26 06:25:04.79287076 +0000 UTC m=+169.129437118" watchObservedRunningTime="2026-05-26 06:25:04.793718152 +0000 UTC m=+169.130284486"
May 26 06:25:04.807224 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.807169    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-6kw68" podStartSLOduration=1.484682837 podStartE2EDuration="2.807154414s" podCreationTimestamp="2026-05-26 06:25:02 +0000 UTC" firstStartedPulling="2026-05-26 06:25:02.634388093 +0000 UTC m=+166.970954430" lastFinishedPulling="2026-05-26 06:25:03.956859672 +0000 UTC m=+168.293426007" observedRunningTime="2026-05-26 06:25:04.806409081 +0000 UTC m=+169.142975437" watchObservedRunningTime="2026-05-26 06:25:04.807154414 +0000 UTC m=+169.143720770"
May 26 06:25:04.826684 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:04.826646    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9zpbq" podStartSLOduration=1.431979382 podStartE2EDuration="2.826635198s" podCreationTimestamp="2026-05-26 06:25:02 +0000 UTC" firstStartedPulling="2026-05-26 06:25:02.564873078 +0000 UTC m=+166.901439426" lastFinishedPulling="2026-05-26 06:25:03.959528904 +0000 UTC m=+168.296095242" observedRunningTime="2026-05-26 06:25:04.826227839 +0000 UTC m=+169.162794194" watchObservedRunningTime="2026-05-26 06:25:04.826635198 +0000 UTC m=+169.163201554"
May 26 06:25:05.145478 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.145399    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58b88b8648-fpqls"]
May 26 06:25:05.148143 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.148124    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.150087 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150059    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 26 06:25:05.150198 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150098    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 26 06:25:05.150198 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150107    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-apm0ppj3tmfmn\""
May 26 06:25:05.150312 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150235    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 26 06:25:05.150626 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150591    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 26 06:25:05.150899 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150880    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 26 06:25:05.151018 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.150999    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5bpn4\""
May 26 06:25:05.159089 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.159063    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58b88b8648-fpqls"]
May 26 06:25:05.292714 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.292848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-grpc-tls\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.292848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwg7\" (UniqueName: \"kubernetes.io/projected/7b90aa23-c719-497d-8b2e-9405910f1c5e-kube-api-access-pcwg7\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.292848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-tls\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.292848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.292848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.292848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292841    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b90aa23-c719-497d-8b2e-9405910f1c5e-metrics-client-ca\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.293037 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.292859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.393622 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393579    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.393791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393630    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-grpc-tls\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.393791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393666    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwg7\" (UniqueName: \"kubernetes.io/projected/7b90aa23-c719-497d-8b2e-9405910f1c5e-kube-api-access-pcwg7\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.393791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393693    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-tls\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.393791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393731    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.393791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393762    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.394044 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393795    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b90aa23-c719-497d-8b2e-9405910f1c5e-metrics-client-ca\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.394044 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.393830    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.394787 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.394761    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b90aa23-c719-497d-8b2e-9405910f1c5e-metrics-client-ca\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.396787 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.396677    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.396787 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.396776    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-grpc-tls\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.396956 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.396807    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.396956 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.396839    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.396956 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.396811    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-tls\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.397059 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.396993    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7b90aa23-c719-497d-8b2e-9405910f1c5e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.400587 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.400565    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwg7\" (UniqueName: \"kubernetes.io/projected/7b90aa23-c719-497d-8b2e-9405910f1c5e-kube-api-access-pcwg7\") pod \"thanos-querier-58b88b8648-fpqls\" (UID: \"7b90aa23-c719-497d-8b2e-9405910f1c5e\") " pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.458171 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.458149    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:05.583543 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.583442    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58b88b8648-fpqls"]
May 26 06:25:05.586922 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:05.586891    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b90aa23_c719_497d_8b2e_9405910f1c5e.slice/crio-6a2e2ec4cec44a3fee6e1cae100a09e2209b6b77f3108bdea467cd81ff66d8d6 WatchSource:0}: Error finding container 6a2e2ec4cec44a3fee6e1cae100a09e2209b6b77f3108bdea467cd81ff66d8d6: Status 404 returned error can't find the container with id 6a2e2ec4cec44a3fee6e1cae100a09e2209b6b77f3108bdea467cd81ff66d8d6
May 26 06:25:05.784550 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:05.784509    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"6a2e2ec4cec44a3fee6e1cae100a09e2209b6b77f3108bdea467cd81ff66d8d6"}
May 26 06:25:06.267843 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.267807    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:25:06.269885 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.269853    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hb4dz\""
May 26 06:25:06.278263 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.278231    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x9k28"
May 26 06:25:06.414224 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.414183    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x9k28"]
May 26 06:25:06.417796 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:06.417766    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e82fce_5c69_4787_bcfe_bf4a6e2317c8.slice/crio-6001344e603eba932e1d9345fcf095a90d6bf20e3d7d33b37be41444d386f972 WatchSource:0}: Error finding container 6001344e603eba932e1d9345fcf095a90d6bf20e3d7d33b37be41444d386f972: Status 404 returned error can't find the container with id 6001344e603eba932e1d9345fcf095a90d6bf20e3d7d33b37be41444d386f972
May 26 06:25:06.469024 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.468999    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8f5c878dd-lz5tx"]
May 26 06:25:06.471766 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.471749    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.473648 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.473588    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 26 06:25:06.473757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.473737    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 26 06:25:06.473817 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.473766    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rfknw\""
May 26 06:25:06.473867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.473837    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6480bd2f5po1o\""
May 26 06:25:06.474098 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.474075    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 26 06:25:06.474098 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.474097    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 06:25:06.481439 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.481409    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8f5c878dd-lz5tx"]
May 26 06:25:06.605355 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c435e667-7e0c-4222-b155-05f598081e96-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.605355 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c435e667-7e0c-4222-b155-05f598081e96-audit-log\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.605355 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c435e667-7e0c-4222-b155-05f598081e96-metrics-server-audit-profiles\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.605643 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-secret-metrics-server-tls\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.605643 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cvtp\" (UniqueName: \"kubernetes.io/projected/c435e667-7e0c-4222-b155-05f598081e96-kube-api-access-4cvtp\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.605643 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-client-ca-bundle\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.605643 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.605624    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-secret-metrics-server-client-certs\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.706644 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.706583    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c435e667-7e0c-4222-b155-05f598081e96-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.706830 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.706677    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c435e667-7e0c-4222-b155-05f598081e96-audit-log\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.706895 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.706842    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c435e667-7e0c-4222-b155-05f598081e96-metrics-server-audit-profiles\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.706946 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.706903    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-secret-metrics-server-tls\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.706995 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.706944    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cvtp\" (UniqueName: \"kubernetes.io/projected/c435e667-7e0c-4222-b155-05f598081e96-kube-api-access-4cvtp\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.706995 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.706987    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-client-ca-bundle\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.707115 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.707013    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-secret-metrics-server-client-certs\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.707167 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.707128    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c435e667-7e0c-4222-b155-05f598081e96-audit-log\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.707577 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.707438    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c435e667-7e0c-4222-b155-05f598081e96-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.707824 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.707768    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c435e667-7e0c-4222-b155-05f598081e96-metrics-server-audit-profiles\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.709730 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.709708    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-secret-metrics-server-client-certs\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.709883 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.709868    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-secret-metrics-server-tls\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.709963 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.709944    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c435e667-7e0c-4222-b155-05f598081e96-client-ca-bundle\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.714197 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.714175    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cvtp\" (UniqueName: \"kubernetes.io/projected/c435e667-7e0c-4222-b155-05f598081e96-kube-api-access-4cvtp\") pod \"metrics-server-8f5c878dd-lz5tx\" (UID: \"c435e667-7e0c-4222-b155-05f598081e96\") " pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.784204 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.784162    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:06.788654 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.788628    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x9k28" event={"ID":"97e82fce-5c69-4787-bcfe-bf4a6e2317c8","Type":"ContainerStarted","Data":"6001344e603eba932e1d9345fcf095a90d6bf20e3d7d33b37be41444d386f972"}
May 26 06:25:06.936869 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:06.936833    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8f5c878dd-lz5tx"]
May 26 06:25:07.262714 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:07.262673    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:25:07.477218 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:07.477179    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc435e667_7e0c_4222_b155_05f598081e96.slice/crio-8627dc42dbbeb928748ae4a0da811766b83b0a32deaed85ec169be1055248b63 WatchSource:0}: Error finding container 8627dc42dbbeb928748ae4a0da811766b83b0a32deaed85ec169be1055248b63: Status 404 returned error can't find the container with id 8627dc42dbbeb928748ae4a0da811766b83b0a32deaed85ec169be1055248b63
May 26 06:25:07.795320 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:07.795234    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"7a17717638066f48a4fd2f1c7dcbf46fcd0e2d0fdff5b6eadedc30c2007c00ed"}
May 26 06:25:07.795320 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:07.795290    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"8e7cc839572888a429b307a9340c90cba42636fbe6d64ff798e455226282a365"}
May 26 06:25:07.796469 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:07.796435    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx" event={"ID":"c435e667-7e0c-4222-b155-05f598081e96","Type":"ContainerStarted","Data":"8627dc42dbbeb928748ae4a0da811766b83b0a32deaed85ec169be1055248b63"}
May 26 06:25:08.327130 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.327099    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7465778b99-t6v8r"]
May 26 06:25:08.329274 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.329257    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.337278 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.337247    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 06:25:08.340680 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.340656    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7465778b99-t6v8r"]
May 26 06:25:08.423743 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.423707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-config\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.423898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.423771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-oauth-serving-cert\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.423898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.423814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhcj\" (UniqueName: \"kubernetes.io/projected/3b174ab9-0d3c-4669-97ce-91e165b3e386-kube-api-access-rfhcj\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.423898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.423853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-serving-cert\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.423898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.423886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-oauth-config\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.424194 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.423967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-trusted-ca-bundle\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.424194 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.424036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-service-ca\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526328 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526287    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-config\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526498 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526335    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-oauth-serving-cert\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526498 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526382    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhcj\" (UniqueName: \"kubernetes.io/projected/3b174ab9-0d3c-4669-97ce-91e165b3e386-kube-api-access-rfhcj\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526498 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526416    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-serving-cert\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526498 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526448    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-oauth-config\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526734 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526512    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-trusted-ca-bundle\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.526734 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.526558    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-service-ca\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.527162 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.527136    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-config\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.527288 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.527162    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-oauth-serving-cert\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.527288 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.527244    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-service-ca\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.528666 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.528635    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-trusted-ca-bundle\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.533628 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.530910    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-oauth-config\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.536492 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.536428    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-serving-cert\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.541286 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.541246    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhcj\" (UniqueName: \"kubernetes.io/projected/3b174ab9-0d3c-4669-97ce-91e165b3e386-kube-api-access-rfhcj\") pod \"console-7465778b99-t6v8r\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") " pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.639430 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.639380    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:08.800598 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.800546    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7465778b99-t6v8r"]
May 26 06:25:08.804363 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.804316    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x9k28" event={"ID":"97e82fce-5c69-4787-bcfe-bf4a6e2317c8","Type":"ContainerStarted","Data":"4fd16b71c8f6a700157f5dee59417919be65ae08d354175bdd781d1c38808ed6"}
May 26 06:25:08.806182 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:08.805826    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b174ab9_0d3c_4669_97ce_91e165b3e386.slice/crio-66b13707ab5db7674b5f0a71788ff5693a5f5168921e3ebf568ab6a6736e4235 WatchSource:0}: Error finding container 66b13707ab5db7674b5f0a71788ff5693a5f5168921e3ebf568ab6a6736e4235: Status 404 returned error can't find the container with id 66b13707ab5db7674b5f0a71788ff5693a5f5168921e3ebf568ab6a6736e4235
May 26 06:25:08.810715 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.810689    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"b573a8bc3fc938c4e5418dd6c8c7b33ecedb4d87c31cb47708bfc8a59872ff46"}
May 26 06:25:08.826195 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:08.824278    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x9k28" podStartSLOduration=137.10197207 podStartE2EDuration="2m18.824262936s" podCreationTimestamp="2026-05-26 06:22:50 +0000 UTC" firstStartedPulling="2026-05-26 06:25:06.419831239 +0000 UTC m=+170.756397578" lastFinishedPulling="2026-05-26 06:25:08.14212211 +0000 UTC m=+172.478688444" observedRunningTime="2026-05-26 06:25:08.823637223 +0000 UTC m=+173.160203581" watchObservedRunningTime="2026-05-26 06:25:08.824262936 +0000 UTC m=+173.160829293"
May 26 06:25:09.815873 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.815787    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"40041d7835739ffbabaaba05d97af722b10bf3a3823e81be65dcdb4c87f60672"}
May 26 06:25:09.815873 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.815833    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"5212ba24a3cc4e6b7e61504b4260b4bc91dfff8c62da8d54222ba10e1b051b71"}
May 26 06:25:09.815873 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.815847    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" event={"ID":"7b90aa23-c719-497d-8b2e-9405910f1c5e","Type":"ContainerStarted","Data":"eb00d2f2decca526404e89ccb0983f10a1bf849f2f72ce7745c3df678e5ca66e"}
May 26 06:25:09.816381 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.815960    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:09.817181 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.817154    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx" event={"ID":"c435e667-7e0c-4222-b155-05f598081e96","Type":"ContainerStarted","Data":"9d069855e20b841d0971dea9b72e25870a2def76a6bc64c873c6987aa57ee08c"}
May 26 06:25:09.818505 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.818485    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7465778b99-t6v8r" event={"ID":"3b174ab9-0d3c-4669-97ce-91e165b3e386","Type":"ContainerStarted","Data":"ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f"}
May 26 06:25:09.818590 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.818511    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7465778b99-t6v8r" event={"ID":"3b174ab9-0d3c-4669-97ce-91e165b3e386","Type":"ContainerStarted","Data":"66b13707ab5db7674b5f0a71788ff5693a5f5168921e3ebf568ab6a6736e4235"}
May 26 06:25:09.837653 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.837584    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls" podStartSLOduration=0.990290569 podStartE2EDuration="4.83756874s" podCreationTimestamp="2026-05-26 06:25:05 +0000 UTC" firstStartedPulling="2026-05-26 06:25:05.588822504 +0000 UTC m=+169.925388841" lastFinishedPulling="2026-05-26 06:25:09.436100659 +0000 UTC m=+173.772667012" observedRunningTime="2026-05-26 06:25:09.835303262 +0000 UTC m=+174.171869619" watchObservedRunningTime="2026-05-26 06:25:09.83756874 +0000 UTC m=+174.174135097"
May 26 06:25:09.851408 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.851370    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx" podStartSLOduration=1.896605953 podStartE2EDuration="3.851358685s" podCreationTimestamp="2026-05-26 06:25:06 +0000 UTC" firstStartedPulling="2026-05-26 06:25:07.479486344 +0000 UTC m=+171.816052683" lastFinishedPulling="2026-05-26 06:25:09.434239081 +0000 UTC m=+173.770805415" observedRunningTime="2026-05-26 06:25:09.850218865 +0000 UTC m=+174.186785217" watchObservedRunningTime="2026-05-26 06:25:09.851358685 +0000 UTC m=+174.187925349"
May 26 06:25:09.867303 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:09.867263    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7465778b99-t6v8r" podStartSLOduration=1.867250238 podStartE2EDuration="1.867250238s" podCreationTimestamp="2026-05-26 06:25:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:25:09.866557228 +0000 UTC m=+174.203123587" watchObservedRunningTime="2026-05-26 06:25:09.867250238 +0000 UTC m=+174.203816594"
May 26 06:25:10.762871 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:10.762836    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-p87p8"
May 26 06:25:15.827757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:15.827729    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58b88b8648-fpqls"
May 26 06:25:18.639765 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:18.639728    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:18.640228 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:18.640017    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:18.645153 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:18.645130    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:18.850135 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:18.850100    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:18.895557 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:18.895488    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5c4b6d85-vqnsc"]
May 26 06:25:19.069252 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.069214    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-686f8b84b-s5456"]
May 26 06:25:19.072143 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.072118    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.081522 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.081499    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686f8b84b-s5456"]
May 26 06:25:19.214589 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-service-ca\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.214740 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-trusted-ca-bundle\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.214740 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vkc4\" (UniqueName: \"kubernetes.io/projected/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-kube-api-access-5vkc4\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.214840 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-oauth-serving-cert\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.214840 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214816    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-config\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.214950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-oauth-config\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.214950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.214907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-serving-cert\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.315731 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-oauth-config\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.315862 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315740    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-serving-cert\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.315862 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315790    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-service-ca\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.315862 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315806    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-trusted-ca-bundle\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.315862 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315827    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vkc4\" (UniqueName: \"kubernetes.io/projected/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-kube-api-access-5vkc4\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.316076 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315866    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-oauth-serving-cert\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.316076 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.315896    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-config\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.316577 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.316552    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-oauth-serving-cert\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.316693 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.316650    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-config\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.316799 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.316780    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-service-ca\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.317018 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.316992    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-trusted-ca-bundle\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.318240 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.318213    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-oauth-config\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.318323 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.318300    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-serving-cert\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.325428 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.325409    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vkc4\" (UniqueName: \"kubernetes.io/projected/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-kube-api-access-5vkc4\") pod \"console-686f8b84b-s5456\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") " pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.380720 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.380692    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:19.500463 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.500364    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-686f8b84b-s5456"]
May 26 06:25:19.503031 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:25:19.503003    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f063cb_f1c9_4c7d_9d92_6409f8b440ca.slice/crio-19628343b37f0ac3ea356481a5ba47f08d53b012360e036cee7116f9c1e7d0d3 WatchSource:0}: Error finding container 19628343b37f0ac3ea356481a5ba47f08d53b012360e036cee7116f9c1e7d0d3: Status 404 returned error can't find the container with id 19628343b37f0ac3ea356481a5ba47f08d53b012360e036cee7116f9c1e7d0d3
May 26 06:25:19.850570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.850477    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f8b84b-s5456" event={"ID":"47f063cb-f1c9-4c7d-9d92-6409f8b440ca","Type":"ContainerStarted","Data":"ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054"}
May 26 06:25:19.850570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.850523    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f8b84b-s5456" event={"ID":"47f063cb-f1c9-4c7d-9d92-6409f8b440ca","Type":"ContainerStarted","Data":"19628343b37f0ac3ea356481a5ba47f08d53b012360e036cee7116f9c1e7d0d3"}
May 26 06:25:19.872334 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:19.872285    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-686f8b84b-s5456" podStartSLOduration=0.87226957 podStartE2EDuration="872.26957ms" podCreationTimestamp="2026-05-26 06:25:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:25:19.870470318 +0000 UTC m=+184.207036674" watchObservedRunningTime="2026-05-26 06:25:19.87226957 +0000 UTC m=+184.208835926"
May 26 06:25:26.784762 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:26.784730    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:26.785199 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:26.784774    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:26.928047 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:26.928023    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-568c577cb4-nt5lh_2fa0e2ca-97a8-400b-9103-6ca95838a915/router/0.log"
May 26 06:25:26.939861 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:26.939840    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x9k28_97e82fce-5c69-4787-bcfe-bf4a6e2317c8/serve-healthcheck-canary/0.log"
May 26 06:25:29.381202 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:29.381161    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:29.381586 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:29.381217    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:29.385916 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:29.385890    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:29.884211 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:29.884182    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:25:29.954642 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:29.954596    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7465778b99-t6v8r"]
May 26 06:25:43.915066 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:43.915023    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5c5c4b6d85-vqnsc" podUID="fd14f188-58ad-4f1f-9e42-63057ecffabe" containerName="console" containerID="cri-o://a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3" gracePeriod=15
May 26 06:25:44.148510 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.148489    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c5c4b6d85-vqnsc_fd14f188-58ad-4f1f-9e42-63057ecffabe/console/0.log"
May 26 06:25:44.148633 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.148549    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:25:44.231072 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231006    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-oauth-serving-cert\") pod \"fd14f188-58ad-4f1f-9e42-63057ecffabe\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") "
May 26 06:25:44.231072 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231040    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-oauth-config\") pod \"fd14f188-58ad-4f1f-9e42-63057ecffabe\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") "
May 26 06:25:44.231072 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231061    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-service-ca\") pod \"fd14f188-58ad-4f1f-9e42-63057ecffabe\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") "
May 26 06:25:44.231296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231086    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-config\") pod \"fd14f188-58ad-4f1f-9e42-63057ecffabe\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") "
May 26 06:25:44.231296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231112    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkf4k\" (UniqueName: \"kubernetes.io/projected/fd14f188-58ad-4f1f-9e42-63057ecffabe-kube-api-access-vkf4k\") pod \"fd14f188-58ad-4f1f-9e42-63057ecffabe\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") "
May 26 06:25:44.231296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231163    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-serving-cert\") pod \"fd14f188-58ad-4f1f-9e42-63057ecffabe\" (UID: \"fd14f188-58ad-4f1f-9e42-63057ecffabe\") "
May 26 06:25:44.231483 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231454    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd14f188-58ad-4f1f-9e42-63057ecffabe" (UID: "fd14f188-58ad-4f1f-9e42-63057ecffabe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:44.231544 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231462    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd14f188-58ad-4f1f-9e42-63057ecffabe" (UID: "fd14f188-58ad-4f1f-9e42-63057ecffabe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:44.231544 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.231531    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-config" (OuterVolumeSpecName: "console-config") pod "fd14f188-58ad-4f1f-9e42-63057ecffabe" (UID: "fd14f188-58ad-4f1f-9e42-63057ecffabe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:44.233198 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.233174    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd14f188-58ad-4f1f-9e42-63057ecffabe" (UID: "fd14f188-58ad-4f1f-9e42-63057ecffabe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:25:44.233309 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.233289    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd14f188-58ad-4f1f-9e42-63057ecffabe" (UID: "fd14f188-58ad-4f1f-9e42-63057ecffabe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:25:44.233361 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.233316    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd14f188-58ad-4f1f-9e42-63057ecffabe-kube-api-access-vkf4k" (OuterVolumeSpecName: "kube-api-access-vkf4k") pod "fd14f188-58ad-4f1f-9e42-63057ecffabe" (UID: "fd14f188-58ad-4f1f-9e42-63057ecffabe"). InnerVolumeSpecName "kube-api-access-vkf4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:25:44.332405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.332380    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-oauth-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:44.332405 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.332402    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-oauth-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:44.332519 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.332411    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-service-ca\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:44.332519 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.332420    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:44.332519 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.332429    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkf4k\" (UniqueName: \"kubernetes.io/projected/fd14f188-58ad-4f1f-9e42-63057ecffabe-kube-api-access-vkf4k\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:44.332519 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.332438    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd14f188-58ad-4f1f-9e42-63057ecffabe-console-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:44.926934 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.926906    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c5c4b6d85-vqnsc_fd14f188-58ad-4f1f-9e42-63057ecffabe/console/0.log"
May 26 06:25:44.927307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.926948    2557 generic.go:358] "Generic (PLEG): container finished" podID="fd14f188-58ad-4f1f-9e42-63057ecffabe" containerID="a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3" exitCode=2
May 26 06:25:44.927307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.927020    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5c4b6d85-vqnsc"
May 26 06:25:44.927307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.927029    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5c4b6d85-vqnsc" event={"ID":"fd14f188-58ad-4f1f-9e42-63057ecffabe","Type":"ContainerDied","Data":"a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3"}
May 26 06:25:44.927307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.927064    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5c4b6d85-vqnsc" event={"ID":"fd14f188-58ad-4f1f-9e42-63057ecffabe","Type":"ContainerDied","Data":"eda9f799fe13c2297f6f6de587650d1c1a550ab01f9c7c437474d5bdbebd357a"}
May 26 06:25:44.927307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.927082    2557 scope.go:117] "RemoveContainer" containerID="a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3"
May 26 06:25:44.934915 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.934898    2557 scope.go:117] "RemoveContainer" containerID="a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3"
May 26 06:25:44.935156 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:25:44.935136    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3\": container with ID starting with a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3 not found: ID does not exist" containerID="a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3"
May 26 06:25:44.935202 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.935164    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3"} err="failed to get container status \"a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3\": rpc error: code = NotFound desc = could not find container \"a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3\": container with ID starting with a2ef394cb81465942aca8adf3c6f504f38c42f6a60c5827284e0ed43201742b3 not found: ID does not exist"
May 26 06:25:44.940516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.940494    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5c4b6d85-vqnsc"]
May 26 06:25:44.943831 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:44.943811    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c5c4b6d85-vqnsc"]
May 26 06:25:46.266194 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:46.266159    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd14f188-58ad-4f1f-9e42-63057ecffabe" path="/var/lib/kubelet/pods/fd14f188-58ad-4f1f-9e42-63057ecffabe/volumes"
May 26 06:25:46.789649 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:46.789598    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:46.793956 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:46.793929    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8f5c878dd-lz5tx"
May 26 06:25:54.973736 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:54.973674    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7465778b99-t6v8r" podUID="3b174ab9-0d3c-4669-97ce-91e165b3e386" containerName="console" containerID="cri-o://ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f" gracePeriod=15
May 26 06:25:55.200665 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.200644    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7465778b99-t6v8r_3b174ab9-0d3c-4669-97ce-91e165b3e386/console/0.log"
May 26 06:25:55.200745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.200705    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:55.317928 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.317846    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-serving-cert\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.317928 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.317894    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfhcj\" (UniqueName: \"kubernetes.io/projected/3b174ab9-0d3c-4669-97ce-91e165b3e386-kube-api-access-rfhcj\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.317928 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.317917    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-config\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.318165 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318059    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-service-ca\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.318221 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318173    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-oauth-serving-cert\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.318221 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318203    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-oauth-config\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.318334 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318229    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-trusted-ca-bundle\") pod \"3b174ab9-0d3c-4669-97ce-91e165b3e386\" (UID: \"3b174ab9-0d3c-4669-97ce-91e165b3e386\") "
May 26 06:25:55.318384 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318343    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-config" (OuterVolumeSpecName: "console-config") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:55.318533 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318412    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-service-ca" (OuterVolumeSpecName: "service-ca") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:55.318675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318591    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:55.318675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318656    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.318794 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318680    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-service-ca\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.318794 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.318672    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:25:55.320146 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.320121    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b174ab9-0d3c-4669-97ce-91e165b3e386-kube-api-access-rfhcj" (OuterVolumeSpecName: "kube-api-access-rfhcj") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "kube-api-access-rfhcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:25:55.320146 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.320129    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:25:55.320275 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.320205    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3b174ab9-0d3c-4669-97ce-91e165b3e386" (UID: "3b174ab9-0d3c-4669-97ce-91e165b3e386"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:25:55.419129 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.419093    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-oauth-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.419129 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.419120    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-oauth-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.419129 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.419134    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b174ab9-0d3c-4669-97ce-91e165b3e386-trusted-ca-bundle\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.419338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.419146    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3b174ab9-0d3c-4669-97ce-91e165b3e386-console-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.419338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.419158    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfhcj\" (UniqueName: \"kubernetes.io/projected/3b174ab9-0d3c-4669-97ce-91e165b3e386-kube-api-access-rfhcj\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:25:55.964131 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.964107    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7465778b99-t6v8r_3b174ab9-0d3c-4669-97ce-91e165b3e386/console/0.log"
May 26 06:25:55.964296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.964144    2557 generic.go:358] "Generic (PLEG): container finished" podID="3b174ab9-0d3c-4669-97ce-91e165b3e386" containerID="ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f" exitCode=2
May 26 06:25:55.964296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.964205    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7465778b99-t6v8r" event={"ID":"3b174ab9-0d3c-4669-97ce-91e165b3e386","Type":"ContainerDied","Data":"ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f"}
May 26 06:25:55.964296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.964210    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7465778b99-t6v8r"
May 26 06:25:55.964296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.964231    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7465778b99-t6v8r" event={"ID":"3b174ab9-0d3c-4669-97ce-91e165b3e386","Type":"ContainerDied","Data":"66b13707ab5db7674b5f0a71788ff5693a5f5168921e3ebf568ab6a6736e4235"}
May 26 06:25:55.964296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.964245    2557 scope.go:117] "RemoveContainer" containerID="ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f"
May 26 06:25:55.972149 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.972134    2557 scope.go:117] "RemoveContainer" containerID="ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f"
May 26 06:25:55.972389 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:25:55.972366    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f\": container with ID starting with ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f not found: ID does not exist" containerID="ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f"
May 26 06:25:55.972438 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.972402    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f"} err="failed to get container status \"ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f\": rpc error: code = NotFound desc = could not find container \"ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f\": container with ID starting with ddaa32ad80610c2ee22a0d65298ea682bef3e2b3324383af427af86af4be867f not found: ID does not exist"
May 26 06:25:55.984146 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.984120    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7465778b99-t6v8r"]
May 26 06:25:55.987451 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:55.987432    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7465778b99-t6v8r"]
May 26 06:25:56.266129 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:25:56.266052    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b174ab9-0d3c-4669-97ce-91e165b3e386" path="/var/lib/kubelet/pods/3b174ab9-0d3c-4669-97ce-91e165b3e386/volumes"
May 26 06:26:20.313110 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313083    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65858c67b9-ds46z"]
May 26 06:26:20.313493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313348    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd14f188-58ad-4f1f-9e42-63057ecffabe" containerName="console"
May 26 06:26:20.313493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313358    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd14f188-58ad-4f1f-9e42-63057ecffabe" containerName="console"
May 26 06:26:20.313493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313367    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b174ab9-0d3c-4669-97ce-91e165b3e386" containerName="console"
May 26 06:26:20.313493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313373    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b174ab9-0d3c-4669-97ce-91e165b3e386" containerName="console"
May 26 06:26:20.313493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313426    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="fd14f188-58ad-4f1f-9e42-63057ecffabe" containerName="console"
May 26 06:26:20.313493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.313435    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="3b174ab9-0d3c-4669-97ce-91e165b3e386" containerName="console"
May 26 06:26:20.317281 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.317264    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.329258 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.329234    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65858c67b9-ds46z"]
May 26 06:26:20.408660 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-oauth-config\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.408774 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408687    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-trusted-ca-bundle\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.408774 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-oauth-serving-cert\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.408860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-service-ca\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.408860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408805    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8vs\" (UniqueName: \"kubernetes.io/projected/b2fd2816-70c1-44c8-b53b-0fea4892490f-kube-api-access-6n8vs\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.408860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-serving-cert\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.408860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.408845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-config\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509557 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509531    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-trusted-ca-bundle\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509712 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-oauth-serving-cert\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509723    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-service-ca\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509757 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509739    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8vs\" (UniqueName: \"kubernetes.io/projected/b2fd2816-70c1-44c8-b53b-0fea4892490f-kube-api-access-6n8vs\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509915 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509763    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-serving-cert\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509915 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509787    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-config\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.509915 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.509890    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-oauth-config\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.510416 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.510396    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-oauth-serving-cert\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.510523 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.510442    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-trusted-ca-bundle\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.510523 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.510500    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-config\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.510654 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.510544    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-service-ca\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.512240 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.512222    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-serving-cert\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.512240 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.512234    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-oauth-config\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.517031 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.517008    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8vs\" (UniqueName: \"kubernetes.io/projected/b2fd2816-70c1-44c8-b53b-0fea4892490f-kube-api-access-6n8vs\") pod \"console-65858c67b9-ds46z\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") " pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.625367 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.625306    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:20.744971 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:20.744941    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65858c67b9-ds46z"]
May 26 06:26:20.747913 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:26:20.747885    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2fd2816_70c1_44c8_b53b_0fea4892490f.slice/crio-f7c2294efaf0f362a8d913c4574a7804e308e7b886c431556902bf13a19abd7f WatchSource:0}: Error finding container f7c2294efaf0f362a8d913c4574a7804e308e7b886c431556902bf13a19abd7f: Status 404 returned error can't find the container with id f7c2294efaf0f362a8d913c4574a7804e308e7b886c431556902bf13a19abd7f
May 26 06:26:21.036861 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:21.036827    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65858c67b9-ds46z" event={"ID":"b2fd2816-70c1-44c8-b53b-0fea4892490f","Type":"ContainerStarted","Data":"5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd"}
May 26 06:26:21.036861 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:21.036866    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65858c67b9-ds46z" event={"ID":"b2fd2816-70c1-44c8-b53b-0fea4892490f","Type":"ContainerStarted","Data":"f7c2294efaf0f362a8d913c4574a7804e308e7b886c431556902bf13a19abd7f"}
May 26 06:26:21.063278 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:21.063226    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65858c67b9-ds46z" podStartSLOduration=1.063213723 podStartE2EDuration="1.063213723s" podCreationTimestamp="2026-05-26 06:26:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:26:21.061746822 +0000 UTC m=+245.398313178" watchObservedRunningTime="2026-05-26 06:26:21.063213723 +0000 UTC m=+245.399780079"
May 26 06:26:27.058280 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:27.058233    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:26:27.060588 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:27.060551    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5-metrics-certs\") pod \"network-metrics-daemon-cxsbh\" (UID: \"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5\") " pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:26:27.065349 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:27.065325    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5zglb\""
May 26 06:26:27.073929 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:27.073897    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxsbh"
May 26 06:26:27.216696 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:27.216662    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxsbh"]
May 26 06:26:27.219519 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:26:27.219491    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3999db6_7bf5_4c66_94b8_0ca2a03bc1f5.slice/crio-878bedfb71a4d45fbbf10cd013c05c96e0f8888778c79a7eb6016744a7953427 WatchSource:0}: Error finding container 878bedfb71a4d45fbbf10cd013c05c96e0f8888778c79a7eb6016744a7953427: Status 404 returned error can't find the container with id 878bedfb71a4d45fbbf10cd013c05c96e0f8888778c79a7eb6016744a7953427
May 26 06:26:28.059360 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:28.059325    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxsbh" event={"ID":"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5","Type":"ContainerStarted","Data":"878bedfb71a4d45fbbf10cd013c05c96e0f8888778c79a7eb6016744a7953427"}
May 26 06:26:29.064019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:29.063978    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxsbh" event={"ID":"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5","Type":"ContainerStarted","Data":"cc6bf8376c109875708a6e9e2b209417c025ab4d3fa77c7e9bc1b318ab291b00"}
May 26 06:26:29.064019 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:29.064019    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxsbh" event={"ID":"f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5","Type":"ContainerStarted","Data":"18f1be865bb3a7e90430327ccb9d7c5aa0e03c6accab10e026cb12fc6868e719"}
May 26 06:26:29.079618 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:29.079542    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cxsbh" podStartSLOduration=251.968031569 podStartE2EDuration="4m13.079525893s" podCreationTimestamp="2026-05-26 06:22:16 +0000 UTC" firstStartedPulling="2026-05-26 06:26:27.221388029 +0000 UTC m=+251.557954367" lastFinishedPulling="2026-05-26 06:26:28.332882355 +0000 UTC m=+252.669448691" observedRunningTime="2026-05-26 06:26:29.077425998 +0000 UTC m=+253.413992353" watchObservedRunningTime="2026-05-26 06:26:29.079525893 +0000 UTC m=+253.416092249"
May 26 06:26:30.625951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:30.625921    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:30.626319 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:30.625965    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:30.630518 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:30.630499    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:31.073640 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:31.073598    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:26:31.118200 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:31.118165    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686f8b84b-s5456"]
May 26 06:26:56.138631 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.138570    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-686f8b84b-s5456" podUID="47f063cb-f1c9-4c7d-9d92-6409f8b440ca" containerName="console" containerID="cri-o://ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054" gracePeriod=15
May 26 06:26:56.372377 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.372350    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-686f8b84b-s5456_47f063cb-f1c9-4c7d-9d92-6409f8b440ca/console/0.log"
May 26 06:26:56.372486 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.372411    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:26:56.495179 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495156    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-oauth-serving-cert\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495187    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-oauth-config\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495213    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-config\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495254    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-trusted-ca-bundle\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495277    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vkc4\" (UniqueName: \"kubernetes.io/projected/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-kube-api-access-5vkc4\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495331    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-serving-cert\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495592 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495494    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-service-ca\") pod \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\" (UID: \"47f063cb-f1c9-4c7d-9d92-6409f8b440ca\") "
May 26 06:26:56.495687 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495666    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:26:56.495755 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495730    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-config" (OuterVolumeSpecName: "console-config") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:26:56.495813 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495754    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:26:56.495864 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495822    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-oauth-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:56.495864 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495839    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:56.495864 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.495852    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-trusted-ca-bundle\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:56.496033 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.496015    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:26:56.497430 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.497406    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:26:56.497798 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.497772    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-kube-api-access-5vkc4" (OuterVolumeSpecName: "kube-api-access-5vkc4") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "kube-api-access-5vkc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:26:56.497798 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.497781    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "47f063cb-f1c9-4c7d-9d92-6409f8b440ca" (UID: "47f063cb-f1c9-4c7d-9d92-6409f8b440ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:26:56.596365 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.596341    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vkc4\" (UniqueName: \"kubernetes.io/projected/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-kube-api-access-5vkc4\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:56.596365 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.596363    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:56.596485 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.596373    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-service-ca\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:56.596485 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:56.596382    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/47f063cb-f1c9-4c7d-9d92-6409f8b440ca-console-oauth-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:26:57.146849 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.146819    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-686f8b84b-s5456_47f063cb-f1c9-4c7d-9d92-6409f8b440ca/console/0.log"
May 26 06:26:57.147296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.146865    2557 generic.go:358] "Generic (PLEG): container finished" podID="47f063cb-f1c9-4c7d-9d92-6409f8b440ca" containerID="ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054" exitCode=2
May 26 06:26:57.147296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.146902    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f8b84b-s5456" event={"ID":"47f063cb-f1c9-4c7d-9d92-6409f8b440ca","Type":"ContainerDied","Data":"ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054"}
May 26 06:26:57.147296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.146932    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-686f8b84b-s5456" event={"ID":"47f063cb-f1c9-4c7d-9d92-6409f8b440ca","Type":"ContainerDied","Data":"19628343b37f0ac3ea356481a5ba47f08d53b012360e036cee7116f9c1e7d0d3"}
May 26 06:26:57.147296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.146930    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-686f8b84b-s5456"
May 26 06:26:57.147296 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.146945    2557 scope.go:117] "RemoveContainer" containerID="ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054"
May 26 06:26:57.155361 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.155343    2557 scope.go:117] "RemoveContainer" containerID="ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054"
May 26 06:26:57.155630 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:26:57.155583    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054\": container with ID starting with ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054 not found: ID does not exist" containerID="ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054"
May 26 06:26:57.155715 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.155636    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054"} err="failed to get container status \"ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054\": rpc error: code = NotFound desc = could not find container \"ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054\": container with ID starting with ae7ac0e4481f560fa8a3792d58a6b712fcf9fe00ad56efc3416ffe95489aa054 not found: ID does not exist"
May 26 06:26:57.167310 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.167286    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-686f8b84b-s5456"]
May 26 06:26:57.171212 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:57.171192    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-686f8b84b-s5456"]
May 26 06:26:58.265934 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:26:58.265903    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f063cb-f1c9-4c7d-9d92-6409f8b440ca" path="/var/lib/kubelet/pods/47f063cb-f1c9-4c7d-9d92-6409f8b440ca/volumes"
May 26 06:27:16.144036 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:27:16.144011    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 26 06:29:33.442237 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.442202    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"]
May 26 06:29:33.442733 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.442496    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f063cb-f1c9-4c7d-9d92-6409f8b440ca" containerName="console"
May 26 06:29:33.442733 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.442509    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f063cb-f1c9-4c7d-9d92-6409f8b440ca" containerName="console"
May 26 06:29:33.442733 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.442561    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="47f063cb-f1c9-4c7d-9d92-6409f8b440ca" containerName="console"
May 26 06:29:33.445302 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.445287    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:29:33.447174 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.447152    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 06:29:33.447645 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.447624    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 06:29:33.447740 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.447625    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-8zw6v\""
May 26 06:29:33.459434 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.459415    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"]
May 26 06:29:33.525841 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.525813    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szldz\" (UniqueName: \"kubernetes.io/projected/a1e47333-c33b-4e94-81de-2a7c513e8f9d-kube-api-access-szldz\") pod \"feast-operator-controller-manager-6d7cc779d9-n6drj\" (UID: \"a1e47333-c33b-4e94-81de-2a7c513e8f9d\") " pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:29:33.626970 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.626933    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szldz\" (UniqueName: \"kubernetes.io/projected/a1e47333-c33b-4e94-81de-2a7c513e8f9d-kube-api-access-szldz\") pod \"feast-operator-controller-manager-6d7cc779d9-n6drj\" (UID: \"a1e47333-c33b-4e94-81de-2a7c513e8f9d\") " pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:29:33.635103 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.635079    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szldz\" (UniqueName: \"kubernetes.io/projected/a1e47333-c33b-4e94-81de-2a7c513e8f9d-kube-api-access-szldz\") pod \"feast-operator-controller-manager-6d7cc779d9-n6drj\" (UID: \"a1e47333-c33b-4e94-81de-2a7c513e8f9d\") " pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:29:33.754800 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.754731    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:29:33.871942 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.871914    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"]
May 26 06:29:33.874687 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:29:33.874664    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e47333_c33b_4e94_81de_2a7c513e8f9d.slice/crio-ba38fb4a89eb55afee7b34f1f67911b889815888ab9ef8e3e947a765df3f1cac WatchSource:0}: Error finding container ba38fb4a89eb55afee7b34f1f67911b889815888ab9ef8e3e947a765df3f1cac: Status 404 returned error can't find the container with id ba38fb4a89eb55afee7b34f1f67911b889815888ab9ef8e3e947a765df3f1cac
May 26 06:29:33.876793 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:33.876772    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 06:29:34.561672 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:34.561630    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj" event={"ID":"a1e47333-c33b-4e94-81de-2a7c513e8f9d","Type":"ContainerStarted","Data":"ba38fb4a89eb55afee7b34f1f67911b889815888ab9ef8e3e947a765df3f1cac"}
May 26 06:29:37.571434 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:37.571391    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj" event={"ID":"a1e47333-c33b-4e94-81de-2a7c513e8f9d","Type":"ContainerStarted","Data":"2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a"}
May 26 06:29:37.571821 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:37.571518    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:29:37.585965 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:37.585923    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj" podStartSLOduration=1.751167751 podStartE2EDuration="4.585908529s" podCreationTimestamp="2026-05-26 06:29:33 +0000 UTC" firstStartedPulling="2026-05-26 06:29:33.876897397 +0000 UTC m=+438.213463736" lastFinishedPulling="2026-05-26 06:29:36.71163818 +0000 UTC m=+441.048204514" observedRunningTime="2026-05-26 06:29:37.58413953 +0000 UTC m=+441.920705889" watchObservedRunningTime="2026-05-26 06:29:37.585908529 +0000 UTC m=+441.922474921"
May 26 06:29:48.576508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:29:48.576476    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:30:15.885493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.885459    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"]
May 26 06:30:15.894007 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.893936    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:15.897890 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.897865    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 06:30:15.898133 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.898110    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 06:30:15.898260 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.898114    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 06:30:15.898436 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.898418    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 06:30:15.898564 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.898545    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 06:30:15.898650 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.898592    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 06:30:15.898728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.898312    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 06:30:15.899534 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.899516    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pgmhn\""
May 26 06:30:15.909457 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:15.909435    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"]
May 26 06:30:16.059232 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.059199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.059385 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.059239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-registry-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.059385 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.059257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-offline-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.059385 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.059288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.059385 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.059370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7scxn\" (UniqueName: \"kubernetes.io/projected/f4defd24-5021-420b-88b0-f6944d9025d9-kube-api-access-7scxn\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.059587 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.059404    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f4defd24-5021-420b-88b0-f6944d9025d9-feast-data\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.159750 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.159716    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-registry-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.159919 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.159756    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-offline-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.159919 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.159784    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.159919 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.159816    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7scxn\" (UniqueName: \"kubernetes.io/projected/f4defd24-5021-420b-88b0-f6944d9025d9-kube-api-access-7scxn\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.159919 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.159847    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f4defd24-5021-420b-88b0-f6944d9025d9-feast-data\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.159919 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.159901    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.160301 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.160282    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f4defd24-5021-420b-88b0-f6944d9025d9-feast-data\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.161851 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.161832    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 06:30:16.161959 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.161911    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 06:30:16.162041 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.162026    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 06:30:16.162162 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.162136    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 06:30:16.165681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.165662    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 06:30:16.170082 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:30:16.170065    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 06:30:16.170175 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:30:16.170138    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls podName:f4defd24-5021-420b-88b0-f6944d9025d9 nodeName:}" failed. No retries permitted until 2026-05-26 06:30:16.670116947 +0000 UTC m=+481.006683281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls") pod "feast-simple-feast-setup-54f6f4dc5d-pwj44" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 06:30:16.172437 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.172411    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-registry-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.172749 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.172733    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-offline-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.172868 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.172850    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.176170 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.176155    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 06:30:16.187433 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.187410    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7scxn\" (UniqueName: \"kubernetes.io/projected/f4defd24-5021-420b-88b0-f6944d9025d9-kube-api-access-7scxn\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.764560 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.764521    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.766929 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.766905    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-pwj44\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.816407 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.816381    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pgmhn\""
May 26 06:30:16.824814 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.824794    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:30:16.952813 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:16.952787    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"]
May 26 06:30:16.955489 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:30:16.955464    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4defd24_5021_420b_88b0_f6944d9025d9.slice/crio-b66e7d1a7461678e6ef8cb0947da610bfbfcb155be6a6dc7707b1fb17f1f3652 WatchSource:0}: Error finding container b66e7d1a7461678e6ef8cb0947da610bfbfcb155be6a6dc7707b1fb17f1f3652: Status 404 returned error can't find the container with id b66e7d1a7461678e6ef8cb0947da610bfbfcb155be6a6dc7707b1fb17f1f3652
May 26 06:30:17.687376 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:17.687334    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"b66e7d1a7461678e6ef8cb0947da610bfbfcb155be6a6dc7707b1fb17f1f3652"}
May 26 06:30:35.374584 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:35.374553    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65858c67b9-ds46z"]
May 26 06:30:48.780211 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:48.780168    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"d67df8a0e1d65e8f912b48d7221ee17f2f6b9037cbc616e61995f4a7f7bfb713"}
May 26 06:30:52.792408 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:52.792374    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4defd24-5021-420b-88b0-f6944d9025d9" containerID="d67df8a0e1d65e8f912b48d7221ee17f2f6b9037cbc616e61995f4a7f7bfb713" exitCode=0
May 26 06:30:52.792895 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:52.792435    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"d67df8a0e1d65e8f912b48d7221ee17f2f6b9037cbc616e61995f4a7f7bfb713"}
May 26 06:30:53.797070 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:53.797039    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"c7ff90650e32cf8b8cbe31e1df27086977aba3d58682501e1473bd77b71bc2a1"}
May 26 06:30:58.812670 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:58.812634    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4defd24-5021-420b-88b0-f6944d9025d9" containerID="c7ff90650e32cf8b8cbe31e1df27086977aba3d58682501e1473bd77b71bc2a1" exitCode=0
May 26 06:30:58.813048 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:58.812695    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"c7ff90650e32cf8b8cbe31e1df27086977aba3d58682501e1473bd77b71bc2a1"}
May 26 06:30:58.822786 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:58.822766    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
May 26 06:30:59.819799 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:59.819752    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"0e10e3de3a73782653d0b58ca97c87b23ea8d1bceb9874f624710e47061fda4b"}
May 26 06:30:59.819799 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:59.819800    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"f7b9aef5945ad9cd48ab1c6b6f9751a2d553bad779ea3b716dc933b18f8c3f5c"}
May 26 06:30:59.820338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:59.819817    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"1728916784d2b4468eb66cfcdfa39801334656f1ba4cbb77db93fe5409f5f6bf"}
May 26 06:30:59.820338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:59.819830    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerStarted","Data":"626461e0a1330feb075d761c8c8822dab87e5163c8cc53102d0fa1f243ec7eae"}
May 26 06:30:59.843483 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:30:59.843423    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podStartSLOduration=14.02454323 podStartE2EDuration="44.843404674s" podCreationTimestamp="2026-05-26 06:30:15 +0000 UTC" firstStartedPulling="2026-05-26 06:30:16.957336339 +0000 UTC m=+481.293902672" lastFinishedPulling="2026-05-26 06:30:47.776197783 +0000 UTC m=+512.112764116" observedRunningTime="2026-05-26 06:30:59.842269258 +0000 UTC m=+524.178835614" watchObservedRunningTime="2026-05-26 06:30:59.843404674 +0000 UTC m=+524.179971032"
May 26 06:31:00.397672 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.397583    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65858c67b9-ds46z" podUID="b2fd2816-70c1-44c8-b53b-0fea4892490f" containerName="console" containerID="cri-o://5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd" gracePeriod=15
May 26 06:31:00.677745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.677714    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65858c67b9-ds46z_b2fd2816-70c1-44c8-b53b-0fea4892490f/console/0.log"
May 26 06:31:00.677877 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.677793    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:31:00.747543 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747507    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-trusted-ca-bundle\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.747744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747559    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-oauth-config\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.747744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747644    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6n8vs\" (UniqueName: \"kubernetes.io/projected/b2fd2816-70c1-44c8-b53b-0fea4892490f-kube-api-access-6n8vs\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.747744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747673    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-serving-cert\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.747744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747716    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-oauth-serving-cert\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.747970 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747749    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-service-ca\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.747970 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.747796    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-config\") pod \"b2fd2816-70c1-44c8-b53b-0fea4892490f\" (UID: \"b2fd2816-70c1-44c8-b53b-0fea4892490f\") "
May 26 06:31:00.748263 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.748038    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:31:00.748348 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.748323    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-config" (OuterVolumeSpecName: "console-config") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:31:00.748791 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.748725    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:31:00.749418 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.749375    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-service-ca" (OuterVolumeSpecName: "service-ca") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:31:00.750809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.750771    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:31:00.752076 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.752040    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2fd2816-70c1-44c8-b53b-0fea4892490f-kube-api-access-6n8vs" (OuterVolumeSpecName: "kube-api-access-6n8vs") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "kube-api-access-6n8vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:31:00.752551 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.752517    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b2fd2816-70c1-44c8-b53b-0fea4892490f" (UID: "b2fd2816-70c1-44c8-b53b-0fea4892490f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:31:00.825176 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.825146    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65858c67b9-ds46z_b2fd2816-70c1-44c8-b53b-0fea4892490f/console/0.log"
May 26 06:31:00.825746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.825192    2557 generic.go:358] "Generic (PLEG): container finished" podID="b2fd2816-70c1-44c8-b53b-0fea4892490f" containerID="5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd" exitCode=2
May 26 06:31:00.825746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.825286    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65858c67b9-ds46z" event={"ID":"b2fd2816-70c1-44c8-b53b-0fea4892490f","Type":"ContainerDied","Data":"5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd"}
May 26 06:31:00.825746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.825315    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65858c67b9-ds46z" event={"ID":"b2fd2816-70c1-44c8-b53b-0fea4892490f","Type":"ContainerDied","Data":"f7c2294efaf0f362a8d913c4574a7804e308e7b886c431556902bf13a19abd7f"}
May 26 06:31:00.825746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.825335    2557 scope.go:117] "RemoveContainer" containerID="5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd"
May 26 06:31:00.825746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.825475    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65858c67b9-ds46z"
May 26 06:31:00.837847 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.837698    2557 scope.go:117] "RemoveContainer" containerID="5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd"
May 26 06:31:00.838089 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:31:00.838013    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd\": container with ID starting with 5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd not found: ID does not exist" containerID="5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd"
May 26 06:31:00.838089 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.838050    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd"} err="failed to get container status \"5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd\": rpc error: code = NotFound desc = could not find container \"5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd\": container with ID starting with 5a9df070ecae4c277c1adc07fa6c17a1b09cf2e01ace2b1f7c5b7dfe218e46dd not found: ID does not exist"
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849082    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849120    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-oauth-serving-cert\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849136    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-service-ca\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849150    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849163    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fd2816-70c1-44c8-b53b-0fea4892490f-trusted-ca-bundle\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849177    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fd2816-70c1-44c8-b53b-0fea4892490f-console-oauth-config\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.849284 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.849191    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n8vs\" (UniqueName: \"kubernetes.io/projected/b2fd2816-70c1-44c8-b53b-0fea4892490f-kube-api-access-6n8vs\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:31:00.852898 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.852829    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65858c67b9-ds46z"]
May 26 06:31:00.860958 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:00.860912    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65858c67b9-ds46z"]
May 26 06:31:01.825999 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.825881    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:01.825999 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.825925    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:01.825999 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.825939    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:01.826582 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.826063    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:01.828492 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.828177    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused"
May 26 06:31:01.828492 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.828208    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
May 26 06:31:01.828492 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.828190    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 06:31:01.828492 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:01.828235    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 06:31:02.267851 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:02.267812    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2fd2816-70c1-44c8-b53b-0fea4892490f" path="/var/lib/kubelet/pods/b2fd2816-70c1-44c8-b53b-0fea4892490f/volumes"
May 26 06:31:04.826694 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.826662    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827134 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.826751    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827134 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.826993    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827383 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.827360    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827503 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.827404    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827503 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.827420    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827638 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.827502    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827715 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.827694    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.827775 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.827764    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.831164 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.831147    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.840009 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.839991    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:31:04.842457 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:31:04.842438    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:32:07.076482 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.076451    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"]
May 26 06:32:07.077007 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.076787    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="registry" containerID="cri-o://626461e0a1330feb075d761c8c8822dab87e5163c8cc53102d0fa1f243ec7eae" gracePeriod=30
May 26 06:32:07.077007 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.076853    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui" containerID="cri-o://0e10e3de3a73782653d0b58ca97c87b23ea8d1bceb9874f624710e47061fda4b" gracePeriod=30
May 26 06:32:07.077007 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.076863    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="offline" containerID="cri-o://f7b9aef5945ad9cd48ab1c6b6f9751a2d553bad779ea3b716dc933b18f8c3f5c" gracePeriod=30
May 26 06:32:07.077007 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.076978    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online" containerID="cri-o://1728916784d2b4468eb66cfcdfa39801334656f1ba4cbb77db93fe5409f5f6bf" gracePeriod=30
May 26 06:32:07.341804 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.341707    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"]
May 26 06:32:07.342181 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.342167    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2fd2816-70c1-44c8-b53b-0fea4892490f" containerName="console"
May 26 06:32:07.342252 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.342184    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2fd2816-70c1-44c8-b53b-0fea4892490f" containerName="console"
May 26 06:32:07.342287 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.342251    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2fd2816-70c1-44c8-b53b-0fea4892490f" containerName="console"
May 26 06:32:07.346240 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.346222    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.348034 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.348010    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-r5x29\""
May 26 06:32:07.356059 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.356033    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"]
May 26 06:32:07.450331 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.450270    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-feast-data\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.450511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.450343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czv9j\" (UniqueName: \"kubernetes.io/projected/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-kube-api-access-czv9j\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.450511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.450378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-registry-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.450511 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.450410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.450673 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.450540    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.450673 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.450591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-offline-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.551365 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.551335    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.551537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.551372    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-offline-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.551537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.551489    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-feast-data\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.551537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.551514    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czv9j\" (UniqueName: \"kubernetes.io/projected/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-kube-api-access-czv9j\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.551537 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:32:07.551521    2557 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 06:32:07.551767 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:32:07.551594    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls podName:a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a nodeName:}" failed. No retries permitted until 2026-05-26 06:32:08.051572738 +0000 UTC m=+592.388139086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls") pod "feast-simple-feast-setup-54f6f4dc5d-4v796" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a") : secret "feast-simple-feast-setup-online-tls" not found
May 26 06:32:07.551767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.551647    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-registry-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.551767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.551718    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.552439 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.552412    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-feast-data\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.554245 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.554219    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-offline-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.554691 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.554668    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-ui-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.554691 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.554681    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-registry-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:07.559139 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:07.559111    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czv9j\" (UniqueName: \"kubernetes.io/projected/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-kube-api-access-czv9j\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:08.022036 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.022007    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4defd24-5021-420b-88b0-f6944d9025d9" containerID="0e10e3de3a73782653d0b58ca97c87b23ea8d1bceb9874f624710e47061fda4b" exitCode=0
May 26 06:32:08.022036 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.022035    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4defd24-5021-420b-88b0-f6944d9025d9" containerID="1728916784d2b4468eb66cfcdfa39801334656f1ba4cbb77db93fe5409f5f6bf" exitCode=0
May 26 06:32:08.022207 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.022076    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"0e10e3de3a73782653d0b58ca97c87b23ea8d1bceb9874f624710e47061fda4b"}
May 26 06:32:08.022207 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.022109    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"1728916784d2b4468eb66cfcdfa39801334656f1ba4cbb77db93fe5409f5f6bf"}
May 26 06:32:08.056452 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.056428    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:08.058714 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.058687    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls\") pod \"feast-simple-feast-setup-54f6f4dc5d-4v796\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") " pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:08.260278 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.260244    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:08.387970 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:08.387941    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"]
May 26 06:32:08.389817 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:32:08.389789    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2c1b90e_1796_4d6d_ade4_3dc4bc17a03a.slice/crio-a644c381644c7ed21ee6e130f9c8fc6722eaa23c4c64f41941599f515f933e10 WatchSource:0}: Error finding container a644c381644c7ed21ee6e130f9c8fc6722eaa23c4c64f41941599f515f933e10: Status 404 returned error can't find the container with id a644c381644c7ed21ee6e130f9c8fc6722eaa23c4c64f41941599f515f933e10
May 26 06:32:09.026784 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:09.026745    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"edb55d8fb1b274995e3382bffb0d4af4d76852b5fe4dc02fab79a4c6aa7d5d1c"}
May 26 06:32:09.026784 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:09.026786    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"a644c381644c7ed21ee6e130f9c8fc6722eaa23c4c64f41941599f515f933e10"}
May 26 06:32:13.044520 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:13.044486    2557 generic.go:358] "Generic (PLEG): container finished" podID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerID="edb55d8fb1b274995e3382bffb0d4af4d76852b5fe4dc02fab79a4c6aa7d5d1c" exitCode=0
May 26 06:32:13.044876 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:13.044560    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"edb55d8fb1b274995e3382bffb0d4af4d76852b5fe4dc02fab79a4c6aa7d5d1c"}
May 26 06:32:14.049665 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:14.049626    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"1100794ff3ff8774a46fd2a4866f1f1f34921708db11d81fa880c6c7b45eb267"}
May 26 06:32:14.827573 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:14.827506    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 06:32:14.840244 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:14.840218    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 06:32:19.066042 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:19.066007    2557 generic.go:358] "Generic (PLEG): container finished" podID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerID="1100794ff3ff8774a46fd2a4866f1f1f34921708db11d81fa880c6c7b45eb267" exitCode=0
May 26 06:32:19.066508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:19.066087    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"1100794ff3ff8774a46fd2a4866f1f1f34921708db11d81fa880c6c7b45eb267"}
May 26 06:32:20.073325 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.073284    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"878cb89f41c38b8fcb073f7254bf3686b9ccee0316692ac11a4af2a5f6a457c3"}
May 26 06:32:20.073779 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.073342    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"bdf30015e0e7592c7bed896f3cd4f74c59330c401749b8c2cb5b6cf1b68d1f2a"}
May 26 06:32:20.073779 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.073358    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"662776d0887929c5d1db51641406d924274e76423944d2921fff92fd6878181d"}
May 26 06:32:20.073779 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.073370    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerStarted","Data":"9675ef7c4e9569aaec16c7c92578d86614f17d670bf33b9b096dbff5a31ec2fb"}
May 26 06:32:20.097947 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.097887    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podStartSLOduration=13.097868811 podStartE2EDuration="13.097868811s" podCreationTimestamp="2026-05-26 06:32:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:32:20.097236385 +0000 UTC m=+604.433802755" watchObservedRunningTime="2026-05-26 06:32:20.097868811 +0000 UTC m=+604.434435169"
May 26 06:32:20.261257 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.261215    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:20.261443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.261270    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:20.261443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.261286    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:20.261443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.261300    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:20.263570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.263529    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
May 26 06:32:20.263716 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.263563    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
May 26 06:32:20.263716 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.263690    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
May 26 06:32:20.263837 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:20.263777    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
May 26 06:32:23.261267 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:23.261222    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.24:6571: connect: connection refused"
May 26 06:32:23.261822 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:23.261218    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
May 26 06:32:23.261955 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:23.261220    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
May 26 06:32:23.261955 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:23.261278    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
May 26 06:32:24.828290 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:24.828242    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 06:32:24.840469 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:24.840441    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 06:32:26.266148 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.266122    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.266558 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.266231    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.266558 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.266464    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.266728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.266707    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.266997 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.266975    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.267107 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.267008    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.267107 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.267023    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.267107 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.267076    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.267216 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.267166    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:26.267283 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:26.267270    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:27.099099 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:27.099052    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:27.102116 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:27.102090    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:32:34.827936 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:34.827891    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
May 26 06:32:34.828327 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:34.828043    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:32:34.840461 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:34.840433    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
May 26 06:32:34.840539 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:34.840521    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:32:37.129849 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.129823    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4defd24-5021-420b-88b0-f6944d9025d9" containerID="f7b9aef5945ad9cd48ab1c6b6f9751a2d553bad779ea3b716dc933b18f8c3f5c" exitCode=137
May 26 06:32:37.129849 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.129845    2557 generic.go:358] "Generic (PLEG): container finished" podID="f4defd24-5021-420b-88b0-f6944d9025d9" containerID="626461e0a1330feb075d761c8c8822dab87e5163c8cc53102d0fa1f243ec7eae" exitCode=137
May 26 06:32:37.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.129890    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"f7b9aef5945ad9cd48ab1c6b6f9751a2d553bad779ea3b716dc933b18f8c3f5c"}
May 26 06:32:37.130163 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.129922    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"626461e0a1330feb075d761c8c8822dab87e5163c8cc53102d0fa1f243ec7eae"}
May 26 06:32:37.720498 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.720473    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:32:37.812627 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.812570    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls\") pod \"f4defd24-5021-420b-88b0-f6944d9025d9\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") "
May 26 06:32:37.812809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.812664    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-online-tls\") pod \"f4defd24-5021-420b-88b0-f6944d9025d9\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") "
May 26 06:32:37.812809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.812713    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7scxn\" (UniqueName: \"kubernetes.io/projected/f4defd24-5021-420b-88b0-f6944d9025d9-kube-api-access-7scxn\") pod \"f4defd24-5021-420b-88b0-f6944d9025d9\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") "
May 26 06:32:37.812809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.812758    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-offline-tls\") pod \"f4defd24-5021-420b-88b0-f6944d9025d9\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") "
May 26 06:32:37.812942 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.812808    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-registry-tls\") pod \"f4defd24-5021-420b-88b0-f6944d9025d9\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") "
May 26 06:32:37.812942 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.812837    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f4defd24-5021-420b-88b0-f6944d9025d9-feast-data\") pod \"f4defd24-5021-420b-88b0-f6944d9025d9\" (UID: \"f4defd24-5021-420b-88b0-f6944d9025d9\") "
May 26 06:32:37.813516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.813479    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4defd24-5021-420b-88b0-f6944d9025d9-feast-data" (OuterVolumeSpecName: "feast-data") pod "f4defd24-5021-420b-88b0-f6944d9025d9" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:32:37.814969 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.814937    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f4defd24-5021-420b-88b0-f6944d9025d9" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:32:37.815136 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.815103    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-online-tls" (OuterVolumeSpecName: "online-tls") pod "f4defd24-5021-420b-88b0-f6944d9025d9" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:32:37.815227 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.815171    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f4defd24-5021-420b-88b0-f6944d9025d9" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:32:37.815227 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.815215    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4defd24-5021-420b-88b0-f6944d9025d9-kube-api-access-7scxn" (OuterVolumeSpecName: "kube-api-access-7scxn") pod "f4defd24-5021-420b-88b0-f6944d9025d9" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9"). InnerVolumeSpecName "kube-api-access-7scxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:32:37.815305 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.815248    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f4defd24-5021-420b-88b0-f6944d9025d9" (UID: "f4defd24-5021-420b-88b0-f6944d9025d9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:32:37.913722 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.913680    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-ui-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:32:37.913722 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.913721    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-online-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:32:37.913722 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.913734    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7scxn\" (UniqueName: \"kubernetes.io/projected/f4defd24-5021-420b-88b0-f6944d9025d9-kube-api-access-7scxn\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:32:37.913940 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.913743    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-offline-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:32:37.913940 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.913753    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f4defd24-5021-420b-88b0-f6944d9025d9-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:32:37.913940 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:37.913761    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f4defd24-5021-420b-88b0-f6944d9025d9-feast-data\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:32:38.135537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.135506    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44" event={"ID":"f4defd24-5021-420b-88b0-f6944d9025d9","Type":"ContainerDied","Data":"b66e7d1a7461678e6ef8cb0947da610bfbfcb155be6a6dc7707b1fb17f1f3652"}
May 26 06:32:38.135981 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.135558    2557 scope.go:117] "RemoveContainer" containerID="0e10e3de3a73782653d0b58ca97c87b23ea8d1bceb9874f624710e47061fda4b"
May 26 06:32:38.135981 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.135571    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"
May 26 06:32:38.144896 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.144878    2557 scope.go:117] "RemoveContainer" containerID="f7b9aef5945ad9cd48ab1c6b6f9751a2d553bad779ea3b716dc933b18f8c3f5c"
May 26 06:32:38.152110 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.152094    2557 scope.go:117] "RemoveContainer" containerID="1728916784d2b4468eb66cfcdfa39801334656f1ba4cbb77db93fe5409f5f6bf"
May 26 06:32:38.157951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.157929    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"]
May 26 06:32:38.160510 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.160492    2557 scope.go:117] "RemoveContainer" containerID="626461e0a1330feb075d761c8c8822dab87e5163c8cc53102d0fa1f243ec7eae"
May 26 06:32:38.161720 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.161697    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-pwj44"]
May 26 06:32:38.167363 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.167347    2557 scope.go:117] "RemoveContainer" containerID="c7ff90650e32cf8b8cbe31e1df27086977aba3d58682501e1473bd77b71bc2a1"
May 26 06:32:38.174099 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.174081    2557 scope.go:117] "RemoveContainer" containerID="d67df8a0e1d65e8f912b48d7221ee17f2f6b9037cbc616e61995f4a7f7bfb713"
May 26 06:32:38.266297 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:32:38.266259    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" path="/var/lib/kubelet/pods/f4defd24-5021-420b-88b0-f6944d9025d9/volumes"
May 26 06:33:29.002329 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002290    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"]
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002628    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="feast-init"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002640    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="feast-init"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002649    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="registry"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002655    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="registry"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002660    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002666    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002673    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="feast-apply"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002677    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="feast-apply"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002687    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002692    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002706    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="offline"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002714    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="offline"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002767    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="ui"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002778    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="offline"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002789    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="online"
May 26 06:33:29.002893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.002795    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f4defd24-5021-420b-88b0-f6944d9025d9" containerName="registry"
May 26 06:33:29.006177 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.006158    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.008187 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008169    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
May 26 06:33:29.008311 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008294    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 06:33:29.008408 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008394    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-27c9z\""
May 26 06:33:29.008508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008295    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 06:33:29.008508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008465    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 06:33:29.008636 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008592    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 06:33:29.008701 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008667    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 06:33:29.008701 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.008696    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 06:33:29.015726 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.015703    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"]
May 26 06:33:29.104945 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.104912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-registry-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.105132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.104957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twxp8\" (UniqueName: \"kubernetes.io/projected/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-kube-api-access-twxp8\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.105132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.105031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-feast-data\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.105132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.105050    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-online-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.105132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.105070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.105132 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.105086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206251 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206220    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-registry-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206437 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206285    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twxp8\" (UniqueName: \"kubernetes.io/projected/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-kube-api-access-twxp8\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206437 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206336    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-feast-data\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206437 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206367    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-online-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206437 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206396    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206680 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:33:29.206482    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 06:33:29.206680 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:33:29.206547    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls podName:e67deadf-8b88-4c9d-b4d3-199f6a136cf9 nodeName:}" failed. No retries permitted until 2026-05-26 06:33:29.706527536 +0000 UTC m=+674.043093875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls") pod "feast-simple-feast-remote-setup-67c598965-flrks" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9") : secret "feast-simple-feast-remote-setup-offline-tls" not found
May 26 06:33:29.206680 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206836 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:33:29.206764    2557 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 06:33:29.206836 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206790    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-feast-data\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.206836 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:33:29.206822    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls podName:e67deadf-8b88-4c9d-b4d3-199f6a136cf9 nodeName:}" failed. No retries permitted until 2026-05-26 06:33:29.706806021 +0000 UTC m=+674.043372357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls") pod "feast-simple-feast-remote-setup-67c598965-flrks" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 26 06:33:29.207021 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.206997    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-registry-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.209022 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.208993    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-online-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.216342 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.216319    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twxp8\" (UniqueName: \"kubernetes.io/projected/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-kube-api-access-twxp8\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.711319 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.711285    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.711319 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.711320    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.713744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.713720    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.713848 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.713789    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls\") pod \"feast-simple-feast-remote-setup-67c598965-flrks\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:29.918774 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:29.918747    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:30.048696 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:30.048673    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"]
May 26 06:33:30.050563 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:33:30.050532    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode67deadf_8b88_4c9d_b4d3_199f6a136cf9.slice/crio-6af044fd17630492199f28a838dcc2f663a905767d82d956a2b1aecd7f559e92 WatchSource:0}: Error finding container 6af044fd17630492199f28a838dcc2f663a905767d82d956a2b1aecd7f559e92: Status 404 returned error can't find the container with id 6af044fd17630492199f28a838dcc2f663a905767d82d956a2b1aecd7f559e92
May 26 06:33:30.300362 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:30.300267    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerStarted","Data":"0ae613c21ed8c8f5e96580127bb5feb6670a7008d4b168a7ad057d41073533f4"}
May 26 06:33:30.300362 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:30.300315    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerStarted","Data":"6af044fd17630492199f28a838dcc2f663a905767d82d956a2b1aecd7f559e92"}
May 26 06:33:35.316849 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:35.316815    2557 generic.go:358] "Generic (PLEG): container finished" podID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerID="0ae613c21ed8c8f5e96580127bb5feb6670a7008d4b168a7ad057d41073533f4" exitCode=0
May 26 06:33:35.316849 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:35.316851    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerDied","Data":"0ae613c21ed8c8f5e96580127bb5feb6670a7008d4b168a7ad057d41073533f4"}
May 26 06:33:36.321484 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:36.321450    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerStarted","Data":"2aa86972ef316beda301daa0b96f7f0150d945f20be50e7525b31eeb46a4d5f0"}
May 26 06:33:41.339620 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:41.339572    2557 generic.go:358] "Generic (PLEG): container finished" podID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerID="2aa86972ef316beda301daa0b96f7f0150d945f20be50e7525b31eeb46a4d5f0" exitCode=0
May 26 06:33:41.339986 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:41.339648    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerDied","Data":"2aa86972ef316beda301daa0b96f7f0150d945f20be50e7525b31eeb46a4d5f0"}
May 26 06:33:42.345920 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:42.345877    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerStarted","Data":"a7a0756d0f2f29f9ba6a41cf218e00bb4af3a2ad1b002580e79147d49d2ef9df"}
May 26 06:33:42.345920 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:42.345926    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerStarted","Data":"78fd84cae3cdd969ac5eaec20b50232b4ae3bb0514fc5daa928a4781054d52bd"}
May 26 06:33:42.346332 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:42.345940    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerStarted","Data":"dbe216f56d0798902162295a58499baee9c412bc277717555ef80812fd2249f3"}
May 26 06:33:42.370761 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:42.370693    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podStartSLOduration=14.370673371 podStartE2EDuration="14.370673371s" podCreationTimestamp="2026-05-26 06:33:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:33:42.368683324 +0000 UTC m=+686.705249681" watchObservedRunningTime="2026-05-26 06:33:42.370673371 +0000 UTC m=+686.707239729"
May 26 06:33:44.919655 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:44.919618    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:44.920203 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:44.920181    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:44.920312 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:44.920206    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:44.921578 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:44.921537    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 26 06:33:44.921578 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:44.921563    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused"
May 26 06:33:44.921776 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:44.921624    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 26 06:33:47.920627 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.920576    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:47.921084 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.920707    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:47.921084 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.921075    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:47.921245 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.921106    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:47.921293 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.921278    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:47.921513 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.921496    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:47.925104 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:47.925070    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:48.364439 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:48.364360    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:33:48.367143 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:33:48.367121    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:34:50.283769 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.283727    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"]
May 26 06:34:50.284317 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.284132    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online" containerID="cri-o://dbe216f56d0798902162295a58499baee9c412bc277717555ef80812fd2249f3" gracePeriod=30
May 26 06:34:50.284317 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.284247    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui" containerID="cri-o://a7a0756d0f2f29f9ba6a41cf218e00bb4af3a2ad1b002580e79147d49d2ef9df" gracePeriod=30
May 26 06:34:50.284448 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.284336    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="offline" containerID="cri-o://78fd84cae3cdd969ac5eaec20b50232b4ae3bb0514fc5daa928a4781054d52bd" gracePeriod=30
May 26 06:34:50.398045 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.398002    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"]
May 26 06:34:50.398473 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.398447    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="registry" containerID="cri-o://9675ef7c4e9569aaec16c7c92578d86614f17d670bf33b9b096dbff5a31ec2fb" gracePeriod=30
May 26 06:34:50.398585 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.398559    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="offline" containerID="cri-o://bdf30015e0e7592c7bed896f3cd4f74c59330c401749b8c2cb5b6cf1b68d1f2a" gracePeriod=30
May 26 06:34:50.398695 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.398578    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online" containerID="cri-o://662776d0887929c5d1db51641406d924274e76423944d2921fff92fd6878181d" gracePeriod=30
May 26 06:34:50.398695 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:50.398564    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui" containerID="cri-o://878cb89f41c38b8fcb073f7254bf3686b9ccee0316692ac11a4af2a5f6a457c3" gracePeriod=30
May 26 06:34:51.539806 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.539775    2557 generic.go:358] "Generic (PLEG): container finished" podID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerID="a7a0756d0f2f29f9ba6a41cf218e00bb4af3a2ad1b002580e79147d49d2ef9df" exitCode=0
May 26 06:34:51.539806 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.539799    2557 generic.go:358] "Generic (PLEG): container finished" podID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerID="dbe216f56d0798902162295a58499baee9c412bc277717555ef80812fd2249f3" exitCode=0
May 26 06:34:51.540242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.539848    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerDied","Data":"a7a0756d0f2f29f9ba6a41cf218e00bb4af3a2ad1b002580e79147d49d2ef9df"}
May 26 06:34:51.540242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.539882    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerDied","Data":"dbe216f56d0798902162295a58499baee9c412bc277717555ef80812fd2249f3"}
May 26 06:34:51.542344 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.542325    2557 generic.go:358] "Generic (PLEG): container finished" podID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerID="878cb89f41c38b8fcb073f7254bf3686b9ccee0316692ac11a4af2a5f6a457c3" exitCode=0
May 26 06:34:51.542344 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.542341    2557 generic.go:358] "Generic (PLEG): container finished" podID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerID="662776d0887929c5d1db51641406d924274e76423944d2921fff92fd6878181d" exitCode=0
May 26 06:34:51.542478 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.542398    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"878cb89f41c38b8fcb073f7254bf3686b9ccee0316692ac11a4af2a5f6a457c3"}
May 26 06:34:51.542478 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:51.542424    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"662776d0887929c5d1db51641406d924274e76423944d2921fff92fd6878181d"}
May 26 06:34:56.267014 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:56.266970    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
May 26 06:34:57.099412 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:57.099371    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
May 26 06:34:57.921537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:57.921474    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 26 06:34:58.364995 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:34:58.364910    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 26 06:35:06.267030 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:06.266982    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
May 26 06:35:07.099261 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:07.099219    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
May 26 06:35:07.921242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:07.921193    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 26 06:35:08.364988 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:08.364897    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 26 06:35:16.267152 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:16.267109    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
May 26 06:35:16.267541 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:16.267238    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:35:17.100071 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:17.100038    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
May 26 06:35:17.100231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:17.100155    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:35:17.921707 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:17.921663    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused"
May 26 06:35:17.922094 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:17.921806    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:35:18.364993 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:18.364899    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused"
May 26 06:35:18.365145 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:18.365021    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:35:20.631465 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.631388    2557 generic.go:358] "Generic (PLEG): container finished" podID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerID="bdf30015e0e7592c7bed896f3cd4f74c59330c401749b8c2cb5b6cf1b68d1f2a" exitCode=137
May 26 06:35:20.631465 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.631414    2557 generic.go:358] "Generic (PLEG): container finished" podID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerID="9675ef7c4e9569aaec16c7c92578d86614f17d670bf33b9b096dbff5a31ec2fb" exitCode=137
May 26 06:35:20.631886 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.631459    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"bdf30015e0e7592c7bed896f3cd4f74c59330c401749b8c2cb5b6cf1b68d1f2a"}
May 26 06:35:20.631886 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.631493    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"9675ef7c4e9569aaec16c7c92578d86614f17d670bf33b9b096dbff5a31ec2fb"}
May 26 06:35:20.633643 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.633619    2557 generic.go:358] "Generic (PLEG): container finished" podID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerID="78fd84cae3cdd969ac5eaec20b50232b4ae3bb0514fc5daa928a4781054d52bd" exitCode=137
May 26 06:35:20.633742 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.633626    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerDied","Data":"78fd84cae3cdd969ac5eaec20b50232b4ae3bb0514fc5daa928a4781054d52bd"}
May 26 06:35:20.924995 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.924973    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:35:20.985091 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985059    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-registry-tls\") pod \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") "
May 26 06:35:20.985231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985108    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls\") pod \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") "
May 26 06:35:20.985231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985174    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twxp8\" (UniqueName: \"kubernetes.io/projected/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-kube-api-access-twxp8\") pod \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") "
May 26 06:35:20.985231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985221    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-online-tls\") pod \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") "
May 26 06:35:20.985399 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985238    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-feast-data\") pod \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") "
May 26 06:35:20.985399 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985264    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls\") pod \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\" (UID: \"e67deadf-8b88-4c9d-b4d3-199f6a136cf9\") "
May 26 06:35:20.985882 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.985833    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e67deadf-8b88-4c9d-b4d3-199f6a136cf9" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 06:35:20.986073 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.986040    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-feast-data" (OuterVolumeSpecName: "feast-data") pod "e67deadf-8b88-4c9d-b4d3-199f6a136cf9" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:35:20.987647 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.987618    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e67deadf-8b88-4c9d-b4d3-199f6a136cf9" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:20.987735 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.987679    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-kube-api-access-twxp8" (OuterVolumeSpecName: "kube-api-access-twxp8") pod "e67deadf-8b88-4c9d-b4d3-199f6a136cf9" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9"). InnerVolumeSpecName "kube-api-access-twxp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:35:20.987955 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.987922    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e67deadf-8b88-4c9d-b4d3-199f6a136cf9" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:20.988027 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:20.987941    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-online-tls" (OuterVolumeSpecName: "online-tls") pod "e67deadf-8b88-4c9d-b4d3-199f6a136cf9" (UID: "e67deadf-8b88-4c9d-b4d3-199f6a136cf9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:21.034119 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.034100    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:35:21.086413 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086381    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-registry-tls\") pod \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") "
May 26 06:35:21.086569 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086436    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-feast-data\") pod \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") "
May 26 06:35:21.086569 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086469    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-offline-tls\") pod \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") "
May 26 06:35:21.086569 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086506    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-ui-tls\") pod \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") "
May 26 06:35:21.086569 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086528    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls\") pod \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") "
May 26 06:35:21.086820 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086578    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czv9j\" (UniqueName: \"kubernetes.io/projected/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-kube-api-access-czv9j\") pod \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\" (UID: \"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a\") "
May 26 06:35:21.086874 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086855    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twxp8\" (UniqueName: \"kubernetes.io/projected/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-kube-api-access-twxp8\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.086932 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086877    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-online-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.086932 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086892    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-feast-data\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.086932 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086906    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-ui-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.086932 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086920    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.087078 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.086934    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e67deadf-8b88-4c9d-b4d3-199f6a136cf9-offline-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.087078 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.087041    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-feast-data" (OuterVolumeSpecName: "feast-data") pod "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:35:21.088716 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.088686    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-kube-api-access-czv9j" (OuterVolumeSpecName: "kube-api-access-czv9j") pod "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a"). InnerVolumeSpecName "kube-api-access-czv9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:35:21.089057 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.089030    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls" (OuterVolumeSpecName: "online-tls") pod "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:21.089057 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.089046    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:21.089158 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.089067    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:21.089158 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.089079    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" (UID: "a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:35:21.187745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.187676    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.187745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.187709    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-feast-data\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.187745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.187717    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-offline-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.187745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.187726    2557 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-ui-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.187745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.187735    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-online-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.187745 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.187744    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czv9j\" (UniqueName: \"kubernetes.io/projected/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a-kube-api-access-czv9j\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:35:21.638767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.638674    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks" event={"ID":"e67deadf-8b88-4c9d-b4d3-199f6a136cf9","Type":"ContainerDied","Data":"6af044fd17630492199f28a838dcc2f663a905767d82d956a2b1aecd7f559e92"}
May 26 06:35:21.638767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.638695    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"
May 26 06:35:21.638767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.638722    2557 scope.go:117] "RemoveContainer" containerID="a7a0756d0f2f29f9ba6a41cf218e00bb4af3a2ad1b002580e79147d49d2ef9df"
May 26 06:35:21.641472 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.641454    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"
May 26 06:35:21.641627 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.641466    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796" event={"ID":"a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a","Type":"ContainerDied","Data":"a644c381644c7ed21ee6e130f9c8fc6722eaa23c4c64f41941599f515f933e10"}
May 26 06:35:21.649184 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.649152    2557 scope.go:117] "RemoveContainer" containerID="78fd84cae3cdd969ac5eaec20b50232b4ae3bb0514fc5daa928a4781054d52bd"
May 26 06:35:21.656265 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.656246    2557 scope.go:117] "RemoveContainer" containerID="dbe216f56d0798902162295a58499baee9c412bc277717555ef80812fd2249f3"
May 26 06:35:21.659808 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.659785    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"]
May 26 06:35:21.663225 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.663196    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-67c598965-flrks"]
May 26 06:35:21.664425 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.664408    2557 scope.go:117] "RemoveContainer" containerID="2aa86972ef316beda301daa0b96f7f0150d945f20be50e7525b31eeb46a4d5f0"
May 26 06:35:21.673593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.672577    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"]
May 26 06:35:21.673593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.673569    2557 scope.go:117] "RemoveContainer" containerID="0ae613c21ed8c8f5e96580127bb5feb6670a7008d4b168a7ad057d41073533f4"
May 26 06:35:21.675933 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.675914    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54f6f4dc5d-4v796"]
May 26 06:35:21.681244 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.681230    2557 scope.go:117] "RemoveContainer" containerID="878cb89f41c38b8fcb073f7254bf3686b9ccee0316692ac11a4af2a5f6a457c3"
May 26 06:35:21.688162 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.688145    2557 scope.go:117] "RemoveContainer" containerID="bdf30015e0e7592c7bed896f3cd4f74c59330c401749b8c2cb5b6cf1b68d1f2a"
May 26 06:35:21.694420 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.694405    2557 scope.go:117] "RemoveContainer" containerID="662776d0887929c5d1db51641406d924274e76423944d2921fff92fd6878181d"
May 26 06:35:21.700714 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.700701    2557 scope.go:117] "RemoveContainer" containerID="9675ef7c4e9569aaec16c7c92578d86614f17d670bf33b9b096dbff5a31ec2fb"
May 26 06:35:21.707096 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.707079    2557 scope.go:117] "RemoveContainer" containerID="1100794ff3ff8774a46fd2a4866f1f1f34921708db11d81fa880c6c7b45eb267"
May 26 06:35:21.713089 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:21.713072    2557 scope.go:117] "RemoveContainer" containerID="edb55d8fb1b274995e3382bffb0d4af4d76852b5fe4dc02fab79a4c6aa7d5d1c"
May 26 06:35:22.265477 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:22.265446    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" path="/var/lib/kubelet/pods/a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a/volumes"
May 26 06:35:22.266055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:22.266040    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" path="/var/lib/kubelet/pods/e67deadf-8b88-4c9d-b4d3-199f6a136cf9/volumes"
May 26 06:35:33.316387 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316353    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dw4rr"]
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316814    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316834    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316846    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="offline"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316855    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="offline"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316871    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="feast-apply"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316879    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="feast-apply"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316888    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="offline"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316897    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="offline"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316907    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316915    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316923    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="registry"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316932    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="registry"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316941    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online"
May 26 06:35:33.316951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316948    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316962    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="feast-init"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316970    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="feast-init"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316981    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="feast-init"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.316989    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="feast-init"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317004    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="feast-apply"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317013    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="feast-apply"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317025    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317032    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317104    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="ui"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317152    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="offline"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317164    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="online"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317174    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="registry"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317187    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="offline"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317197    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e67deadf-8b88-4c9d-b4d3-199f6a136cf9" containerName="online"
May 26 06:35:33.317616 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.317207    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c1b90e-1796-4d6d-ade4-3dc4bc17a03a" containerName="ui"
May 26 06:35:33.322786 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.322765    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.325020 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.325000    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-fgv45\""
May 26 06:35:33.325375 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.325351    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dw4rr"]
May 26 06:35:33.325558 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.325545    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 06:35:33.325663 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.325546    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 06:35:33.325663 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.325578    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
May 26 06:35:33.351005 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.350979    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-njfdd"]
May 26 06:35:33.354089 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.354074    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:35:33.359547 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.359526    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-njfdd"]
May 26 06:35:33.479889 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.479858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkc9k\" (UniqueName: \"kubernetes.io/projected/a1da5f83-e6b1-43b7-8508-4deec5a3cb13-kube-api-access-dkc9k\") pod \"redis-854544c579-njfdd\" (UID: \"a1da5f83-e6b1-43b7-8508-4deec5a3cb13\") " pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:35:33.479889 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.479889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnxsn\" (UniqueName: \"kubernetes.io/projected/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-kube-api-access-qnxsn\") pod \"postgres-7c7656cc6d-dw4rr\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") " pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.480061 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.479922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-postgresdata\") pod \"postgres-7c7656cc6d-dw4rr\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") " pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.580911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.580850    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkc9k\" (UniqueName: \"kubernetes.io/projected/a1da5f83-e6b1-43b7-8508-4deec5a3cb13-kube-api-access-dkc9k\") pod \"redis-854544c579-njfdd\" (UID: \"a1da5f83-e6b1-43b7-8508-4deec5a3cb13\") " pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:35:33.580911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.580880    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnxsn\" (UniqueName: \"kubernetes.io/projected/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-kube-api-access-qnxsn\") pod \"postgres-7c7656cc6d-dw4rr\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") " pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.581045 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.580922    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-postgresdata\") pod \"postgres-7c7656cc6d-dw4rr\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") " pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.581276 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.581258    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-postgresdata\") pod \"postgres-7c7656cc6d-dw4rr\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") " pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.588094 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.588075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkc9k\" (UniqueName: \"kubernetes.io/projected/a1da5f83-e6b1-43b7-8508-4deec5a3cb13-kube-api-access-dkc9k\") pod \"redis-854544c579-njfdd\" (UID: \"a1da5f83-e6b1-43b7-8508-4deec5a3cb13\") " pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:35:33.588259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.588239    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnxsn\" (UniqueName: \"kubernetes.io/projected/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-kube-api-access-qnxsn\") pod \"postgres-7c7656cc6d-dw4rr\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") " pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.644063 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.644040    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:35:33.663854 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.663834    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:35:33.777174 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.777141    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dw4rr"]
May 26 06:35:33.780777 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:35:33.780751    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0fd09ec_0628_408a_a1b1_acbe38c1b8af.slice/crio-884eab22a6da7b1d1c661ee8387801b7fa1b0adb4d54cb038839f58cde25af2c WatchSource:0}: Error finding container 884eab22a6da7b1d1c661ee8387801b7fa1b0adb4d54cb038839f58cde25af2c: Status 404 returned error can't find the container with id 884eab22a6da7b1d1c661ee8387801b7fa1b0adb4d54cb038839f58cde25af2c
May 26 06:35:33.782432 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.782411    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 06:35:33.793721 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:33.793697    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-njfdd"]
May 26 06:35:33.796365 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:35:33.796334    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1da5f83_e6b1_43b7_8508_4deec5a3cb13.slice/crio-a7a903c4ec9e81929e02ea6ce2877974afc46c431eb225bd1408683225a6533c WatchSource:0}: Error finding container a7a903c4ec9e81929e02ea6ce2877974afc46c431eb225bd1408683225a6533c: Status 404 returned error can't find the container with id a7a903c4ec9e81929e02ea6ce2877974afc46c431eb225bd1408683225a6533c
May 26 06:35:34.682731 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:34.682693    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-njfdd" event={"ID":"a1da5f83-e6b1-43b7-8508-4deec5a3cb13","Type":"ContainerStarted","Data":"a7a903c4ec9e81929e02ea6ce2877974afc46c431eb225bd1408683225a6533c"}
May 26 06:35:34.684402 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:34.684373    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr" event={"ID":"c0fd09ec-0628-408a-a1b1-acbe38c1b8af","Type":"ContainerStarted","Data":"884eab22a6da7b1d1c661ee8387801b7fa1b0adb4d54cb038839f58cde25af2c"}
May 26 06:35:35.688210 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:35.688175    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-njfdd" event={"ID":"a1da5f83-e6b1-43b7-8508-4deec5a3cb13","Type":"ContainerStarted","Data":"572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f"}
May 26 06:35:35.705278 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:35.705198    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-njfdd" podStartSLOduration=0.9678393 podStartE2EDuration="2.70518117s" podCreationTimestamp="2026-05-26 06:35:33 +0000 UTC" firstStartedPulling="2026-05-26 06:35:33.797926657 +0000 UTC m=+798.134492994" lastFinishedPulling="2026-05-26 06:35:35.535268521 +0000 UTC m=+799.871834864" observedRunningTime="2026-05-26 06:35:35.704256391 +0000 UTC m=+800.040822747" watchObservedRunningTime="2026-05-26 06:35:35.70518117 +0000 UTC m=+800.041747526"
May 26 06:35:39.702746 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:39.702717    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr" event={"ID":"c0fd09ec-0628-408a-a1b1-acbe38c1b8af","Type":"ContainerStarted","Data":"0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262"}
May 26 06:35:39.715731 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:39.715592    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr" podStartSLOduration=0.879826723 podStartE2EDuration="6.715576012s" podCreationTimestamp="2026-05-26 06:35:33 +0000 UTC" firstStartedPulling="2026-05-26 06:35:33.782562699 +0000 UTC m=+798.119129033" lastFinishedPulling="2026-05-26 06:35:39.618311984 +0000 UTC m=+803.954878322" observedRunningTime="2026-05-26 06:35:39.715296844 +0000 UTC m=+804.051863202" watchObservedRunningTime="2026-05-26 06:35:39.715576012 +0000 UTC m=+804.052142369"
May 26 06:35:44.023741 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.023699    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"]
May 26 06:35:44.030091 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.030066    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.032090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.031866    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
May 26 06:35:44.032090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.031899    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
May 26 06:35:44.032090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.031940    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-mhfs7\""
May 26 06:35:44.032090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.031987    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 26 06:35:44.032090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.031897    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
May 26 06:35:44.035351 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.035314    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"]
May 26 06:35:44.172516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.172485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-online-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.172516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.172522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-registry-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.172788 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.172553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/949fa1ae-352b-479d-838f-08ae645becde-feast-data\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.172788 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.172655    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65zmv\" (UniqueName: \"kubernetes.io/projected/949fa1ae-352b-479d-838f-08ae645becde-kube-api-access-65zmv\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.172788 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.172732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-offline-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.273313 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.273279    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-offline-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.273499 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.273320    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-online-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.273499 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.273341    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-registry-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.273499 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.273437    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/949fa1ae-352b-479d-838f-08ae645becde-feast-data\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.273682 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.273500    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-65zmv\" (UniqueName: \"kubernetes.io/projected/949fa1ae-352b-479d-838f-08ae645becde-kube-api-access-65zmv\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.273945 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.273871    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/949fa1ae-352b-479d-838f-08ae645becde-feast-data\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.275943 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.275925    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-registry-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.276027 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.275941    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-offline-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.276027 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.276018    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-online-tls\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.281231 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.281202    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65zmv\" (UniqueName: \"kubernetes.io/projected/949fa1ae-352b-479d-838f-08ae645becde-kube-api-access-65zmv\") pod \"feast-credit-scoring-6867c9dff4-vtzhp\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") " pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.342106 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.342068    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:44.469976 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.469941    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"]
May 26 06:35:44.472422 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:35:44.472383    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949fa1ae_352b_479d_838f_08ae645becde.slice/crio-391d17fd86f3eabdbc19af2be0ee889d0a5cda33839f13410a56587878608998 WatchSource:0}: Error finding container 391d17fd86f3eabdbc19af2be0ee889d0a5cda33839f13410a56587878608998: Status 404 returned error can't find the container with id 391d17fd86f3eabdbc19af2be0ee889d0a5cda33839f13410a56587878608998
May 26 06:35:44.717410 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.717367    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerStarted","Data":"4d5477eccc4028c089e7a520b10a2161568b6addc93740e6667c43da95a9b1e2"}
May 26 06:35:44.717589 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:44.717415    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerStarted","Data":"391d17fd86f3eabdbc19af2be0ee889d0a5cda33839f13410a56587878608998"}
May 26 06:35:45.721165 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:45.721078    2557 generic.go:358] "Generic (PLEG): container finished" podID="949fa1ae-352b-479d-838f-08ae645becde" containerID="4d5477eccc4028c089e7a520b10a2161568b6addc93740e6667c43da95a9b1e2" exitCode=0
May 26 06:35:45.721165 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:45.721135    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerDied","Data":"4d5477eccc4028c089e7a520b10a2161568b6addc93740e6667c43da95a9b1e2"}
May 26 06:35:46.726071 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:46.726033    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerStarted","Data":"500c2422bc7e84ad82d0da8ea75568e6432085675f0308035c0a4d057ef241aa"}
May 26 06:35:52.745894 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:52.745854    2557 generic.go:358] "Generic (PLEG): container finished" podID="949fa1ae-352b-479d-838f-08ae645becde" containerID="500c2422bc7e84ad82d0da8ea75568e6432085675f0308035c0a4d057ef241aa" exitCode=0
May 26 06:35:52.746278 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:52.745927    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerDied","Data":"500c2422bc7e84ad82d0da8ea75568e6432085675f0308035c0a4d057ef241aa"}
May 26 06:35:53.752974 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:53.752938    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerStarted","Data":"df4cf04c0470c46f074eb7fa3c27c68d0fd1b679948a62500ff49c7ed73b6bac"}
May 26 06:35:53.753338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:53.752990    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerStarted","Data":"7c46063e7e7560e577d35a3682af21d731bff5b10d0fdce157ce2d70b25000c8"}
May 26 06:35:53.753338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:53.753006    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerStarted","Data":"b03770b9d56264b5dd21a8e03b2a4c14fbc24a330ee2e56187e817f686c0f2ab"}
May 26 06:35:53.773950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:53.773896    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podStartSLOduration=9.773878212 podStartE2EDuration="9.773878212s" podCreationTimestamp="2026-05-26 06:35:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:35:53.77276749 +0000 UTC m=+818.109333849" watchObservedRunningTime="2026-05-26 06:35:53.773878212 +0000 UTC m=+818.110444569"
May 26 06:35:54.343175 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:54.343134    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:54.343175 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:54.343181    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:54.343428 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:54.343193    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:56.342724 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:56.342682    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:56.343297 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:56.343268    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:56.343434 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:56.343422    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:56.344739 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:56.344698    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
May 26 06:35:56.344739 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:56.344716    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 06:35:56.344927 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:56.344822    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
May 26 06:35:59.343422 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:59.343376    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
May 26 06:35:59.344302 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:59.344282    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:59.345089 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:59.345069    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:59.350709 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:59.350691    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:35:59.777443 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:35:59.777416    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:36:02.342918 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:36:02.342876    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
May 26 06:36:05.342985 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:36:05.342953    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:36:05.343755 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:36:05.343732    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:37:04.508457 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.508421    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"]
May 26 06:37:04.509056 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.508764    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry" containerID="cri-o://b03770b9d56264b5dd21a8e03b2a4c14fbc24a330ee2e56187e817f686c0f2ab" gracePeriod=30
May 26 06:37:04.509056 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.508841    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="offline" containerID="cri-o://df4cf04c0470c46f074eb7fa3c27c68d0fd1b679948a62500ff49c7ed73b6bac" gracePeriod=30
May 26 06:37:04.509056 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.508841    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online" containerID="cri-o://7c46063e7e7560e577d35a3682af21d731bff5b10d0fdce157ce2d70b25000c8" gracePeriod=30
May 26 06:37:04.525565 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.525538    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dw4rr"]
May 26 06:37:04.525794 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.525772    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr" podUID="c0fd09ec-0628-408a-a1b1-acbe38c1b8af" containerName="postgres" containerID="cri-o://0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262" gracePeriod=30
May 26 06:37:04.534155 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.533374    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-njfdd"]
May 26 06:37:04.534155 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.533584    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-njfdd" podUID="a1da5f83-e6b1-43b7-8508-4deec5a3cb13" containerName="redis" containerID="cri-o://572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f" gracePeriod=30
May 26 06:37:04.786018 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.785996    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:37:04.789321 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.789303    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:37:04.847960 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.847933    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkc9k\" (UniqueName: \"kubernetes.io/projected/a1da5f83-e6b1-43b7-8508-4deec5a3cb13-kube-api-access-dkc9k\") pod \"a1da5f83-e6b1-43b7-8508-4deec5a3cb13\" (UID: \"a1da5f83-e6b1-43b7-8508-4deec5a3cb13\") "
May 26 06:37:04.848124 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.848026    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnxsn\" (UniqueName: \"kubernetes.io/projected/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-kube-api-access-qnxsn\") pod \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") "
May 26 06:37:04.848124 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.848072    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-postgresdata\") pod \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\" (UID: \"c0fd09ec-0628-408a-a1b1-acbe38c1b8af\") "
May 26 06:37:04.850091 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.850063    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1da5f83-e6b1-43b7-8508-4deec5a3cb13-kube-api-access-dkc9k" (OuterVolumeSpecName: "kube-api-access-dkc9k") pod "a1da5f83-e6b1-43b7-8508-4deec5a3cb13" (UID: "a1da5f83-e6b1-43b7-8508-4deec5a3cb13"). InnerVolumeSpecName "kube-api-access-dkc9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:37:04.850222 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.850161    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-kube-api-access-qnxsn" (OuterVolumeSpecName: "kube-api-access-qnxsn") pod "c0fd09ec-0628-408a-a1b1-acbe38c1b8af" (UID: "c0fd09ec-0628-408a-a1b1-acbe38c1b8af"). InnerVolumeSpecName "kube-api-access-qnxsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:37:04.878731 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.878692    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "c0fd09ec-0628-408a-a1b1-acbe38c1b8af" (UID: "c0fd09ec-0628-408a-a1b1-acbe38c1b8af"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:37:04.949025 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.948967    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnxsn\" (UniqueName: \"kubernetes.io/projected/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-kube-api-access-qnxsn\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:04.949025 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.949005    2557 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/c0fd09ec-0628-408a-a1b1-acbe38c1b8af-postgresdata\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:04.949025 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.949015    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkc9k\" (UniqueName: \"kubernetes.io/projected/a1da5f83-e6b1-43b7-8508-4deec5a3cb13-kube-api-access-dkc9k\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:04.965156 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.965117    2557 generic.go:358] "Generic (PLEG): container finished" podID="a1da5f83-e6b1-43b7-8508-4deec5a3cb13" containerID="572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f" exitCode=0
May 26 06:37:04.965342 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.965172    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-njfdd"
May 26 06:37:04.965342 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.965200    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-njfdd" event={"ID":"a1da5f83-e6b1-43b7-8508-4deec5a3cb13","Type":"ContainerDied","Data":"572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f"}
May 26 06:37:04.965342 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.965237    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-njfdd" event={"ID":"a1da5f83-e6b1-43b7-8508-4deec5a3cb13","Type":"ContainerDied","Data":"a7a903c4ec9e81929e02ea6ce2877974afc46c431eb225bd1408683225a6533c"}
May 26 06:37:04.965342 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.965258    2557 scope.go:117] "RemoveContainer" containerID="572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f"
May 26 06:37:04.966440 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.966421    2557 generic.go:358] "Generic (PLEG): container finished" podID="c0fd09ec-0628-408a-a1b1-acbe38c1b8af" containerID="0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262" exitCode=0
May 26 06:37:04.966516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.966468    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr" event={"ID":"c0fd09ec-0628-408a-a1b1-acbe38c1b8af","Type":"ContainerDied","Data":"0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262"}
May 26 06:37:04.966516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.966473    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr"
May 26 06:37:04.966516 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.966491    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-7c7656cc6d-dw4rr" event={"ID":"c0fd09ec-0628-408a-a1b1-acbe38c1b8af","Type":"ContainerDied","Data":"884eab22a6da7b1d1c661ee8387801b7fa1b0adb4d54cb038839f58cde25af2c"}
May 26 06:37:04.974699 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.974666    2557 scope.go:117] "RemoveContainer" containerID="572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f"
May 26 06:37:04.974970 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:37:04.974940    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f\": container with ID starting with 572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f not found: ID does not exist" containerID="572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f"
May 26 06:37:04.975046 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.974978    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f"} err="failed to get container status \"572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f\": rpc error: code = NotFound desc = could not find container \"572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f\": container with ID starting with 572a26f3bf4e9ebe83c11bd89388f12fc793044a687bb454fc91a4a7cfd3c97f not found: ID does not exist"
May 26 06:37:04.975046 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.974997    2557 scope.go:117] "RemoveContainer" containerID="0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262"
May 26 06:37:04.982082 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.982063    2557 scope.go:117] "RemoveContainer" containerID="0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262"
May 26 06:37:04.982330 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:37:04.982313    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262\": container with ID starting with 0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262 not found: ID does not exist" containerID="0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262"
May 26 06:37:04.982374 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.982337    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262"} err="failed to get container status \"0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262\": rpc error: code = NotFound desc = could not find container \"0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262\": container with ID starting with 0be06df7a5ba5b460797a6a2c9b96426bc0198361afec51400f981db31b75262 not found: ID does not exist"
May 26 06:37:04.986242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.986221    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dw4rr"]
May 26 06:37:04.987800 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.987780    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-7c7656cc6d-dw4rr"]
May 26 06:37:04.995281 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.995259    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-njfdd"]
May 26 06:37:04.998615 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:04.998584    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-njfdd"]
May 26 06:37:05.971321 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:05.971286    2557 generic.go:358] "Generic (PLEG): container finished" podID="949fa1ae-352b-479d-838f-08ae645becde" containerID="7c46063e7e7560e577d35a3682af21d731bff5b10d0fdce157ce2d70b25000c8" exitCode=0
May 26 06:37:05.971702 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:05.971362    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerDied","Data":"7c46063e7e7560e577d35a3682af21d731bff5b10d0fdce157ce2d70b25000c8"}
May 26 06:37:06.268334 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:06.268247    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1da5f83-e6b1-43b7-8508-4deec5a3cb13" path="/var/lib/kubelet/pods/a1da5f83-e6b1-43b7-8508-4deec5a3cb13/volumes"
May 26 06:37:06.268710 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:06.268689    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0fd09ec-0628-408a-a1b1-acbe38c1b8af" path="/var/lib/kubelet/pods/c0fd09ec-0628-408a-a1b1-acbe38c1b8af/volumes"
May 26 06:37:09.774176 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:09.774129    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 06:37:19.774200 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:19.774153    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 06:37:29.773774 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:29.773728    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
May 26 06:37:29.774240 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:29.773863    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:37:35.054160 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.054128    2557 generic.go:358] "Generic (PLEG): container finished" podID="949fa1ae-352b-479d-838f-08ae645becde" containerID="df4cf04c0470c46f074eb7fa3c27c68d0fd1b679948a62500ff49c7ed73b6bac" exitCode=137
May 26 06:37:35.054160 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.054155    2557 generic.go:358] "Generic (PLEG): container finished" podID="949fa1ae-352b-479d-838f-08ae645becde" containerID="b03770b9d56264b5dd21a8e03b2a4c14fbc24a330ee2e56187e817f686c0f2ab" exitCode=137
May 26 06:37:35.054536 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.054209    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerDied","Data":"df4cf04c0470c46f074eb7fa3c27c68d0fd1b679948a62500ff49c7ed73b6bac"}
May 26 06:37:35.054536 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.054253    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerDied","Data":"b03770b9d56264b5dd21a8e03b2a4c14fbc24a330ee2e56187e817f686c0f2ab"}
May 26 06:37:35.155700 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.155676    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:37:35.285887 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.285811    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-offline-tls\") pod \"949fa1ae-352b-479d-838f-08ae645becde\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") "
May 26 06:37:35.285887 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.285854    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-online-tls\") pod \"949fa1ae-352b-479d-838f-08ae645becde\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") "
May 26 06:37:35.285887 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.285871    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/949fa1ae-352b-479d-838f-08ae645becde-feast-data\") pod \"949fa1ae-352b-479d-838f-08ae645becde\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") "
May 26 06:37:35.285887 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.285885    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-registry-tls\") pod \"949fa1ae-352b-479d-838f-08ae645becde\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") "
May 26 06:37:35.286187 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.285915    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65zmv\" (UniqueName: \"kubernetes.io/projected/949fa1ae-352b-479d-838f-08ae645becde-kube-api-access-65zmv\") pod \"949fa1ae-352b-479d-838f-08ae645becde\" (UID: \"949fa1ae-352b-479d-838f-08ae645becde\") "
May 26 06:37:35.288010 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.287983    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949fa1ae-352b-479d-838f-08ae645becde-kube-api-access-65zmv" (OuterVolumeSpecName: "kube-api-access-65zmv") pod "949fa1ae-352b-479d-838f-08ae645becde" (UID: "949fa1ae-352b-479d-838f-08ae645becde"). InnerVolumeSpecName "kube-api-access-65zmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:37:35.288116 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.288031    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "949fa1ae-352b-479d-838f-08ae645becde" (UID: "949fa1ae-352b-479d-838f-08ae645becde"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:37:35.288116 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.288055    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "949fa1ae-352b-479d-838f-08ae645becde" (UID: "949fa1ae-352b-479d-838f-08ae645becde"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:37:35.288312 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.288296    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-online-tls" (OuterVolumeSpecName: "online-tls") pod "949fa1ae-352b-479d-838f-08ae645becde" (UID: "949fa1ae-352b-479d-838f-08ae645becde"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:37:35.293801 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.293780    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/949fa1ae-352b-479d-838f-08ae645becde-feast-data" (OuterVolumeSpecName: "feast-data") pod "949fa1ae-352b-479d-838f-08ae645becde" (UID: "949fa1ae-352b-479d-838f-08ae645becde"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:37:35.386619 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.386573    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-online-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:35.386619 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.386628    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/949fa1ae-352b-479d-838f-08ae645becde-feast-data\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:35.386758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.386643    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:35.386758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.386655    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65zmv\" (UniqueName: \"kubernetes.io/projected/949fa1ae-352b-479d-838f-08ae645becde-kube-api-access-65zmv\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:35.386758 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:35.386667    2557 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/949fa1ae-352b-479d-838f-08ae645becde-offline-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:37:36.058737 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.058704    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp" event={"ID":"949fa1ae-352b-479d-838f-08ae645becde","Type":"ContainerDied","Data":"391d17fd86f3eabdbc19af2be0ee889d0a5cda33839f13410a56587878608998"}
May 26 06:37:36.059168 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.058749    2557 scope.go:117] "RemoveContainer" containerID="df4cf04c0470c46f074eb7fa3c27c68d0fd1b679948a62500ff49c7ed73b6bac"
May 26 06:37:36.059168 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.058767    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"
May 26 06:37:36.067160 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.067144    2557 scope.go:117] "RemoveContainer" containerID="7c46063e7e7560e577d35a3682af21d731bff5b10d0fdce157ce2d70b25000c8"
May 26 06:37:36.074145 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.074123    2557 scope.go:117] "RemoveContainer" containerID="b03770b9d56264b5dd21a8e03b2a4c14fbc24a330ee2e56187e817f686c0f2ab"
May 26 06:37:36.078876 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.078776    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"]
May 26 06:37:36.081493 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.081478    2557 scope.go:117] "RemoveContainer" containerID="500c2422bc7e84ad82d0da8ea75568e6432085675f0308035c0a4d057ef241aa"
May 26 06:37:36.085567 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.085547    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6867c9dff4-vtzhp"]
May 26 06:37:36.089022 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.089008    2557 scope.go:117] "RemoveContainer" containerID="4d5477eccc4028c089e7a520b10a2161568b6addc93740e6667c43da95a9b1e2"
May 26 06:37:36.266119 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:37:36.266091    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949fa1ae-352b-479d-838f-08ae645becde" path="/var/lib/kubelet/pods/949fa1ae-352b-479d-838f-08ae645becde/volumes"
May 26 06:39:14.982810 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.982777    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-mf5sf"]
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983085    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1da5f83-e6b1-43b7-8508-4deec5a3cb13" containerName="redis"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983098    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1da5f83-e6b1-43b7-8508-4deec5a3cb13" containerName="redis"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983119    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="offline"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983124    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="offline"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983131    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="feast-init"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983136    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="feast-init"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983144    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="feast-apply"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983150    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="feast-apply"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983156    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983161    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983171    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0fd09ec-0628-408a-a1b1-acbe38c1b8af" containerName="postgres"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983176    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0fd09ec-0628-408a-a1b1-acbe38c1b8af" containerName="postgres"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983182    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983187    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983231    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1da5f83-e6b1-43b7-8508-4deec5a3cb13" containerName="redis"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983240    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="online"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983247    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="registry"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983253    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="949fa1ae-352b-479d-838f-08ae645becde" containerName="offline"
May 26 06:39:14.983259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.983260    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c0fd09ec-0628-408a-a1b1-acbe38c1b8af" containerName="postgres"
May 26 06:39:14.986139 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.986109    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:39:14.988046 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.988018    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
May 26 06:39:14.988147 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.988062    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
May 26 06:39:14.988454 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.988437    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-65dn9\""
May 26 06:39:14.995809 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:14.995786    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-mf5sf"]
May 26 06:39:15.008837 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:15.008814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxs2w\" (UniqueName: \"kubernetes.io/projected/94fd6bef-8c11-45db-9f2c-c6bd05f3b575-kube-api-access-sxs2w\") pod \"redis-854544c579-mf5sf\" (UID: \"94fd6bef-8c11-45db-9f2c-c6bd05f3b575\") " pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:39:15.109354 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:15.109322    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxs2w\" (UniqueName: \"kubernetes.io/projected/94fd6bef-8c11-45db-9f2c-c6bd05f3b575-kube-api-access-sxs2w\") pod \"redis-854544c579-mf5sf\" (UID: \"94fd6bef-8c11-45db-9f2c-c6bd05f3b575\") " pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:39:15.116662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:15.116645    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxs2w\" (UniqueName: \"kubernetes.io/projected/94fd6bef-8c11-45db-9f2c-c6bd05f3b575-kube-api-access-sxs2w\") pod \"redis-854544c579-mf5sf\" (UID: \"94fd6bef-8c11-45db-9f2c-c6bd05f3b575\") " pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:39:15.306517 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:15.306435    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:39:15.428484 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:15.428452    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-mf5sf"]
May 26 06:39:15.431658 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:39:15.431595    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94fd6bef_8c11_45db_9f2c_c6bd05f3b575.slice/crio-fb93498a171bed3cc6faceea27cc464ee3019c6a7fd1fdbb1d2a16e59d6d5f7f WatchSource:0}: Error finding container fb93498a171bed3cc6faceea27cc464ee3019c6a7fd1fdbb1d2a16e59d6d5f7f: Status 404 returned error can't find the container with id fb93498a171bed3cc6faceea27cc464ee3019c6a7fd1fdbb1d2a16e59d6d5f7f
May 26 06:39:16.333880 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:16.333850    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-mf5sf" event={"ID":"94fd6bef-8c11-45db-9f2c-c6bd05f3b575","Type":"ContainerStarted","Data":"460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522"}
May 26 06:39:16.333880 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:16.333883    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-mf5sf" event={"ID":"94fd6bef-8c11-45db-9f2c-c6bd05f3b575","Type":"ContainerStarted","Data":"fb93498a171bed3cc6faceea27cc464ee3019c6a7fd1fdbb1d2a16e59d6d5f7f"}
May 26 06:39:16.347311 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:16.347263    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-mf5sf" podStartSLOduration=2.347249305 podStartE2EDuration="2.347249305s" podCreationTimestamp="2026-05-26 06:39:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:39:16.345813983 +0000 UTC m=+1020.682380355" watchObservedRunningTime="2026-05-26 06:39:16.347249305 +0000 UTC m=+1020.683815661"
May 26 06:39:20.411093 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.411058    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-544t6"]
May 26 06:39:20.414124 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.414107    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.416150 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.416121    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
May 26 06:39:20.419524 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.419500    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-544t6"]
May 26 06:39:20.443307 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.443284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f47709ab-b7ec-4a3b-b986-560529a8eddd-postgresdata\") pod \"postgres-7c7656cc6d-544t6\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.443416 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.443320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-465s8\" (UniqueName: \"kubernetes.io/projected/f47709ab-b7ec-4a3b-b986-560529a8eddd-kube-api-access-465s8\") pod \"postgres-7c7656cc6d-544t6\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.544645 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.544585    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-465s8\" (UniqueName: \"kubernetes.io/projected/f47709ab-b7ec-4a3b-b986-560529a8eddd-kube-api-access-465s8\") pod \"postgres-7c7656cc6d-544t6\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.544792 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.544745    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f47709ab-b7ec-4a3b-b986-560529a8eddd-postgresdata\") pod \"postgres-7c7656cc6d-544t6\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.545152 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.545123    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f47709ab-b7ec-4a3b-b986-560529a8eddd-postgresdata\") pod \"postgres-7c7656cc6d-544t6\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.552465 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.552445    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-465s8\" (UniqueName: \"kubernetes.io/projected/f47709ab-b7ec-4a3b-b986-560529a8eddd-kube-api-access-465s8\") pod \"postgres-7c7656cc6d-544t6\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") " pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.726130 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.726056    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:39:20.848619 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:20.848559    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-544t6"]
May 26 06:39:20.851247 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:39:20.851219    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf47709ab_b7ec_4a3b_b986_560529a8eddd.slice/crio-c53b00c5648f9d6fa1ab597d28604241dbe682c2dfbcc58f9ac54003fae351f6 WatchSource:0}: Error finding container c53b00c5648f9d6fa1ab597d28604241dbe682c2dfbcc58f9ac54003fae351f6: Status 404 returned error can't find the container with id c53b00c5648f9d6fa1ab597d28604241dbe682c2dfbcc58f9ac54003fae351f6
May 26 06:39:21.348547 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:21.348508    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6" event={"ID":"f47709ab-b7ec-4a3b-b986-560529a8eddd","Type":"ContainerStarted","Data":"9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0"}
May 26 06:39:21.348547 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:21.348553    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6" event={"ID":"f47709ab-b7ec-4a3b-b986-560529a8eddd","Type":"ContainerStarted","Data":"c53b00c5648f9d6fa1ab597d28604241dbe682c2dfbcc58f9ac54003fae351f6"}
May 26 06:39:21.363889 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:21.363845    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6" podStartSLOduration=1.363830268 podStartE2EDuration="1.363830268s" podCreationTimestamp="2026-05-26 06:39:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:39:21.362388694 +0000 UTC m=+1025.698955051" watchObservedRunningTime="2026-05-26 06:39:21.363830268 +0000 UTC m=+1025.700396752"
May 26 06:39:26.065698 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.065667    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"]
May 26 06:39:26.069162 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.069144    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.071111 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.071045    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
May 26 06:39:26.071111 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.071065    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
May 26 06:39:26.071111 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.071089    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
May 26 06:39:26.071325 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.071183    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-tpjdk\""
May 26 06:39:26.079887 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.079863    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"]
May 26 06:39:26.087667 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.087643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cf043994-3256-4739-a79a-71c72e320589-feast-data\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.087764 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.087687    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-online-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.087815 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.087761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzmm8\" (UniqueName: \"kubernetes.io/projected/cf043994-3256-4739-a79a-71c72e320589-kube-api-access-pzmm8\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.087850 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.087817    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.189075 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.189038    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cf043994-3256-4739-a79a-71c72e320589-feast-data\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.189075 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.189081    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-online-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.189311 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.189222    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzmm8\" (UniqueName: \"kubernetes.io/projected/cf043994-3256-4739-a79a-71c72e320589-kube-api-access-pzmm8\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.189311 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.189272    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.189415 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:39:26.189397    2557 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
May 26 06:39:26.189466 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.189426    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cf043994-3256-4739-a79a-71c72e320589-feast-data\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.189524 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:39:26.189480    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls podName:cf043994-3256-4739-a79a-71c72e320589 nodeName:}" failed. No retries permitted until 2026-05-26 06:39:26.689457384 +0000 UTC m=+1031.026023729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls") pod "feast-credit-scoring-879557cf9-vnjhw" (UID: "cf043994-3256-4739-a79a-71c72e320589") : secret "feast-credit-scoring-registry-tls" not found
May 26 06:39:26.191597 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.191569    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-online-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.197255 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.197231    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzmm8\" (UniqueName: \"kubernetes.io/projected/cf043994-3256-4739-a79a-71c72e320589-kube-api-access-pzmm8\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.692587 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.692548    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.695190 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.695165    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls\") pod \"feast-credit-scoring-879557cf9-vnjhw\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") " pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:26.978246 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:26.978169    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:27.110776 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:27.108034    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"]
May 26 06:39:27.113743 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:39:27.113717    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf043994_3256_4739_a79a_71c72e320589.slice/crio-006a96e5d913b6fc793bbc0abdd35d509ea2e67a0f6873cba21a86454ef714f0 WatchSource:0}: Error finding container 006a96e5d913b6fc793bbc0abdd35d509ea2e67a0f6873cba21a86454ef714f0: Status 404 returned error can't find the container with id 006a96e5d913b6fc793bbc0abdd35d509ea2e67a0f6873cba21a86454ef714f0
May 26 06:39:27.367559 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:27.367472    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerStarted","Data":"a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6"}
May 26 06:39:27.367559 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:27.367512    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerStarted","Data":"006a96e5d913b6fc793bbc0abdd35d509ea2e67a0f6873cba21a86454ef714f0"}
May 26 06:39:28.371270 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:28.371189    2557 generic.go:358] "Generic (PLEG): container finished" podID="cf043994-3256-4739-a79a-71c72e320589" containerID="a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6" exitCode=0
May 26 06:39:28.371646 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:28.371275    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerDied","Data":"a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6"}
May 26 06:39:29.375985 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:29.375951    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerStarted","Data":"43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181"}
May 26 06:39:35.392540 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:35.392502    2557 generic.go:358] "Generic (PLEG): container finished" podID="cf043994-3256-4739-a79a-71c72e320589" containerID="43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181" exitCode=0
May 26 06:39:35.392908 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:35.392573    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerDied","Data":"43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181"}
May 26 06:39:36.397139 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:36.397101    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerStarted","Data":"ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2"}
May 26 06:39:36.397597 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:36.397147    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerStarted","Data":"69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d"}
May 26 06:39:36.417131 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:36.417080    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podStartSLOduration=10.417065866 podStartE2EDuration="10.417065866s" podCreationTimestamp="2026-05-26 06:39:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:39:36.414857907 +0000 UTC m=+1040.751424265" watchObservedRunningTime="2026-05-26 06:39:36.417065866 +0000 UTC m=+1040.753632221"
May 26 06:39:36.978382 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:36.978352    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:36.978576 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:36.978397    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:38.978854 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:38.978811    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:38.978854 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:38.978863    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:38.980430 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:38.980392    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
May 26 06:39:38.980544 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:38.980439    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 06:39:41.979100 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:41.979059    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
May 26 06:39:41.984507 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:41.984482    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:41.987950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:41.987923    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:44.979303 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:44.979251    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
May 26 06:39:47.979342 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:47.979310    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:47.980080 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:47.980062    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:39:51.894336 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.894297    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"]
May 26 06:39:51.899280 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.899259    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:51.901181 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.901153    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
May 26 06:39:51.901181 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.901169    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
May 26 06:39:51.901330 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.901215    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
May 26 06:39:51.901330 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.901297    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-2bmlb\""
May 26 06:39:51.907594 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.907571    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"]
May 26 06:39:51.997172 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.997145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d521fa9f-8ad1-419a-b5dd-ec9444da638f-feast-data\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:51.997297 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.997182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-online-tls\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:51.997297 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.997212    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj7cd\" (UniqueName: \"kubernetes.io/projected/d521fa9f-8ad1-419a-b5dd-ec9444da638f-kube-api-access-zj7cd\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:51.997375 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:51.997304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-registry-tls\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.097815 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.097788    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj7cd\" (UniqueName: \"kubernetes.io/projected/d521fa9f-8ad1-419a-b5dd-ec9444da638f-kube-api-access-zj7cd\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.097950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.097825    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-registry-tls\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.097950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.097862    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d521fa9f-8ad1-419a-b5dd-ec9444da638f-feast-data\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.097950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.097885    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-online-tls\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.098341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.098311    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d521fa9f-8ad1-419a-b5dd-ec9444da638f-feast-data\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.100277 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.100248    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-online-tls\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.100365 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.100279    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-registry-tls\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.104923 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.104901    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj7cd\" (UniqueName: \"kubernetes.io/projected/d521fa9f-8ad1-419a-b5dd-ec9444da638f-kube-api-access-zj7cd\") pod \"feast-driver-ranking-74b66c555b-2h7dl\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") " pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.209912 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.209886    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:39:52.342508 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.342478    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"]
May 26 06:39:52.345691 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:39:52.345666    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd521fa9f_8ad1_419a_b5dd_ec9444da638f.slice/crio-2f0d1d06ebaa51f81b9020b9c281d1009593fe30930965547cd84a95d2da0d3d WatchSource:0}: Error finding container 2f0d1d06ebaa51f81b9020b9c281d1009593fe30930965547cd84a95d2da0d3d: Status 404 returned error can't find the container with id 2f0d1d06ebaa51f81b9020b9c281d1009593fe30930965547cd84a95d2da0d3d
May 26 06:39:52.445565 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.445528    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerStarted","Data":"f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a"}
May 26 06:39:52.445715 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:52.445572    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerStarted","Data":"2f0d1d06ebaa51f81b9020b9c281d1009593fe30930965547cd84a95d2da0d3d"}
May 26 06:39:57.459387 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:57.459347    2557 generic.go:358] "Generic (PLEG): container finished" podID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerID="f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a" exitCode=0
May 26 06:39:57.459779 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:57.459423    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerDied","Data":"f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a"}
May 26 06:39:58.463747 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:39:58.463713    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerStarted","Data":"3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f"}
May 26 06:40:04.485595 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:04.485556    2557 generic.go:358] "Generic (PLEG): container finished" podID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerID="3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f" exitCode=0
May 26 06:40:04.485944 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:04.485628    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerDied","Data":"3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f"}
May 26 06:40:05.491291 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:05.491243    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerStarted","Data":"942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b"}
May 26 06:40:05.491291 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:05.491282    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerStarted","Data":"19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00"}
May 26 06:40:05.515621 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:05.515557    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podStartSLOduration=14.515539106 podStartE2EDuration="14.515539106s" podCreationTimestamp="2026-05-26 06:39:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:40:05.513177368 +0000 UTC m=+1069.849743723" watchObservedRunningTime="2026-05-26 06:40:05.515539106 +0000 UTC m=+1069.852105464"
May 26 06:40:07.210398 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:07.210346    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:07.211017 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:07.210416    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:07.211950 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:07.211920    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 26 06:40:07.212052 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:07.211951    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 06:40:10.211074 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:10.211021    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 26 06:40:10.553079 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:10.552992    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:10.553455 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:10.553427    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:10.556299 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:10.556278    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:12.210316 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:12.210281    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:13.210893 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:13.210846    2557 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
May 26 06:40:16.210918 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:16.210887    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:40:16.211564 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:40:16.211546    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:41:29.701925 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.701893    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"]
May 26 06:41:29.702338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.702109    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj" podUID="a1e47333-c33b-4e94-81de-2a7c513e8f9d" containerName="manager" containerID="cri-o://2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a" gracePeriod=10
May 26 06:41:29.932667 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.932634    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"]
May 26 06:41:29.933223 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.932933    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry" containerID="cri-o://69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d" gracePeriod=30
May 26 06:41:29.933223 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.933053    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online" containerID="cri-o://ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2" gracePeriod=30
May 26 06:41:29.938959 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.938932    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"]
May 26 06:41:29.940068 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.940019    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry" containerID="cri-o://19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00" gracePeriod=30
May 26 06:41:29.945954 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.940500    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online" containerID="cri-o://942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b" gracePeriod=30
May 26 06:41:29.982043 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:29.982022    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:41:30.084238 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.084193    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szldz\" (UniqueName: \"kubernetes.io/projected/a1e47333-c33b-4e94-81de-2a7c513e8f9d-kube-api-access-szldz\") pod \"a1e47333-c33b-4e94-81de-2a7c513e8f9d\" (UID: \"a1e47333-c33b-4e94-81de-2a7c513e8f9d\") "
May 26 06:41:30.086394 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.086351    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1e47333-c33b-4e94-81de-2a7c513e8f9d-kube-api-access-szldz" (OuterVolumeSpecName: "kube-api-access-szldz") pod "a1e47333-c33b-4e94-81de-2a7c513e8f9d" (UID: "a1e47333-c33b-4e94-81de-2a7c513e8f9d"). InnerVolumeSpecName "kube-api-access-szldz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:41:30.185057 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.185015    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szldz\" (UniqueName: \"kubernetes.io/projected/a1e47333-c33b-4e94-81de-2a7c513e8f9d-kube-api-access-szldz\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:41:30.553902 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.553795    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 06:41:30.746409 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.746379    2557 generic.go:358] "Generic (PLEG): container finished" podID="a1e47333-c33b-4e94-81de-2a7c513e8f9d" containerID="2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a" exitCode=0
May 26 06:41:30.746743 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.746438    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"
May 26 06:41:30.746743 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.746457    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj" event={"ID":"a1e47333-c33b-4e94-81de-2a7c513e8f9d","Type":"ContainerDied","Data":"2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a"}
May 26 06:41:30.746743 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.746496    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj" event={"ID":"a1e47333-c33b-4e94-81de-2a7c513e8f9d","Type":"ContainerDied","Data":"ba38fb4a89eb55afee7b34f1f67911b889815888ab9ef8e3e947a765df3f1cac"}
May 26 06:41:30.746743 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.746515    2557 scope.go:117] "RemoveContainer" containerID="2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a"
May 26 06:41:30.749052 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.749034    2557 generic.go:358] "Generic (PLEG): container finished" podID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerID="942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b" exitCode=0
May 26 06:41:30.749143 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.749056    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerDied","Data":"942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b"}
May 26 06:41:30.751333 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.751315    2557 generic.go:358] "Generic (PLEG): container finished" podID="cf043994-3256-4739-a79a-71c72e320589" containerID="ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2" exitCode=0
May 26 06:41:30.751426 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.751384    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerDied","Data":"ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2"}
May 26 06:41:30.754270 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.754249    2557 scope.go:117] "RemoveContainer" containerID="2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a"
May 26 06:41:30.754495 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:41:30.754477    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a\": container with ID starting with 2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a not found: ID does not exist" containerID="2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a"
May 26 06:41:30.754539 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.754502    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a"} err="failed to get container status \"2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a\": rpc error: code = NotFound desc = could not find container \"2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a\": container with ID starting with 2e71e2b55ef148d5f4a18da901f8c1a07363e24314873955f4a641b74912603a not found: ID does not exist"
May 26 06:41:30.760005 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.759983    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"]
May 26 06:41:30.763710 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:30.763691    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6d7cc779d9-n6drj"]
May 26 06:41:31.986220 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:31.986165    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 06:41:32.266221 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.266145    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1e47333-c33b-4e94-81de-2a7c513e8f9d" path="/var/lib/kubelet/pods/a1e47333-c33b-4e94-81de-2a7c513e8f9d/volumes"
May 26 06:41:32.395767 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.395739    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-544t6"]
May 26 06:41:32.395963 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.395924    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6" podUID="f47709ab-b7ec-4a3b-b986-560529a8eddd" containerName="postgres" containerID="cri-o://9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0" gracePeriod=30
May 26 06:41:32.400033 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.400000    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-mf5sf"]
May 26 06:41:32.400221 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.400185    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-mf5sf" podUID="94fd6bef-8c11-45db-9f2c-c6bd05f3b575" containerName="redis" containerID="cri-o://460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522" gracePeriod=30
May 26 06:41:32.639713 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.639691    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:41:32.661650 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.661593    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:41:32.759703 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.759671    2557 generic.go:358] "Generic (PLEG): container finished" podID="f47709ab-b7ec-4a3b-b986-560529a8eddd" containerID="9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0" exitCode=0
May 26 06:41:32.759867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.759711    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6"
May 26 06:41:32.759867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.759757    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6" event={"ID":"f47709ab-b7ec-4a3b-b986-560529a8eddd","Type":"ContainerDied","Data":"9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0"}
May 26 06:41:32.759867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.759791    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-7c7656cc6d-544t6" event={"ID":"f47709ab-b7ec-4a3b-b986-560529a8eddd","Type":"ContainerDied","Data":"c53b00c5648f9d6fa1ab597d28604241dbe682c2dfbcc58f9ac54003fae351f6"}
May 26 06:41:32.759867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.759808    2557 scope.go:117] "RemoveContainer" containerID="9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0"
May 26 06:41:32.760788 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.760770    2557 generic.go:358] "Generic (PLEG): container finished" podID="94fd6bef-8c11-45db-9f2c-c6bd05f3b575" containerID="460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522" exitCode=0
May 26 06:41:32.760861 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.760810    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-mf5sf"
May 26 06:41:32.760861 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.760840    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-mf5sf" event={"ID":"94fd6bef-8c11-45db-9f2c-c6bd05f3b575","Type":"ContainerDied","Data":"460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522"}
May 26 06:41:32.760861 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.760858    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-mf5sf" event={"ID":"94fd6bef-8c11-45db-9f2c-c6bd05f3b575","Type":"ContainerDied","Data":"fb93498a171bed3cc6faceea27cc464ee3019c6a7fd1fdbb1d2a16e59d6d5f7f"}
May 26 06:41:32.767237 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.767221    2557 scope.go:117] "RemoveContainer" containerID="9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0"
May 26 06:41:32.767480 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:41:32.767456    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0\": container with ID starting with 9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0 not found: ID does not exist" containerID="9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0"
May 26 06:41:32.767569 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.767487    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0"} err="failed to get container status \"9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0\": rpc error: code = NotFound desc = could not find container \"9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0\": container with ID starting with 9c687e8b0e8b608c88826d214878cfd1c7cb715d92195f5ec1832a8034b4b8a0 not found: ID does not exist"
May 26 06:41:32.767569 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.767504    2557 scope.go:117] "RemoveContainer" containerID="460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522"
May 26 06:41:32.774162 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.774147    2557 scope.go:117] "RemoveContainer" containerID="460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522"
May 26 06:41:32.774412 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:41:32.774395    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522\": container with ID starting with 460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522 not found: ID does not exist" containerID="460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522"
May 26 06:41:32.774462 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.774419    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522"} err="failed to get container status \"460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522\": rpc error: code = NotFound desc = could not find container \"460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522\": container with ID starting with 460561ba5d559763c48538b76534e1bbfd09f94e6d902b24dc876c3e56564522 not found: ID does not exist"
May 26 06:41:32.804225 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.804204    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxs2w\" (UniqueName: \"kubernetes.io/projected/94fd6bef-8c11-45db-9f2c-c6bd05f3b575-kube-api-access-sxs2w\") pod \"94fd6bef-8c11-45db-9f2c-c6bd05f3b575\" (UID: \"94fd6bef-8c11-45db-9f2c-c6bd05f3b575\") "
May 26 06:41:32.804306 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.804238    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f47709ab-b7ec-4a3b-b986-560529a8eddd-postgresdata\") pod \"f47709ab-b7ec-4a3b-b986-560529a8eddd\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") "
May 26 06:41:32.804306 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.804277    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-465s8\" (UniqueName: \"kubernetes.io/projected/f47709ab-b7ec-4a3b-b986-560529a8eddd-kube-api-access-465s8\") pod \"f47709ab-b7ec-4a3b-b986-560529a8eddd\" (UID: \"f47709ab-b7ec-4a3b-b986-560529a8eddd\") "
May 26 06:41:32.806224 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.806196    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94fd6bef-8c11-45db-9f2c-c6bd05f3b575-kube-api-access-sxs2w" (OuterVolumeSpecName: "kube-api-access-sxs2w") pod "94fd6bef-8c11-45db-9f2c-c6bd05f3b575" (UID: "94fd6bef-8c11-45db-9f2c-c6bd05f3b575"). InnerVolumeSpecName "kube-api-access-sxs2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:41:32.806224 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.806207    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f47709ab-b7ec-4a3b-b986-560529a8eddd-kube-api-access-465s8" (OuterVolumeSpecName: "kube-api-access-465s8") pod "f47709ab-b7ec-4a3b-b986-560529a8eddd" (UID: "f47709ab-b7ec-4a3b-b986-560529a8eddd"). InnerVolumeSpecName "kube-api-access-465s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:41:32.834115 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.834093    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f47709ab-b7ec-4a3b-b986-560529a8eddd-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "f47709ab-b7ec-4a3b-b986-560529a8eddd" (UID: "f47709ab-b7ec-4a3b-b986-560529a8eddd"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:41:32.904976 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.904956    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxs2w\" (UniqueName: \"kubernetes.io/projected/94fd6bef-8c11-45db-9f2c-c6bd05f3b575-kube-api-access-sxs2w\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:41:32.904976 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.904977    2557 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f47709ab-b7ec-4a3b-b986-560529a8eddd-postgresdata\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:41:32.905090 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:32.904988    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-465s8\" (UniqueName: \"kubernetes.io/projected/f47709ab-b7ec-4a3b-b986-560529a8eddd-kube-api-access-465s8\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:41:33.080283 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:33.080253    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-544t6"]
May 26 06:41:33.083730 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:33.083710    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-7c7656cc6d-544t6"]
May 26 06:41:33.092269 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:33.092247    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-mf5sf"]
May 26 06:41:33.093971 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:33.093950    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-mf5sf"]
May 26 06:41:34.266442 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:34.266405    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94fd6bef-8c11-45db-9f2c-c6bd05f3b575" path="/var/lib/kubelet/pods/94fd6bef-8c11-45db-9f2c-c6bd05f3b575/volumes"
May 26 06:41:34.266817 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:34.266753    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f47709ab-b7ec-4a3b-b986-560529a8eddd" path="/var/lib/kubelet/pods/f47709ab-b7ec-4a3b-b986-560529a8eddd/volumes"
May 26 06:41:40.553800 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:40.553710    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 06:41:41.985871 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:41.985828    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 06:41:50.553725 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:50.553685    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
May 26 06:41:50.554079 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:50.553806    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:41:51.985144 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:51.985106    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 06:41:51.985526 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:41:51.985213    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:42:00.583755 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.583723    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:42:00.604494 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.604470    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:42:00.607793 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.607775    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls\") pod \"cf043994-3256-4739-a79a-71c72e320589\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") "
May 26 06:42:00.607858 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.607843    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzmm8\" (UniqueName: \"kubernetes.io/projected/cf043994-3256-4739-a79a-71c72e320589-kube-api-access-pzmm8\") pod \"cf043994-3256-4739-a79a-71c72e320589\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") "
May 26 06:42:00.608049 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.607905    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-online-tls\") pod \"cf043994-3256-4739-a79a-71c72e320589\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") "
May 26 06:42:00.608049 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.607955    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cf043994-3256-4739-a79a-71c72e320589-feast-data\") pod \"cf043994-3256-4739-a79a-71c72e320589\" (UID: \"cf043994-3256-4739-a79a-71c72e320589\") "
May 26 06:42:00.609772 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.609741    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cf043994-3256-4739-a79a-71c72e320589" (UID: "cf043994-3256-4739-a79a-71c72e320589"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:42:00.609860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.609771    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-online-tls" (OuterVolumeSpecName: "online-tls") pod "cf043994-3256-4739-a79a-71c72e320589" (UID: "cf043994-3256-4739-a79a-71c72e320589"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:42:00.609860 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.609820    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf043994-3256-4739-a79a-71c72e320589-kube-api-access-pzmm8" (OuterVolumeSpecName: "kube-api-access-pzmm8") pod "cf043994-3256-4739-a79a-71c72e320589" (UID: "cf043994-3256-4739-a79a-71c72e320589"). InnerVolumeSpecName "kube-api-access-pzmm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:42:00.617481 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.617449    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf043994-3256-4739-a79a-71c72e320589-feast-data" (OuterVolumeSpecName: "feast-data") pod "cf043994-3256-4739-a79a-71c72e320589" (UID: "cf043994-3256-4739-a79a-71c72e320589"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:42:00.708419 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708353    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-registry-tls\") pod \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") "
May 26 06:42:00.708419 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708397    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d521fa9f-8ad1-419a-b5dd-ec9444da638f-feast-data\") pod \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") "
May 26 06:42:00.708570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708441    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj7cd\" (UniqueName: \"kubernetes.io/projected/d521fa9f-8ad1-419a-b5dd-ec9444da638f-kube-api-access-zj7cd\") pod \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") "
May 26 06:42:00.708570 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708469    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-online-tls\") pod \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\" (UID: \"d521fa9f-8ad1-419a-b5dd-ec9444da638f\") "
May 26 06:42:00.708688 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708649    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.708688 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708667    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzmm8\" (UniqueName: \"kubernetes.io/projected/cf043994-3256-4739-a79a-71c72e320589-kube-api-access-pzmm8\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.708688 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708681    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cf043994-3256-4739-a79a-71c72e320589-online-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.708781 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708693    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cf043994-3256-4739-a79a-71c72e320589-feast-data\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.708913 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.708890    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d521fa9f-8ad1-419a-b5dd-ec9444da638f-feast-data" (OuterVolumeSpecName: "feast-data") pod "d521fa9f-8ad1-419a-b5dd-ec9444da638f" (UID: "d521fa9f-8ad1-419a-b5dd-ec9444da638f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:42:00.710356 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.710333    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d521fa9f-8ad1-419a-b5dd-ec9444da638f" (UID: "d521fa9f-8ad1-419a-b5dd-ec9444da638f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:42:00.710461 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.710439    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-online-tls" (OuterVolumeSpecName: "online-tls") pod "d521fa9f-8ad1-419a-b5dd-ec9444da638f" (UID: "d521fa9f-8ad1-419a-b5dd-ec9444da638f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 06:42:00.710461 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.710450    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d521fa9f-8ad1-419a-b5dd-ec9444da638f-kube-api-access-zj7cd" (OuterVolumeSpecName: "kube-api-access-zj7cd") pod "d521fa9f-8ad1-419a-b5dd-ec9444da638f" (UID: "d521fa9f-8ad1-419a-b5dd-ec9444da638f"). InnerVolumeSpecName "kube-api-access-zj7cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:42:00.809504 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.809473    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-registry-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.809504 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.809498    2557 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d521fa9f-8ad1-419a-b5dd-ec9444da638f-feast-data\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.809504 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.809511    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj7cd\" (UniqueName: \"kubernetes.io/projected/d521fa9f-8ad1-419a-b5dd-ec9444da638f-kube-api-access-zj7cd\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.809742 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.809524    2557 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d521fa9f-8ad1-419a-b5dd-ec9444da638f-online-tls\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:42:00.847218 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.847183    2557 generic.go:358] "Generic (PLEG): container finished" podID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerID="19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00" exitCode=137
May 26 06:42:00.847330 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.847258    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"
May 26 06:42:00.847330 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.847266    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerDied","Data":"19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00"}
May 26 06:42:00.847330 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.847303    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" event={"ID":"d521fa9f-8ad1-419a-b5dd-ec9444da638f","Type":"ContainerDied","Data":"2f0d1d06ebaa51f81b9020b9c281d1009593fe30930965547cd84a95d2da0d3d"}
May 26 06:42:00.847330 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.847325    2557 scope.go:117] "RemoveContainer" containerID="942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b"
May 26 06:42:00.849469 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.849447    2557 generic.go:358] "Generic (PLEG): container finished" podID="cf043994-3256-4739-a79a-71c72e320589" containerID="69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d" exitCode=137
May 26 06:42:00.849598 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.849483    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerDied","Data":"69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d"}
May 26 06:42:00.849598 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.849503    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw" event={"ID":"cf043994-3256-4739-a79a-71c72e320589","Type":"ContainerDied","Data":"006a96e5d913b6fc793bbc0abdd35d509ea2e67a0f6873cba21a86454ef714f0"}
May 26 06:42:00.849598 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.849517    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"
May 26 06:42:00.856045 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.856025    2557 scope.go:117] "RemoveContainer" containerID="19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00"
May 26 06:42:00.863944 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.863928    2557 scope.go:117] "RemoveContainer" containerID="3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f"
May 26 06:42:00.869841 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.869819    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"]
May 26 06:42:00.871205 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.871182    2557 scope.go:117] "RemoveContainer" containerID="f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a"
May 26 06:42:00.875620 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.875583    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl"]
May 26 06:42:00.878306 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.878291    2557 scope.go:117] "RemoveContainer" containerID="942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b"
May 26 06:42:00.878533 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.878517    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b\": container with ID starting with 942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b not found: ID does not exist" containerID="942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b"
May 26 06:42:00.878584 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.878539    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b"} err="failed to get container status \"942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b\": rpc error: code = NotFound desc = could not find container \"942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b\": container with ID starting with 942e87095e38d6e30982052400e2c9f2dbec92349611650da746130efa01864b not found: ID does not exist"
May 26 06:42:00.878584 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.878555    2557 scope.go:117] "RemoveContainer" containerID="19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00"
May 26 06:42:00.878789 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.878771    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00\": container with ID starting with 19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00 not found: ID does not exist" containerID="19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00"
May 26 06:42:00.878834 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.878795    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00"} err="failed to get container status \"19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00\": rpc error: code = NotFound desc = could not find container \"19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00\": container with ID starting with 19574db67251624d6a8cf984fe77ccf2f5cc54de53da373ec44fe42d0fa7bf00 not found: ID does not exist"
May 26 06:42:00.878834 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.878812    2557 scope.go:117] "RemoveContainer" containerID="3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f"
May 26 06:42:00.879012 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.878997    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f\": container with ID starting with 3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f not found: ID does not exist" containerID="3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f"
May 26 06:42:00.879052 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.879016    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f"} err="failed to get container status \"3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f\": rpc error: code = NotFound desc = could not find container \"3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f\": container with ID starting with 3e7f7297fe6c7f4eae3fe81f27c77c290873c68d4910f8c2dff6335eb753168f not found: ID does not exist"
May 26 06:42:00.879052 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.879029    2557 scope.go:117] "RemoveContainer" containerID="f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a"
May 26 06:42:00.879235 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.879221    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a\": container with ID starting with f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a not found: ID does not exist" containerID="f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a"
May 26 06:42:00.879272 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.879238    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a"} err="failed to get container status \"f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a\": rpc error: code = NotFound desc = could not find container \"f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a\": container with ID starting with f8e445522f49c2249a50f582c78c2296f90a610e543e213565dfe5aa2a1cb25a not found: ID does not exist"
May 26 06:42:00.879272 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.879250    2557 scope.go:117] "RemoveContainer" containerID="ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2"
May 26 06:42:00.884409 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.884389    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"]
May 26 06:42:00.886353 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.886339    2557 scope.go:117] "RemoveContainer" containerID="69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d"
May 26 06:42:00.889472 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.889453    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-879557cf9-vnjhw"]
May 26 06:42:00.893464 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.893448    2557 scope.go:117] "RemoveContainer" containerID="43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181"
May 26 06:42:00.899624 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.899591    2557 scope.go:117] "RemoveContainer" containerID="a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6"
May 26 06:42:00.906078 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906061    2557 scope.go:117] "RemoveContainer" containerID="ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2"
May 26 06:42:00.906324 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.906305    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2\": container with ID starting with ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2 not found: ID does not exist" containerID="ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2"
May 26 06:42:00.906403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906330    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2"} err="failed to get container status \"ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2\": rpc error: code = NotFound desc = could not find container \"ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2\": container with ID starting with ac23a8cd18a49fbf77fcf5c2d835ff9b697d277861b3a2e14dbc5857c37bffc2 not found: ID does not exist"
May 26 06:42:00.906403 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906349    2557 scope.go:117] "RemoveContainer" containerID="69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d"
May 26 06:42:00.906599 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.906582    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d\": container with ID starting with 69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d not found: ID does not exist" containerID="69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d"
May 26 06:42:00.906662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906627    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d"} err="failed to get container status \"69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d\": rpc error: code = NotFound desc = could not find container \"69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d\": container with ID starting with 69b04704dd5d60f64d79e4ac81534526e0678ec3cb43afcb88d040bc8cef887d not found: ID does not exist"
May 26 06:42:00.906662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906644    2557 scope.go:117] "RemoveContainer" containerID="43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181"
May 26 06:42:00.906870 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.906852    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181\": container with ID starting with 43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181 not found: ID does not exist" containerID="43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181"
May 26 06:42:00.906912 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906876    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181"} err="failed to get container status \"43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181\": rpc error: code = NotFound desc = could not find container \"43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181\": container with ID starting with 43751ebbf400ae93694ee8b3cdad20731584ab9cdba128398d413639e4521181 not found: ID does not exist"
May 26 06:42:00.906912 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.906890    2557 scope.go:117] "RemoveContainer" containerID="a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6"
May 26 06:42:00.907098 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:42:00.907081    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6\": container with ID starting with a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6 not found: ID does not exist" containerID="a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6"
May 26 06:42:00.907174 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:00.907103    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6"} err="failed to get container status \"a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6\": rpc error: code = NotFound desc = could not find container \"a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6\": container with ID starting with a1df9c8592720d74e9bb41f9cf12e6f768c59c9c68a7dfbe1e8a82f6406bb9d6 not found: ID does not exist"
May 26 06:42:01.554581 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:01.554523    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-74b66c555b-2h7dl" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": context deadline exceeded"
May 26 06:42:02.265957 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:02.265922    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf043994-3256-4739-a79a-71c72e320589" path="/var/lib/kubelet/pods/cf043994-3256-4739-a79a-71c72e320589/volumes"
May 26 06:42:02.266424 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:42:02.266409    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" path="/var/lib/kubelet/pods/d521fa9f-8ad1-419a-b5dd-ec9444da638f/volumes"
May 26 06:52:24.261145 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261113    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l7wlr/must-gather-kmhdb"]
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261402    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47709ab-b7ec-4a3b-b986-560529a8eddd" containerName="postgres"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261416    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47709ab-b7ec-4a3b-b986-560529a8eddd" containerName="postgres"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261425    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="feast-apply"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261431    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="feast-apply"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261439    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261444    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261453    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="feast-apply"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261458    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="feast-apply"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261468    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fd6bef-8c11-45db-9f2c-c6bd05f3b575" containerName="redis"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261476    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fd6bef-8c11-45db-9f2c-c6bd05f3b575" containerName="redis"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261487    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="feast-init"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261493    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="feast-init"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261505    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1e47333-c33b-4e94-81de-2a7c513e8f9d" containerName="manager"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261510    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1e47333-c33b-4e94-81de-2a7c513e8f9d" containerName="manager"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261516    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261520    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261526    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261536    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="feast-init"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261541    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="feast-init"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261546    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry"
May 26 06:52:24.261563 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261552    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261634    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="registry"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261647    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1e47333-c33b-4e94-81de-2a7c513e8f9d" containerName="manager"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261657    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f47709ab-b7ec-4a3b-b986-560529a8eddd" containerName="postgres"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261663    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf043994-3256-4739-a79a-71c72e320589" containerName="online"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261668    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="online"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261674    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="94fd6bef-8c11-45db-9f2c-c6bd05f3b575" containerName="redis"
May 26 06:52:24.262236 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.261681    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d521fa9f-8ad1-419a-b5dd-ec9444da638f" containerName="registry"
May 26 06:52:24.264675 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.264649    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.266789 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.266760    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l7wlr\"/\"openshift-service-ca.crt\""
May 26 06:52:24.267054 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.267037    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l7wlr\"/\"default-dockercfg-c4ccz\""
May 26 06:52:24.267054 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.267050    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l7wlr\"/\"kube-root-ca.crt\""
May 26 06:52:24.273951 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.272944    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7wlr/must-gather-kmhdb"]
May 26 06:52:24.317523 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.317491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6801845-ee1d-42e6-afaf-cc087d87f3d4-must-gather-output\") pod \"must-gather-kmhdb\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") " pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.317661 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.317545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hp8t\" (UniqueName: \"kubernetes.io/projected/b6801845-ee1d-42e6-afaf-cc087d87f3d4-kube-api-access-6hp8t\") pod \"must-gather-kmhdb\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") " pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.418905 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.418872    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6801845-ee1d-42e6-afaf-cc087d87f3d4-must-gather-output\") pod \"must-gather-kmhdb\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") " pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.419016 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.418917    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hp8t\" (UniqueName: \"kubernetes.io/projected/b6801845-ee1d-42e6-afaf-cc087d87f3d4-kube-api-access-6hp8t\") pod \"must-gather-kmhdb\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") " pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.419186 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.419167    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6801845-ee1d-42e6-afaf-cc087d87f3d4-must-gather-output\") pod \"must-gather-kmhdb\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") " pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.426939 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.426917    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hp8t\" (UniqueName: \"kubernetes.io/projected/b6801845-ee1d-42e6-afaf-cc087d87f3d4-kube-api-access-6hp8t\") pod \"must-gather-kmhdb\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") " pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.587765 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.587685    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:24.708100 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.708073    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l7wlr/must-gather-kmhdb"]
May 26 06:52:24.710530 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:52:24.710505    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6801845_ee1d_42e6_afaf_cc087d87f3d4.slice/crio-47c6ac86831aed96ce8eb7a3bf8f6b6d256a0329b075e97c4a03eee1feab4d87 WatchSource:0}: Error finding container 47c6ac86831aed96ce8eb7a3bf8f6b6d256a0329b075e97c4a03eee1feab4d87: Status 404 returned error can't find the container with id 47c6ac86831aed96ce8eb7a3bf8f6b6d256a0329b075e97c4a03eee1feab4d87
May 26 06:52:24.712341 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:24.712322    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 06:52:25.541933 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:25.541895    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" event={"ID":"b6801845-ee1d-42e6-afaf-cc087d87f3d4","Type":"ContainerStarted","Data":"47c6ac86831aed96ce8eb7a3bf8f6b6d256a0329b075e97c4a03eee1feab4d87"}
May 26 06:52:31.561450 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:31.561413    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" event={"ID":"b6801845-ee1d-42e6-afaf-cc087d87f3d4","Type":"ContainerStarted","Data":"0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0"}
May 26 06:52:31.561450 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:31.561453    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" event={"ID":"b6801845-ee1d-42e6-afaf-cc087d87f3d4","Type":"ContainerStarted","Data":"b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"}
May 26 06:52:31.581488 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:31.581442    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" podStartSLOduration=1.484802569 podStartE2EDuration="7.581428659s" podCreationTimestamp="2026-05-26 06:52:24 +0000 UTC" firstStartedPulling="2026-05-26 06:52:24.712444917 +0000 UTC m=+1809.049011251" lastFinishedPulling="2026-05-26 06:52:30.809071003 +0000 UTC m=+1815.145637341" observedRunningTime="2026-05-26 06:52:31.579292998 +0000 UTC m=+1815.915859355" watchObservedRunningTime="2026-05-26 06:52:31.581428659 +0000 UTC m=+1815.917995014"
May 26 06:52:40.586593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:40.586506    2557 generic.go:358] "Generic (PLEG): container finished" podID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerID="b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba" exitCode=0
May 26 06:52:40.586593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:40.586550    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" event={"ID":"b6801845-ee1d-42e6-afaf-cc087d87f3d4","Type":"ContainerDied","Data":"b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"}
May 26 06:52:40.587074 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:40.586841    2557 scope.go:117] "RemoveContainer" containerID="b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"
May 26 06:52:41.311744 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.311716    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-l7wlr_must-gather-kmhdb_b6801845-ee1d-42e6-afaf-cc087d87f3d4/gather/0.log"
May 26 06:52:41.799741 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.799708    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hprjg/must-gather-slfc7"]
May 26 06:52:41.801934 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.801912    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:41.803863 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.803845    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hprjg\"/\"default-dockercfg-xrv28\""
May 26 06:52:41.804253 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.804235    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hprjg\"/\"openshift-service-ca.crt\""
May 26 06:52:41.804375 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.804365    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hprjg\"/\"kube-root-ca.crt\""
May 26 06:52:41.812170 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.812148    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hprjg/must-gather-slfc7"]
May 26 06:52:41.970471 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.970436    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7b68a3c1-4c96-4027-9a9f-296331c9370d-must-gather-output\") pod \"must-gather-slfc7\" (UID: \"7b68a3c1-4c96-4027-9a9f-296331c9370d\") " pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:41.970696 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:41.970586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6rq\" (UniqueName: \"kubernetes.io/projected/7b68a3c1-4c96-4027-9a9f-296331c9370d-kube-api-access-xw6rq\") pod \"must-gather-slfc7\" (UID: \"7b68a3c1-4c96-4027-9a9f-296331c9370d\") " pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:42.071979 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.071885    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7b68a3c1-4c96-4027-9a9f-296331c9370d-must-gather-output\") pod \"must-gather-slfc7\" (UID: \"7b68a3c1-4c96-4027-9a9f-296331c9370d\") " pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:42.071979 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.071960    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw6rq\" (UniqueName: \"kubernetes.io/projected/7b68a3c1-4c96-4027-9a9f-296331c9370d-kube-api-access-xw6rq\") pod \"must-gather-slfc7\" (UID: \"7b68a3c1-4c96-4027-9a9f-296331c9370d\") " pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:42.072210 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.072197    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7b68a3c1-4c96-4027-9a9f-296331c9370d-must-gather-output\") pod \"must-gather-slfc7\" (UID: \"7b68a3c1-4c96-4027-9a9f-296331c9370d\") " pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:42.080287 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.080264    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw6rq\" (UniqueName: \"kubernetes.io/projected/7b68a3c1-4c96-4027-9a9f-296331c9370d-kube-api-access-xw6rq\") pod \"must-gather-slfc7\" (UID: \"7b68a3c1-4c96-4027-9a9f-296331c9370d\") " pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:42.110421 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.110398    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hprjg/must-gather-slfc7"
May 26 06:52:42.229593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.229563    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hprjg/must-gather-slfc7"]
May 26 06:52:42.232761 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:52:42.232726    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b68a3c1_4c96_4027_9a9f_296331c9370d.slice/crio-98c127581d6486ee9ef456e1869aa0a6af17c763c8ea220ba9a4f92e4ee0b662 WatchSource:0}: Error finding container 98c127581d6486ee9ef456e1869aa0a6af17c763c8ea220ba9a4f92e4ee0b662: Status 404 returned error can't find the container with id 98c127581d6486ee9ef456e1869aa0a6af17c763c8ea220ba9a4f92e4ee0b662
May 26 06:52:42.592327 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:42.592293    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprjg/must-gather-slfc7" event={"ID":"7b68a3c1-4c96-4027-9a9f-296331c9370d","Type":"ContainerStarted","Data":"98c127581d6486ee9ef456e1869aa0a6af17c763c8ea220ba9a4f92e4ee0b662"}
May 26 06:52:43.597095 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:43.597055    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprjg/must-gather-slfc7" event={"ID":"7b68a3c1-4c96-4027-9a9f-296331c9370d","Type":"ContainerStarted","Data":"3981580f4e607921c90d5c58b5b1bcaf177b206f7abe9a590faad81e83c0cfa6"}
May 26 06:52:43.597095 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:43.597103    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprjg/must-gather-slfc7" event={"ID":"7b68a3c1-4c96-4027-9a9f-296331c9370d","Type":"ContainerStarted","Data":"a9ea61e2d1225b5eeaa606b4a89efc9ddb69d31797877e58c2b9af7fd135ddfc"}
May 26 06:52:43.614980 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:43.614084    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hprjg/must-gather-slfc7" podStartSLOduration=1.958465232 podStartE2EDuration="2.614065574s" podCreationTimestamp="2026-05-26 06:52:41 +0000 UTC" firstStartedPulling="2026-05-26 06:52:42.234498647 +0000 UTC m=+1826.571064985" lastFinishedPulling="2026-05-26 06:52:42.890098993 +0000 UTC m=+1827.226665327" observedRunningTime="2026-05-26 06:52:43.613054198 +0000 UTC m=+1827.949620646" watchObservedRunningTime="2026-05-26 06:52:43.614065574 +0000 UTC m=+1827.950631931"
May 26 06:52:44.263831 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:44.263796    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8zwbx_854814a8-d769-443f-9c2a-f9bbb8647689/global-pull-secret-syncer/0.log"
May 26 06:52:44.432194 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:44.432167    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zf96s_e069bd11-87f4-4aec-bec6-2a8dab6eeadf/konnectivity-agent/0.log"
May 26 06:52:44.502007 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:44.501976    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-226.ec2.internal_bdef92636052986ed01d0acb1a884835/haproxy/0.log"
May 26 06:52:46.631681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:46.631596    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-l7wlr/must-gather-kmhdb"]
May 26 06:52:46.633030 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:46.633000    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="copy" containerID="cri-o://0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0" gracePeriod=2
May 26 06:52:46.635697 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:46.635655    2557 status_manager.go:895] "Failed to get status for pod" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" err="pods \"must-gather-kmhdb\" is forbidden: User \"system:node:ip-10-0-136-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l7wlr\": no relationship found between node 'ip-10-0-136-226.ec2.internal' and this object"
May 26 06:52:46.636952 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:46.636936    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-l7wlr/must-gather-kmhdb"]
May 26 06:52:47.013300 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.013089    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-l7wlr_must-gather-kmhdb_b6801845-ee1d-42e6-afaf-cc087d87f3d4/copy/0.log"
May 26 06:52:47.013927 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.013644    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:47.018808 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.018772    2557 status_manager.go:895] "Failed to get status for pod" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" err="pods \"must-gather-kmhdb\" is forbidden: User \"system:node:ip-10-0-136-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l7wlr\": no relationship found between node 'ip-10-0-136-226.ec2.internal' and this object"
May 26 06:52:47.121317 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.121269    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6801845-ee1d-42e6-afaf-cc087d87f3d4-must-gather-output\") pod \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") "
May 26 06:52:47.122208 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.122184    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hp8t\" (UniqueName: \"kubernetes.io/projected/b6801845-ee1d-42e6-afaf-cc087d87f3d4-kube-api-access-6hp8t\") pod \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\" (UID: \"b6801845-ee1d-42e6-afaf-cc087d87f3d4\") "
May 26 06:52:47.122492 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.121987    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6801845-ee1d-42e6-afaf-cc087d87f3d4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "b6801845-ee1d-42e6-afaf-cc087d87f3d4" (UID: "b6801845-ee1d-42e6-afaf-cc087d87f3d4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 06:52:47.122889 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.122871    2557 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b6801845-ee1d-42e6-afaf-cc087d87f3d4-must-gather-output\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:52:47.125178 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.125143    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6801845-ee1d-42e6-afaf-cc087d87f3d4-kube-api-access-6hp8t" (OuterVolumeSpecName: "kube-api-access-6hp8t") pod "b6801845-ee1d-42e6-afaf-cc087d87f3d4" (UID: "b6801845-ee1d-42e6-afaf-cc087d87f3d4"). InnerVolumeSpecName "kube-api-access-6hp8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 06:52:47.224055 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.224006    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hp8t\" (UniqueName: \"kubernetes.io/projected/b6801845-ee1d-42e6-afaf-cc087d87f3d4-kube-api-access-6hp8t\") on node \"ip-10-0-136-226.ec2.internal\" DevicePath \"\""
May 26 06:52:47.613813 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.613731    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-l7wlr_must-gather-kmhdb_b6801845-ee1d-42e6-afaf-cc087d87f3d4/copy/0.log"
May 26 06:52:47.616626 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.614330    2557 generic.go:358] "Generic (PLEG): container finished" podID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerID="0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0" exitCode=143
May 26 06:52:47.616626 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.614474    2557 scope.go:117] "RemoveContainer" containerID="0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0"
May 26 06:52:47.616626 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.614637    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l7wlr/must-gather-kmhdb"
May 26 06:52:47.619079 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.619036    2557 status_manager.go:895] "Failed to get status for pod" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" err="pods \"must-gather-kmhdb\" is forbidden: User \"system:node:ip-10-0-136-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l7wlr\": no relationship found between node 'ip-10-0-136-226.ec2.internal' and this object"
May 26 06:52:47.628099 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.628076    2557 scope.go:117] "RemoveContainer" containerID="b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"
May 26 06:52:47.632352 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.632314    2557 status_manager.go:895] "Failed to get status for pod" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" pod="openshift-must-gather-l7wlr/must-gather-kmhdb" err="pods \"must-gather-kmhdb\" is forbidden: User \"system:node:ip-10-0-136-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-l7wlr\": no relationship found between node 'ip-10-0-136-226.ec2.internal' and this object"
May 26 06:52:47.640549 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.640326    2557 scope.go:117] "RemoveContainer" containerID="0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0"
May 26 06:52:47.641338 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:52:47.640769    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0\": container with ID starting with 0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0 not found: ID does not exist" containerID="0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0"
May 26 06:52:47.641338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.640812    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0"} err="failed to get container status \"0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0\": rpc error: code = NotFound desc = could not find container \"0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0\": container with ID starting with 0c3387489c849c3e132505d77b0f3276a66822f5c80d673839422f91f18949a0 not found: ID does not exist"
May 26 06:52:47.641338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.640846    2557 scope.go:117] "RemoveContainer" containerID="b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"
May 26 06:52:47.641338 ip-10-0-136-226 kubenswrapper[2557]: E0526 06:52:47.641257    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba\": container with ID starting with b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba not found: ID does not exist" containerID="b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"
May 26 06:52:47.641338 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:47.641283    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba"} err="failed to get container status \"b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba\": rpc error: code = NotFound desc = could not find container \"b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba\": container with ID starting with b92a93ebd8975c97876ca61cb71e0e5bb78f5939b8300f21e6ec2bffd6209aba not found: ID does not exist"
May 26 06:52:48.028579 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.028551    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9zpbq_70f89a2d-4308-4089-915d-9724284fccf4/kube-state-metrics/0.log"
May 26 06:52:48.070731 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.070702    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9zpbq_70f89a2d-4308-4089-915d-9724284fccf4/kube-rbac-proxy-main/0.log"
May 26 06:52:48.123523 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.123497    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9zpbq_70f89a2d-4308-4089-915d-9724284fccf4/kube-rbac-proxy-self/0.log"
May 26 06:52:48.160013 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.159985    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8f5c878dd-lz5tx_c435e667-7e0c-4222-b155-05f598081e96/metrics-server/0.log"
May 26 06:52:48.267268 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.267229    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" path="/var/lib/kubelet/pods/b6801845-ee1d-42e6-afaf-cc087d87f3d4/volumes"
May 26 06:52:48.370686 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.370558    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqrxf_002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6/node-exporter/0.log"
May 26 06:52:48.392096 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.392071    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqrxf_002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6/kube-rbac-proxy/0.log"
May 26 06:52:48.415595 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.415569    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqrxf_002cdadb-acfc-4a2b-9bea-f4a4ae79d0c6/init-textfile/0.log"
May 26 06:52:48.447831 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.447801    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-6kw68_cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d/kube-rbac-proxy-main/0.log"
May 26 06:52:48.473131 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.473104    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-6kw68_cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d/kube-rbac-proxy-self/0.log"
May 26 06:52:48.499761 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.499731    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-6kw68_cbc3b5a9-8660-4e8d-bcf1-5f38bde2908d/openshift-state-metrics/0.log"
May 26 06:52:48.777242 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.777167    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gxjpm_d6979db8-5826-4664-82b3-2ef62d6d792b/prometheus-operator/0.log"
May 26 06:52:48.801389 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.800569    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-gxjpm_d6979db8-5826-4664-82b3-2ef62d6d792b/kube-rbac-proxy/0.log"
May 26 06:52:48.965350 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.965319    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b88b8648-fpqls_7b90aa23-c719-497d-8b2e-9405910f1c5e/thanos-query/0.log"
May 26 06:52:48.991262 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:48.991229    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b88b8648-fpqls_7b90aa23-c719-497d-8b2e-9405910f1c5e/kube-rbac-proxy-web/0.log"
May 26 06:52:49.017410 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:49.017325    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b88b8648-fpqls_7b90aa23-c719-497d-8b2e-9405910f1c5e/kube-rbac-proxy/0.log"
May 26 06:52:49.058728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:49.058696    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b88b8648-fpqls_7b90aa23-c719-497d-8b2e-9405910f1c5e/prom-label-proxy/0.log"
May 26 06:52:49.116733 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:49.116703    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b88b8648-fpqls_7b90aa23-c719-497d-8b2e-9405910f1c5e/kube-rbac-proxy-rules/0.log"
May 26 06:52:49.143789 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:49.143759    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58b88b8648-fpqls_7b90aa23-c719-497d-8b2e-9405910f1c5e/kube-rbac-proxy-metrics/0.log"
May 26 06:52:50.524562 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.524526    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"]
May 26 06:52:50.525328 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.525301    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="copy"
May 26 06:52:50.525328 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.525329    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="copy"
May 26 06:52:50.525476 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.525374    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="gather"
May 26 06:52:50.525476 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.525384    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="gather"
May 26 06:52:50.525476 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.525468    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="gather"
May 26 06:52:50.525649 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.525480    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6801845-ee1d-42e6-afaf-cc087d87f3d4" containerName="copy"
May 26 06:52:50.529434 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.529412    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.542215 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.542192    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"]
May 26 06:52:50.653728 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.653675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-proc\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.653911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.653819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-sys\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.653911 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.653894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-podres\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.654033 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.653933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-lib-modules\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.654033 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.653986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjz72\" (UniqueName: \"kubernetes.io/projected/b17c2912-5df5-4f8e-84eb-6842f386823e-kube-api-access-xjz72\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754424 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754376    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-podres\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754444    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-lib-modules\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754499    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xjz72\" (UniqueName: \"kubernetes.io/projected/b17c2912-5df5-4f8e-84eb-6842f386823e-kube-api-access-xjz72\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754541    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-proc\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754540    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-podres\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754623    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-lib-modules\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754593 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754636    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-sys\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754959 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754629    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-proc\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.754959 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.754693    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b17c2912-5df5-4f8e-84eb-6842f386823e-sys\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.763328 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.763289    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjz72\" (UniqueName: \"kubernetes.io/projected/b17c2912-5df5-4f8e-84eb-6842f386823e-kube-api-access-xjz72\") pod \"perf-node-gather-daemonset-6ctz2\" (UID: \"b17c2912-5df5-4f8e-84eb-6842f386823e\") " pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.846846 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.846765    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:50.989768 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:50.989728    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"]
May 26 06:52:50.993081 ip-10-0-136-226 kubenswrapper[2557]: W0526 06:52:50.993057    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb17c2912_5df5_4f8e_84eb_6842f386823e.slice/crio-45a776b2e8e452e3fc0e6a83e92d3634bb3ba5eb58934faf3da1728cc98d4552 WatchSource:0}: Error finding container 45a776b2e8e452e3fc0e6a83e92d3634bb3ba5eb58934faf3da1728cc98d4552: Status 404 returned error can't find the container with id 45a776b2e8e452e3fc0e6a83e92d3634bb3ba5eb58934faf3da1728cc98d4552
May 26 06:52:51.631922 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:51.631879    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2" event={"ID":"b17c2912-5df5-4f8e-84eb-6842f386823e","Type":"ContainerStarted","Data":"6711b57e2a15ed70933ba20c6d6232accc2d8552d028bae3c7717ec7b48e2f13"}
May 26 06:52:51.632391 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:51.631929    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2" event={"ID":"b17c2912-5df5-4f8e-84eb-6842f386823e","Type":"ContainerStarted","Data":"45a776b2e8e452e3fc0e6a83e92d3634bb3ba5eb58934faf3da1728cc98d4552"}
May 26 06:52:51.632391 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:51.631961    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:51.649773 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:51.649717    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2" podStartSLOduration=1.64970043 podStartE2EDuration="1.64970043s" podCreationTimestamp="2026-05-26 06:52:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 06:52:51.648385609 +0000 UTC m=+1835.984951966" watchObservedRunningTime="2026-05-26 06:52:51.64970043 +0000 UTC m=+1835.986266787"
May 26 06:52:52.108546 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:52.108519    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p87p8_71f9d979-0aeb-4405-8da0-7e46bfc82076/dns/0.log"
May 26 06:52:52.134346 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:52.134321    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-p87p8_71f9d979-0aeb-4405-8da0-7e46bfc82076/kube-rbac-proxy/0.log"
May 26 06:52:52.261806 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:52.261780    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t72t4_5f8848e7-b881-4c6a-8b3f-065fca5100a0/dns-node-resolver/0.log"
May 26 06:52:52.746918 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:52.746891    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ct9nk_36ddea7d-2bc9-40a3-a670-1be374220adc/node-ca/0.log"
May 26 06:52:53.517957 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:53.517932    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-568c577cb4-nt5lh_2fa0e2ca-97a8-400b-9103-6ca95838a915/router/0.log"
May 26 06:52:53.868681 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:53.868591    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x9k28_97e82fce-5c69-4787-bcfe-bf4a6e2317c8/serve-healthcheck-canary/0.log"
May 26 06:52:54.379521 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:54.379492    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mhjjw_af31bdea-bd6f-42a5-ae97-8518aeeae01e/kube-rbac-proxy/0.log"
May 26 06:52:54.407352 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:54.407329    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mhjjw_af31bdea-bd6f-42a5-ae97-8518aeeae01e/exporter/0.log"
May 26 06:52:54.431840 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:54.431814    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mhjjw_af31bdea-bd6f-42a5-ae97-8518aeeae01e/extractor/0.log"
May 26 06:52:57.645558 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:57.645527    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hprjg/perf-node-gather-daemonset-6ctz2"
May 26 06:52:58.693889 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:58.693859    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jr9jn_ff5c686b-b3c2-444a-9f0b-051795ba913a/migrator/0.log"
May 26 06:52:58.723456 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:52:58.723426    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jr9jn_ff5c686b-b3c2-444a-9f0b-051795ba913a/graceful-termination/0.log"
May 26 06:53:00.347856 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.347785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/kube-multus-additional-cni-plugins/0.log"
May 26 06:53:00.371276 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.371252    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/egress-router-binary-copy/0.log"
May 26 06:53:00.398958 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.398932    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/cni-plugins/0.log"
May 26 06:53:00.432320 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.432297    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/bond-cni-plugin/0.log"
May 26 06:53:00.489896 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.489878    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/routeoverride-cni/0.log"
May 26 06:53:00.517467 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.517448    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/whereabouts-cni-bincopy/0.log"
May 26 06:53:00.542984 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.542964    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kmlcg_2684635f-8b95-4dee-a43f-21dc59707299/whereabouts-cni/0.log"
May 26 06:53:00.756179 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.756151    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cqnml_2cbb447f-ec05-4a9e-aefc-87810df1b166/kube-multus/0.log"
May 26 06:53:00.834867 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.834839    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxsbh_f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5/network-metrics-daemon/0.log"
May 26 06:53:00.858615 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:00.858576    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxsbh_f3999db6-7bf5-4c66-94b8-0ca2a03bc1f5/kube-rbac-proxy/0.log"
May 26 06:53:01.994478 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:01.994372    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/ovn-controller/0.log"
May 26 06:53:02.065662 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.065633    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/ovn-acl-logging/0.log"
May 26 06:53:02.086766 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.086744    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/kube-rbac-proxy-node/0.log"
May 26 06:53:02.110980 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.110948    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/kube-rbac-proxy-ovn-metrics/0.log"
May 26 06:53:02.132834 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.132810    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/northd/0.log"
May 26 06:53:02.155218 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.155198    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/nbdb/0.log"
May 26 06:53:02.178189 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.178164    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/sbdb/0.log"
May 26 06:53:02.286717 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:02.286645    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-775ks_f395fbd7-6f0a-4a08-a6d0-c711ad3a323a/ovnkube-controller/0.log"
May 26 06:53:03.648846 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:03.648812    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mqcmb_3fdb5f4e-efbb-4102-a30c-756008053b56/network-check-target-container/0.log"
May 26 06:53:04.651259 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:04.651210    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-tvfh8_d7529446-02e9-4a69-8ae6-9134bf3b7bda/iptables-alerter/0.log"
May 26 06:53:05.254537 ip-10-0-136-226 kubenswrapper[2557]: I0526 06:53:05.254510    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-p8zgb_190a73cc-9e56-42fe-8d88-6760d0b5ec69/tuned/0.log"