May 25 11:19:49.772259 ip-10-0-134-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 25 11:19:49.772271 ip-10-0-134-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 25 11:19:49.772280 ip-10-0-134-184 systemd[1]: kubelet.service: Failed with result 'resources'.
May 25 11:19:49.772571 ip-10-0-134-184 systemd[1]: Failed to start Kubernetes Kubelet.
May 25 11:19:59.944164 ip-10-0-134-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 25 11:19:59.944180 ip-10-0-134-184 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 67c47bced56b4a42b749e718f078bf46 --
May 25 11:22:28.046192 ip-10-0-134-184 systemd[1]: Starting Kubernetes Kubelet...
May 25 11:22:28.541142 ip-10-0-134-184 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:22:28.541142 ip-10-0-134-184 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 11:22:28.541142 ip-10-0-134-184 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:22:28.541142 ip-10-0-134-184 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 11:22:28.541142 ip-10-0-134-184 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 11:22:28.543285 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.543203    2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 11:22:28.547030 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547016    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:22:28.547030 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547030    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547034    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547037    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547039    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547042    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547045    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547047    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547050    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547053    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547055    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547059    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547062    2557 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547065    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547067    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547070    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547072    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547075    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547077    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547080    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:22:28.547097 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547083    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547085    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547088    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547091    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547100    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547104    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547106    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547109    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547112    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547115    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547117    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547120    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547122    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547125    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547128    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547130    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547133    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547135    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547137    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547141    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:22:28.547551 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547143    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547146    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547148    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547152    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547156    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547158    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547161    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547163    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547166    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547168    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547171    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547173    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547176    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547179    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547182    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547185    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547187    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547190    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547193    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:22:28.548040 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547195    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547198    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547200    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547203    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547205    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547208    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547210    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547213    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547216    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547218    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547221    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547223    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547227    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547229    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547232    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547234    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547238    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547240    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547243    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547246    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:22:28.548504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547248    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547251    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547254    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547256    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547259    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547261    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547265    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547622    2557 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547627    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547630    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547633    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547637    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547639    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547642    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547645    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547647    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547650    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547653    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547655    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547658    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:22:28.548996 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547661    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547663    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547666    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547668    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547671    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547674    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547676    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547679    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547682    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547685    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547687    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547690    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547692    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547695    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547698    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547700    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547703    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547706    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547708    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:22:28.549465 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547711    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547713    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547716    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547718    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547721    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547723    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547726    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547728    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547731    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547733    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547736    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547738    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547741    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547743    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547746    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547748    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547751    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547753    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547756    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547758    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:22:28.549941 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547761    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547763    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547766    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547769    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547771    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547773    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547776    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547779    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547783    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547788    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547791    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547794    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547797    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547800    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547803    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547805    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547807    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547810    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547812    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:22:28.550433 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547815    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547817    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547819    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547822    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547824    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547827    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547829    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547831    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547834    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547836    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547839    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547841    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547844    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547847    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.547850    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549313    2557 flags.go:64] FLAG: --address="0.0.0.0"
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549323    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549329    2557 flags.go:64] FLAG: --anonymous-auth="true"
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549334    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549338    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549341    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 11:22:28.550901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549345    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549350    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549353    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549356    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549359    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549363    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549366    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549369    2557 flags.go:64] FLAG: --cgroup-root=""
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549372    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549375    2557 flags.go:64] FLAG: --client-ca-file=""
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549378    2557 flags.go:64] FLAG: --cloud-config=""
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549381    2557 flags.go:64] FLAG: --cloud-provider="external"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549384    2557 flags.go:64] FLAG: --cluster-dns="[]"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549388    2557 flags.go:64] FLAG: --cluster-domain=""
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549391    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549394    2557 flags.go:64] FLAG: --config-dir=""
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549397    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549400    2557 flags.go:64] FLAG: --container-log-max-files="5"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549404    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549407    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549410    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549413    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549416    2557 flags.go:64] FLAG: --contention-profiling="false"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549419    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 11:22:28.551408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549422    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549425    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549428    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549432    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549436    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549439    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549442    2557 flags.go:64] FLAG: --enable-load-reader="false"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549445    2557 flags.go:64] FLAG: --enable-server="true"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549448    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549452    2557 flags.go:64] FLAG: --event-burst="100"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549455    2557 flags.go:64] FLAG: --event-qps="50"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549458    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549461    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549464    2557 flags.go:64] FLAG: --eviction-hard=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549468    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549471    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549474    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549477    2557 flags.go:64] FLAG: --eviction-soft=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549480    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549484    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549487    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549490    2557 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549493    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549496    2557 flags.go:64] FLAG: --fail-swap-on="true"
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549498    2557 flags.go:64] FLAG: --feature-gates=""
May 25 11:22:28.551989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549502    2557 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549505    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549508    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549512    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549515    2557 flags.go:64] FLAG: --healthz-port="10248"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549518    2557 flags.go:64] FLAG: --help="false"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549521    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-134-184.ec2.internal"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549524    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549527    2557 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549530    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549534    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549537    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549540    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549543    2557 flags.go:64] FLAG: --image-service-endpoint=""
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549546    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549549    2557 flags.go:64] FLAG: --kube-api-burst="100"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549552    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549555    2557 flags.go:64] FLAG: --kube-api-qps="50"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549558    2557 flags.go:64] FLAG: --kube-reserved=""
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549562    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549564    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549567    2557 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549570    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549573    2557 flags.go:64] FLAG: --lock-file=""
May 25 11:22:28.552589 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549576    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549579    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549582    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549587    2557 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549590    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549593    2557 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549596    2557 flags.go:64] FLAG: --logging-format="text"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549599    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549602    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549605    2557 flags.go:64] FLAG: --manifest-url=""
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549608    2557 flags.go:64] FLAG: --manifest-url-header=""
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549612    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549615    2557 flags.go:64] FLAG: --max-open-files="1000000"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549619    2557 flags.go:64] FLAG: --max-pods="110"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549622    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549625    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549628    2557 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549631    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549634    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549636    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549639    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549647    2557 flags.go:64] FLAG: --node-status-max-images="50"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549654    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549657    2557 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 11:22:28.553202 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549660    2557 flags.go:64] FLAG: --pod-cidr=""
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549663    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549668    2557 flags.go:64] FLAG: --pod-manifest-path=""
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549671    2557 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549674    2557 flags.go:64] FLAG: --pods-per-core="0"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549677    2557 flags.go:64] FLAG: --port="10250"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549680    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549683    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d5bf739af597528d"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549686    2557 flags.go:64] FLAG: --qos-reserved=""
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549689    2557 flags.go:64] FLAG: --read-only-port="10255"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549692    2557 flags.go:64] FLAG: --register-node="true"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549695    2557 flags.go:64] FLAG: --register-schedulable="true"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549698    2557 flags.go:64] FLAG: --register-with-taints=""
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549710    2557 flags.go:64] FLAG: --registry-burst="10"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549713    2557 flags.go:64] FLAG: --registry-qps="5"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549716    2557 flags.go:64] FLAG: --reserved-cpus=""
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549719    2557 flags.go:64] FLAG: --reserved-memory=""
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549722    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549726    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549729    2557 flags.go:64] FLAG: --rotate-certificates="false"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549732    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549734    2557 flags.go:64] FLAG: --runonce="false"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549737    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549740    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549743    2557 flags.go:64] FLAG: --seccomp-default="false"
May 25 11:22:28.553777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549746    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549749    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549752    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549756    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549759    2557 flags.go:64] FLAG: --storage-driver-password="root"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549762    2557 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549767    2557 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549771    2557 flags.go:64] FLAG: --storage-driver-user="root"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549774    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549777    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549780    2557 flags.go:64] FLAG: --system-cgroups=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549783    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549788    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549791    2557 flags.go:64] FLAG: --tls-cert-file=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549794    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549798    2557 flags.go:64] FLAG: --tls-min-version=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549801    2557 flags.go:64] FLAG: --tls-private-key-file=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549803    2557 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549806    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549809    2557 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549812    2557 flags.go:64] FLAG: --v="2"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549816    2557 flags.go:64] FLAG: --version="false"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549820    2557 flags.go:64] FLAG: --vmodule=""
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549824    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.549828    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 11:22:28.554422 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549927    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549931    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549934    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549937    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549940    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549942    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549945    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549948    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549950    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549954    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549956    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549959    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549961    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549966    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549968    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549971    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549974    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549977    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549981    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:22:28.555067 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549983    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549987    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549991    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549994    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549996    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.549999    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550001    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550004    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550006    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550009    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550011    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550014    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550016    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550019    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550022    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550024    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550027    2557 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550030    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550032    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:22:28.555529 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550035    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550037    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550040    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550042    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550045    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550047    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550050    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550053    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550057    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550059    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550062    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550064    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550067    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550070    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550072    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550075    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550078    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550080    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550083    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550085    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:22:28.556063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550087    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550090    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550092    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550095    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550097    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550100    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550106    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550109    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550111    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550114    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550117    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550119    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550121    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550124    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550126    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550129    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550131    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550134    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550136    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550149    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:22:28.556583 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550153    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550156    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550159    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550161    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550164    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550167    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550170    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.550172    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:22:28.557085 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.550941    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:22:28.558451 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.558433    2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 11:22:28.558489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.558452    2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558497    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558503    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558506    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558510    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558513    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558515    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558518    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:22:28.558517 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558521    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558524    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558527    2557 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558530    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558533    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558535    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558539    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558542    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558544    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558547    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558549    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558552    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558555    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558558    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558560    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558563    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558565    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558568    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558570    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558573    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:22:28.558718 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558575    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558578    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558580    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558583    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558586    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558589    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558591    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558594    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558596    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558599    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558601    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558604    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558606    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558609    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558612    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558614    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558617    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558619    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558622    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558624    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:22:28.559226 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558627    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558629    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558632    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558634    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558637    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558640    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558642    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558645    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558647    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558650    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558652    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558655    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558657    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558660    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558662    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558665    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558667    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558671    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558673    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558676    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:22:28.559717 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558678    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558680    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558684    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558688    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558691    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558693    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558696    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558699    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558702    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558704    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558707    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558709    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558712    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558714    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558717    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558721    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558725    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558728    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:22:28.560235 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558731    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.558736    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558831    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558836    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558839    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558842    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558845    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558848    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558851    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558853    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558855    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558858    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558861    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558879    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558882    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 11:22:28.560678 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558884    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558887    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558889    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558892    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558895    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558898    2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558901    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558903    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558906    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558909    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558911    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558914    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558917    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558920    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558922    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558925    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558927    2557 feature_gate.go:328] unrecognized feature gate: Example
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558930    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558933    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558935    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 11:22:28.561061 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558938    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558942    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558946    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558949    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558952    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558955    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558958    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558960    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558964    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558967    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558971    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558974    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558976    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558979    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558982    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558984    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558987    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558989    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558991    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 11:22:28.561545 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558994    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558996    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.558999    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559001    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559004    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559006    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559008    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559011    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559013    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559016    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559018    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559021    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559023    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559026    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559028    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559030    2557 feature_gate.go:328] unrecognized feature gate: Example2
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559033    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559035    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559038    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559040    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 11:22:28.562017 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559043    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559045    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559048    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559050    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559053    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559056    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559059    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559062    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559064    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559066    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559069    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559072    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559074    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:28.559077    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.559081    2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 11:22:28.562506 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.559925    2557 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 11:22:28.565446 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.565432    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 11:22:28.566604 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.566592    2557 server.go:1019] "Starting client certificate rotation"
May 25 11:22:28.566699 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.566685    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:22:28.566733 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.566720    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 11:22:28.595608 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.595591    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:22:28.600702 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.600684    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 11:22:28.616523 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.616506    2557 log.go:25] "Validated CRI v1 runtime API"
May 25 11:22:28.624066 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.624048    2557 log.go:25] "Validated CRI v1 image API"
May 25 11:22:28.625471 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.625455    2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 11:22:28.627288 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.627273    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:22:28.628075 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.628047    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 984ba976-085e-4fd4-a709-ffcbd2776f7e:/dev/nvme0n1p3 e3d4877e-6f83-40b1-aa36-ecd1930afb5b:/dev/nvme0n1p4]
May 25 11:22:28.628160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.628075    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 11:22:28.632339 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.632217    2557 manager.go:217] Machine: {Timestamp:2026-05-25 11:22:28.631702862 +0000 UTC m=+0.453627073 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3092635 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f7d717d5d512cf51819ad3a201dec SystemUUID:ec2f7d71-7d5d-512c-f518-19ad3a201dec BootID:67c47bce-d56b-4a42-b749-e718f078bf46 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:ee:2e:74:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:ee:2e:74:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:33:1a:52:64:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 11:22:28.633192 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.633179    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 11:22:28.633296 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.633281    2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 11:22:28.636903 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.636860    2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 11:22:28.637065 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.636905    2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 11:22:28.637157 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.637080    2557 topology_manager.go:138] "Creating topology manager with none policy"
May 25 11:22:28.637157 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.637092    2557 container_manager_linux.go:306] "Creating device plugin manager"
May 25 11:22:28.637157 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.637102    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:22:28.638008 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.637996    2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 11:22:28.639183 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.639171    2557 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:22:28.639304 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.639293    2557 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 11:22:28.643105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.643093    2557 kubelet.go:491] "Attempting to sync node with API server"
May 25 11:22:28.643175 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.643117    2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 11:22:28.643175 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.643134    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 11:22:28.643175 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.643147    2557 kubelet.go:397] "Adding apiserver pod source"
May 25 11:22:28.643175 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.643160    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 11:22:28.644460 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.644435    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:22:28.644528 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.644462    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 11:22:28.647888 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.647862    2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 11:22:28.650189 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.650175    2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 11:22:28.652322 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652309    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652327    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652333    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652338    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652364    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652371    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652377    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652382    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652389    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 11:22:28.652394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652395    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 11:22:28.652770 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652410    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 11:22:28.652770 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.652416    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 11:22:28.653318 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.653305    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 11:22:28.653318 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.653316    2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 11:22:28.656072 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.656025    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 25 11:22:28.656852 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.656650    2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 25 11:22:28.659052 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.659034    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vkj9"
May 25 11:22:28.659628 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.659615    2557 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 11:22:28.659669 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.659655    2557 server.go:1295] "Started kubelet"
May 25 11:22:28.659807 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.659718    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 11:22:28.659807 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.659779    2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 11:22:28.659921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.659829    2557 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 11:22:28.660344 ip-10-0-134-184 systemd[1]: Started Kubernetes Kubelet.
May 25 11:22:28.662800 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.662784    2557 server.go:317] "Adding debug handlers to kubelet server"
May 25 11:22:28.663186 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.663170    2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 11:22:28.666235 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.666219    2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 25 11:22:28.667227 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.666186    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-184.ec2.internal.18b2cb21c4b9ace5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-184.ec2.internal,UID:ip-10-0-134-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-184.ec2.internal,},FirstTimestamp:2026-05-25 11:22:28.659629285 +0000 UTC m=+0.481553496,LastTimestamp:2026-05-25 11:22:28.659629285 +0000 UTC m=+0.481553496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-184.ec2.internal,}"
May 25 11:22:28.668978 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.668960    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8vkj9"
May 25 11:22:28.669053 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.669009    2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 11:22:28.670629 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.670614    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 11:22:28.671277 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671261    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 11:22:28.671398 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671384    2557 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 11:22:28.671398 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671399    2557 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 11:22:28.671516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671497    2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 11:22:28.671571 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671541    2557 reconstruct.go:97] "Volume reconstruction finished"
May 25 11:22:28.671571 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671548    2557 reconciler.go:26] "Reconciler: start to sync state"
May 25 11:22:28.671973 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671951    2557 factory.go:55] Registering systemd factory
May 25 11:22:28.671973 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.671970    2557 factory.go:223] Registration of the systemd container factory successfully
May 25 11:22:28.672174 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.672160    2557 factory.go:153] Registering CRI-O factory
May 25 11:22:28.672174 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.672175    2557 factory.go:223] Registration of the crio container factory successfully
May 25 11:22:28.672311 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.672220    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 11:22:28.672311 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.672236    2557 factory.go:103] Registering Raw factory
May 25 11:22:28.672311 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.672251    2557 manager.go:1196] Started watching for new ooms in manager
May 25 11:22:28.672311 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.672271    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:28.672775 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.672760    2557 manager.go:319] Starting recovery of all containers
May 25 11:22:28.679270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.679225    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 11:22:28.680027 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.679833    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:22:28.682906 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.682886    2557 manager.go:324] Recovery completed
May 25 11:22:28.685667 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.685642    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 25 11:22:28.688722 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.688709    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:22:28.690620 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.690597    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:22:28.690620 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.690622    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:22:28.690754 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.690632    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
May 25 11:22:28.692065 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.692049    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 11:22:28.692065 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.692058    2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-184.ec2.internal\" not found" node="ip-10-0-134-184.ec2.internal"
May 25 11:22:28.692148 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.692065    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 11:22:28.692148 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.692084    2557 state_mem.go:36] "Initialized new in-memory state store"
May 25 11:22:28.695958 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.695947    2557 policy_none.go:49] "None policy: Start"
May 25 11:22:28.695992 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.695962    2557 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 11:22:28.695992 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.695974    2557 state_mem.go:35] "Initializing new in-memory state store"
May 25 11:22:28.738426 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738409    2557 manager.go:341] "Starting Device Plugin manager"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.738454    2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738464    2557 server.go:85] "Starting device plugin registration server"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738703    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738715    2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738802    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738904    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.738913    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.739324    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 11:22:28.755213 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.739354    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:28.774090 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.774067    2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 11:22:28.774179 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.774092    2557 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 11:22:28.774179 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.774112    2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 11:22:28.774179 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.774122    2557 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 11:22:28.774179 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.774177    2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 11:22:28.777030 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.777015    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:22:28.839198 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.839151    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:22:28.839979 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.839962    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:22:28.840046 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.839993    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:22:28.840046 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.840004    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
May 25 11:22:28.840046 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.840026    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-184.ec2.internal"
May 25 11:22:28.848972 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.848957    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-184.ec2.internal"
May 25 11:22:28.849030 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.848977    2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-184.ec2.internal\": node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:28.870524 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.870506    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:28.874733 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.874706    2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"]
May 25 11:22:28.874778 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.874774    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:22:28.875544 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.875533    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:22:28.875609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.875557    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:22:28.875609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.875566    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
May 25 11:22:28.877845 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.877833    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:22:28.878023 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878008    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:28.878090 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878043    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:22:28.878694 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878672    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:22:28.878767 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878702    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:22:28.878767 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878713    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
May 25 11:22:28.878767 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878673    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:22:28.878862 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878768    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:22:28.878862 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.878782    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
May 25 11:22:28.880818 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.880801    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
May 25 11:22:28.880911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.880832    2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 11:22:28.881418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.881404    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientMemory"
May 25 11:22:28.881511 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.881430    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasNoDiskPressure"
May 25 11:22:28.881511 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.881444    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeHasSufficientPID"
May 25 11:22:28.900616 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.900596    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-184.ec2.internal\" not found" node="ip-10-0-134-184.ec2.internal"
May 25 11:22:28.904955 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.904940    2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-184.ec2.internal\" not found" node="ip-10-0-134-184.ec2.internal"
May 25 11:22:28.971312 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:28.971276    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:28.973509 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.973494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aced91851613fb93e68cce78a526b35c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-184.ec2.internal\" (UID: \"aced91851613fb93e68cce78a526b35c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
May 25 11:22:28.973576 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.973517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1e621fe567b8bd8b90fe608c3826bbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"e1e621fe567b8bd8b90fe608c3826bbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:28.973576 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:28.973536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e621fe567b8bd8b90fe608c3826bbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"e1e621fe567b8bd8b90fe608c3826bbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.072037 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.071997    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.074219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.074203    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aced91851613fb93e68cce78a526b35c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-184.ec2.internal\" (UID: \"aced91851613fb93e68cce78a526b35c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.074262 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.074228    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1e621fe567b8bd8b90fe608c3826bbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"e1e621fe567b8bd8b90fe608c3826bbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.074262 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.074246    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e621fe567b8bd8b90fe608c3826bbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"e1e621fe567b8bd8b90fe608c3826bbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.074342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.074272    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1e621fe567b8bd8b90fe608c3826bbd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"e1e621fe567b8bd8b90fe608c3826bbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.074342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.074299    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aced91851613fb93e68cce78a526b35c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-184.ec2.internal\" (UID: \"aced91851613fb93e68cce78a526b35c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.074342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.074303    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e1e621fe567b8bd8b90fe608c3826bbd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal\" (UID: \"e1e621fe567b8bd8b90fe608c3826bbd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.172212 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.172155    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.203460 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.203432    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.207828 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.207808    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.272393 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.272346    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.372737 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.372713    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.473203 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.473131    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.566521 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.566491    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 11:22:29.567163 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.566664    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:22:29.567163 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.566686    2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 11:22:29.573754 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.573729    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.671277 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.671244    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 11:22:29.671277 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.671245    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 11:17:28 +0000 UTC" deadline="2028-01-26 14:04:00.64142022 +0000 UTC"
May 25 11:22:29.671277 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.671272    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14666h41m30.970150748s"
May 25 11:22:29.673937 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.673914    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.692473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.692449    2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 11:22:29.713308 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.713279    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5q942"
May 25 11:22:29.723174 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.723149    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5q942"
May 25 11:22:29.774099 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:29.774016    2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-184.ec2.internal\" not found"
May 25 11:22:29.813775 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:29.813723    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e621fe567b8bd8b90fe608c3826bbd.slice/crio-ece67d610cbbbccc6b76c6202e446c5f1f93e17fc6fd06836902766ac3d3cea6 WatchSource:0}: Error finding container ece67d610cbbbccc6b76c6202e446c5f1f93e17fc6fd06836902766ac3d3cea6: Status 404 returned error can't find the container with id ece67d610cbbbccc6b76c6202e446c5f1f93e17fc6fd06836902766ac3d3cea6
May 25 11:22:29.813993 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:29.813971    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaced91851613fb93e68cce78a526b35c.slice/crio-6fb690767e5f063e049f417497334bacf588d8ed463aa17f9b46a0e502463297 WatchSource:0}: Error finding container 6fb690767e5f063e049f417497334bacf588d8ed463aa17f9b46a0e502463297: Status 404 returned error can't find the container with id 6fb690767e5f063e049f417497334bacf588d8ed463aa17f9b46a0e502463297
May 25 11:22:29.818424 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.818373    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:22:29.850344 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.850312    2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:22:29.871751 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.871712    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.891236 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.891201    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:22:29.892920 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.892903    2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal"
May 25 11:22:29.905248 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:29.905227    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 11:22:30.188561 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.188421    2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:22:30.644612 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.644578    2557 apiserver.go:52] "Watching apiserver"
May 25 11:22:30.653035 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.652998    2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 11:22:30.653429 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.653403    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-4hvk5","openshift-multus/network-metrics-daemon-64mv4","openshift-network-diagnostics/network-check-target-wv9l4","kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6lr7v","openshift-dns/node-resolver-q2nlv","openshift-network-operator/iptables-alerter-xznrj","openshift-ovn-kubernetes/ovnkube-node-l8s2l","kube-system/konnectivity-agent-pmf9s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb","openshift-image-registry/node-ca-4mq75","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal","openshift-multus/multus-6kjrw"]
May 25 11:22:30.656111 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.656086    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.658223 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.658202    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:30.658326 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.658277    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:30.659211 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.659126    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 11:22:30.659211 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.659124    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 11:22:30.659211 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.659205    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 11:22:30.660052 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.660034    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p4pbr\""
May 25 11:22:30.662681 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.662487    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.662681 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.662506    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.665242 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.664694    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.665242 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.665134    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bphw\""
May 25 11:22:30.665242 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.665197    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 11:22:30.665242 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.665208    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-khzbd\""
May 25 11:22:30.665566 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.665304    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 11:22:30.665566 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.665321    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 11:22:30.665566 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.665353    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 11:22:30.667178 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.667161    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 11:22:30.667783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.667287    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 11:22:30.667783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.667442    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.667783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.667489    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dkbgs\""
May 25 11:22:30.667783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.667503    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 11:22:30.669618 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.669585    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.670270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.670046    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 11:22:30.670270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.670084    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 11:22:30.670270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.670123    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8d5hd\""
May 25 11:22:30.670270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.670133    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 11:22:30.671383 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.671318    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 11:22:30.671383 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.671369    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 11:22:30.671541 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.671430    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 11:22:30.674730 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.673106    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.674730 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.674205    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 11:22:30.674730 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.674464    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cj8f4\""
May 25 11:22:30.674730 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.674506    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 11:22:30.676180 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.675848    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 11:22:30.676180 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.675856    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.676180 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.676157    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nhb9\""
May 25 11:22:30.676377 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.676188    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 11:22:30.676571 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.676547    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 11:22:30.676667 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.676569    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 11:22:30.676667 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.676624    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 11:22:30.678558 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.678305    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p9qdl\""
May 25 11:22:30.678558 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.678503    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 11:22:30.678558 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.678513    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 11:22:30.678704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.678559    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 11:22:30.679816 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.679800    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.682042 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.682021    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:30.682159 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.682090    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:30.682395 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.682366    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 11:22:30.682395 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.682377    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-szzdw\""
May 25 11:22:30.684139 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-kubernetes\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.684225 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684155    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfgqm\" (UniqueName: \"kubernetes.io/projected/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-kube-api-access-gfgqm\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684225 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-os-release\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.684329 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684240    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.684381 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-socket-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.684417 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684383    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-device-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.684417 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684407    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-systemd-units\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684495 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-system-cni-dir\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.684495 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-etc-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684495 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-ovn\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-registration-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.684601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684526    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9sx6\" (UniqueName: \"kubernetes.io/projected/eee122b2-74c0-4806-981d-3062035d87ff-kube-api-access-d9sx6\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.684601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684540    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-run-netns\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-cni-bin\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684593    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysctl-conf\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-kubelet\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684658    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-systemd\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-sys-fs\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-sys\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7827ba33-a921-4235-8465-322650bfb403-etc-tuned\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/848a9419-e49d-4daa-8898-1874ba85ec8d-hosts-file\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-host-slash\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5a2a926-3620-4ce1-94c1-02706cc7b79b-konnectivity-ca\") pod \"konnectivity-agent-pmf9s\" (UID: \"f5a2a926-3620-4ce1-94c1-02706cc7b79b\") " pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-modprobe-d\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.684898 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684883    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovn-node-metrics-cert\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovnkube-script-lib\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.684952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-systemd\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mshjq\" (UniqueName: \"kubernetes.io/projected/7827ba33-a921-4235-8465-322650bfb403-kube-api-access-mshjq\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt7cv\" (UniqueName: \"kubernetes.io/projected/848a9419-e49d-4daa-8898-1874ba85ec8d-kube-api-access-mt7cv\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovnkube-config\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-cnibin\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685111    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685137    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-var-lib-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysconfig\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685258    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-run\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-lib-modules\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7827ba33-a921-4235-8465-322650bfb403-tmp\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685352    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvmpq\" (UniqueName: \"kubernetes.io/projected/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-kube-api-access-bvmpq\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.685376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-slash\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685392    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-node-log\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685440    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-iptables-alerter-script\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-log-socket\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685481    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685502    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-env-overrides\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfx95\" (UniqueName: \"kubernetes.io/projected/5ae70663-4e21-4a19-9101-e418f652c867-kube-api-access-mfx95\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-cni-netd\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysctl-d\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-var-lib-kubelet\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685609    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-host\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5a2a926-3620-4ce1-94c1-02706cc7b79b-agent-certs\") pod \"konnectivity-agent-pmf9s\" (UID: \"f5a2a926-3620-4ce1-94c1-02706cc7b79b\") " pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/848a9419-e49d-4daa-8898-1874ba85ec8d-tmp-dir\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.686089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.685712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.724390 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.724366    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:17:29 +0000 UTC" deadline="2027-12-26 20:18:20.687112879 +0000 UTC"
May 25 11:22:30.724390 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.724388    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13928h55m49.962727418s"
May 25 11:22:30.772980 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.772954    2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 11:22:30.780267 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.780213    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal" event={"ID":"aced91851613fb93e68cce78a526b35c","Type":"ContainerStarted","Data":"6fb690767e5f063e049f417497334bacf588d8ed463aa17f9b46a0e502463297"}
May 25 11:22:30.781281 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.781254    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" event={"ID":"e1e621fe567b8bd8b90fe608c3826bbd","Type":"ContainerStarted","Data":"ece67d610cbbbccc6b76c6202e446c5f1f93e17fc6fd06836902766ac3d3cea6"}
May 25 11:22:30.786058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-socket-dir-parent\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.786176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786065    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-cni-bin\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.786176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786087    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-kubernetes\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.786176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786109    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gfgqm\" (UniqueName: \"kubernetes.io/projected/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-kube-api-access-gfgqm\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.786176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786134    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-cni-multus\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.786176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-hostroot\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-daemon-config\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786201    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-kubernetes\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786217    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-os-release\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786241    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786262    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-socket-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786286    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-device-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786308    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-systemd-units\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786321    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-os-release\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786331    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-etc-kubernetes\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786360    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-system-cni-dir\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786352    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786387    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-systemd-units\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786390    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-device-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.786418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-etc-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786441    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-system-cni-dir\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786482    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-etc-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-ovn\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786529    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-registration-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786551    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-ovn\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786556    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9sx6\" (UniqueName: \"kubernetes.io/projected/eee122b2-74c0-4806-981d-3062035d87ff-kube-api-access-d9sx6\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786585    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-socket-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786603    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-run-netns\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786613    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-registration-dir\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786628    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-cni-bin\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786652    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786657    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-run-netns\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-system-cni-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786698    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-cni-bin\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb489b71-97f3-4f5f-85f6-e6622b92ed23-cni-binary-copy\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786712    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787079 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786729    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysctl-conf\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786754    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-kubelet\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786775    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-systemd\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-kubelet\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-kubelet\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786818    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786879    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-sys-fs\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786880    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-systemd\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786885    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysctl-conf\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786905    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-sys\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786931    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7827ba33-a921-4235-8465-322650bfb403-etc-tuned\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786937    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-sys-fs\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786944    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786954    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/848a9419-e49d-4daa-8898-1874ba85ec8d-hosts-file\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786965    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-sys\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.786981    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-host-slash\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787020    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5a2a926-3620-4ce1-94c1-02706cc7b79b-konnectivity-ca\") pod \"konnectivity-agent-pmf9s\" (UID: \"f5a2a926-3620-4ce1-94c1-02706cc7b79b\") " pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.787812 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787044    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-modprobe-d\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787070    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovn-node-metrics-cert\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787088    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/848a9419-e49d-4daa-8898-1874ba85ec8d-hosts-file\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787070    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-host-slash\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787093    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovnkube-script-lib\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-serviceca\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787171    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljtdg\" (UniqueName: \"kubernetes.io/projected/cb489b71-97f3-4f5f-85f6-e6622b92ed23-kube-api-access-ljtdg\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787200    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-systemd\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787212    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-modprobe-d\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787227    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mshjq\" (UniqueName: \"kubernetes.io/projected/7827ba33-a921-4235-8465-322650bfb403-kube-api-access-mshjq\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787254    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt7cv\" (UniqueName: \"kubernetes.io/projected/848a9419-e49d-4daa-8898-1874ba85ec8d-kube-api-access-mt7cv\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787280    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovnkube-config\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787273    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-k8s-cni-cncf-io\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787334    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-cnibin\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787322    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-systemd\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7lb5\" (UniqueName: \"kubernetes.io/projected/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-kube-api-access-q7lb5\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.788603 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787392    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787420    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787444    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-var-lib-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-cni-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-netns\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rkz8\" (UniqueName: \"kubernetes.io/projected/75775f92-a777-4a28-ac20-efe3d188bacc-kube-api-access-6rkz8\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787547    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysconfig\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787571    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-run\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787595    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-lib-modules\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787619    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7827ba33-a921-4235-8465-322650bfb403-tmp\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787650    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvmpq\" (UniqueName: \"kubernetes.io/projected/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-kube-api-access-bvmpq\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787678    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-slash\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787705    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-node-log\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-cnibin\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787753    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f5a2a926-3620-4ce1-94c1-02706cc7b79b-konnectivity-ca\") pod \"konnectivity-agent-pmf9s\" (UID: \"f5a2a926-3620-4ce1-94c1-02706cc7b79b\") " pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787758    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787757    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovnkube-script-lib\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.789404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787888    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5ae70663-4e21-4a19-9101-e418f652c867-cnibin\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787891    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-run\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787931    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovnkube-config\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.787989    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-var-lib-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788018    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-lib-modules\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788036    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-iptables-alerter-script\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788061    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysconfig\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788077    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-log-socket\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788105    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788136    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-env-overrides\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788164    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-os-release\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-multus-certs\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788222    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788222    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-node-log\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788282    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-log-socket\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788314    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788346    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfx95\" (UniqueName: \"kubernetes.io/projected/5ae70663-4e21-4a19-9101-e418f652c867-kube-api-access-mfx95\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.790224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788348    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-slash\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788383    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-cni-netd\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788416    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-conf-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788457    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysctl-d\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788494    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-var-lib-kubelet\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788522    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-host\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788573    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5a2a926-3620-4ce1-94c1-02706cc7b79b-agent-certs\") pod \"konnectivity-agent-pmf9s\" (UID: \"f5a2a926-3620-4ce1-94c1-02706cc7b79b\") " pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-host\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788653    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788672    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-env-overrides\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788687    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788699    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-cni-netd\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788725    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/848a9419-e49d-4daa-8898-1874ba85ec8d-tmp-dir\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788734    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-var-lib-kubelet\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788775    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-host\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788782    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eee122b2-74c0-4806-981d-3062035d87ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788818    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.790956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788822    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788881    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7827ba33-a921-4235-8465-322650bfb403-etc-sysctl-d\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.788923    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.789003    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-run-openvswitch\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.789197    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/848a9419-e49d-4daa-8898-1874ba85ec8d-tmp-dir\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.789503    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-iptables-alerter-script\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.789608    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5ae70663-4e21-4a19-9101-e418f652c867-cni-binary-copy\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.791046    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7827ba33-a921-4235-8465-322650bfb403-etc-tuned\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.791081    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7827ba33-a921-4235-8465-322650bfb403-tmp\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.791686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.791145    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-ovn-node-metrics-cert\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.792049 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.791834    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f5a2a926-3620-4ce1-94c1-02706cc7b79b-agent-certs\") pod \"konnectivity-agent-pmf9s\" (UID: \"f5a2a926-3620-4ce1-94c1-02706cc7b79b\") " pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:30.794647 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.794626    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:22:30.794806 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.794651    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:22:30.794806 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.794667    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:30.794806 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.794743    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:22:31.294722858 +0000 UTC m=+3.116647070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:30.796825 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.796801    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfgqm\" (UniqueName: \"kubernetes.io/projected/e17079bf-1c65-4f8e-9aa7-378915e6f0b3-kube-api-access-gfgqm\") pod \"ovnkube-node-l8s2l\" (UID: \"e17079bf-1c65-4f8e-9aa7-378915e6f0b3\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:30.797821 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.797801    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvmpq\" (UniqueName: \"kubernetes.io/projected/3dd23a98-c4c7-4dc5-bce7-0401cb994dc5-kube-api-access-bvmpq\") pod \"iptables-alerter-xznrj\" (UID: \"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5\") " pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:30.797919 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.797824    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mshjq\" (UniqueName: \"kubernetes.io/projected/7827ba33-a921-4235-8465-322650bfb403-kube-api-access-mshjq\") pod \"tuned-6lr7v\" (UID: \"7827ba33-a921-4235-8465-322650bfb403\") " pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.797992 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.797976    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt7cv\" (UniqueName: \"kubernetes.io/projected/848a9419-e49d-4daa-8898-1874ba85ec8d-kube-api-access-mt7cv\") pod \"node-resolver-q2nlv\" (UID: \"848a9419-e49d-4daa-8898-1874ba85ec8d\") " pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.798443 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.798416    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9sx6\" (UniqueName: \"kubernetes.io/projected/eee122b2-74c0-4806-981d-3062035d87ff-kube-api-access-d9sx6\") pod \"aws-ebs-csi-driver-node-clskb\" (UID: \"eee122b2-74c0-4806-981d-3062035d87ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.799400 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.799377    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfx95\" (UniqueName: \"kubernetes.io/projected/5ae70663-4e21-4a19-9101-e418f652c867-kube-api-access-mfx95\") pod \"multus-additional-cni-plugins-4hvk5\" (UID: \"5ae70663-4e21-4a19-9101-e418f652c867\") " pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:30.809086 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.809066    2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:22:30.890182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890089    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-os-release\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890145    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-multus-certs\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890177    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890207    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-conf-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890236    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-host\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890210    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-os-release\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890268    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-socket-dir-parent\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890293    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-cni-bin\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890305    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-conf-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890325    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-cni-multus\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890312    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-host\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890380    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-cni-bin\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.890384    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890392    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-socket-dir-parent\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890414    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-multus-certs\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.890430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890431    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-cni-multus\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:30.890443    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:22:31.390423555 +0000 UTC m=+3.212347753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890467    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-hostroot\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890490    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-daemon-config\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890508    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-hostroot\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890516    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-etc-kubernetes\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890550    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-etc-kubernetes\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890561    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-system-cni-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890588    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb489b71-97f3-4f5f-85f6-e6622b92ed23-cni-binary-copy\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890618    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-kubelet\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890653    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-serviceca\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890667    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-system-cni-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890678    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljtdg\" (UniqueName: \"kubernetes.io/projected/cb489b71-97f3-4f5f-85f6-e6622b92ed23-kube-api-access-ljtdg\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890791    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-k8s-cni-cncf-io\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890822    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7lb5\" (UniqueName: \"kubernetes.io/projected/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-kube-api-access-q7lb5\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890850    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-cni-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890890    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-netns\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890920    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6rkz8\" (UniqueName: \"kubernetes.io/projected/75775f92-a777-4a28-ac20-efe3d188bacc-kube-api-access-6rkz8\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.890961    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-cnibin\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891066    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-cnibin\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891131    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-cni-dir\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891164    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cb489b71-97f3-4f5f-85f6-e6622b92ed23-multus-daemon-config\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891171    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-netns\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891200    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cb489b71-97f3-4f5f-85f6-e6622b92ed23-cni-binary-copy\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891238    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-run-k8s-cni-cncf-io\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891246    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb489b71-97f3-4f5f-85f6-e6622b92ed23-host-var-lib-kubelet\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.891881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.891498    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-serviceca\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.902106 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.902075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljtdg\" (UniqueName: \"kubernetes.io/projected/cb489b71-97f3-4f5f-85f6-e6622b92ed23-kube-api-access-ljtdg\") pod \"multus-6kjrw\" (UID: \"cb489b71-97f3-4f5f-85f6-e6622b92ed23\") " pod="openshift-multus/multus-6kjrw"
May 25 11:22:30.902301 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.902276    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7lb5\" (UniqueName: \"kubernetes.io/projected/931b2d21-9dcd-4749-82e8-2ab1c0ac9179-kube-api-access-q7lb5\") pod \"node-ca-4mq75\" (UID: \"931b2d21-9dcd-4749-82e8-2ab1c0ac9179\") " pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:30.902373 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.902332    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rkz8\" (UniqueName: \"kubernetes.io/projected/75775f92-a777-4a28-ac20-efe3d188bacc-kube-api-access-6rkz8\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:30.972097 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.972063    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb"
May 25 11:22:30.982012 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.981986    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6lr7v"
May 25 11:22:30.990685 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.990661    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q2nlv"
May 25 11:22:30.997123 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:30.997095    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xznrj"
May 25 11:22:31.003908 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.003880    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:31.009619 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.009595    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:31.016187 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.016158    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4hvk5"
May 25 11:22:31.024689 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.024658    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4mq75"
May 25 11:22:31.030359 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.030336    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6kjrw"
May 25 11:22:31.133538 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.133509    2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 11:22:31.393593 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.393562    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:31.393772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.393610    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:31.393772 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:31.393763    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:22:31.393912 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:31.393788    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:22:31.393912 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:31.393801    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:31.393912 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:31.393827    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:31.393912 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:31.393861    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:22:32.393846579 +0000 UTC m=+4.215770780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:31.393912 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:31.393905    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:22:32.39388682 +0000 UTC m=+4.215811026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:31.493046 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:31.493015    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7827ba33_a921_4235_8465_322650bfb403.slice/crio-6c07373ed3a3db01722239a575abf92c062ad5b01c45017b4d0fbd2955a766ad WatchSource:0}: Error finding container 6c07373ed3a3db01722239a575abf92c062ad5b01c45017b4d0fbd2955a766ad: Status 404 returned error can't find the container with id 6c07373ed3a3db01722239a575abf92c062ad5b01c45017b4d0fbd2955a766ad
May 25 11:22:31.494321 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:31.494292    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee122b2_74c0_4806_981d_3062035d87ff.slice/crio-3e5b533114628f50954c8525e017552a12572efa3ca216c3d14fd46c365820ee WatchSource:0}: Error finding container 3e5b533114628f50954c8525e017552a12572efa3ca216c3d14fd46c365820ee: Status 404 returned error can't find the container with id 3e5b533114628f50954c8525e017552a12572efa3ca216c3d14fd46c365820ee
May 25 11:22:31.498063 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:31.497979    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931b2d21_9dcd_4749_82e8_2ab1c0ac9179.slice/crio-47cd31c41c1ae97b3afbcb3c444633f2d3eb2718a556cdea5d6bc3e37a5e0a2f WatchSource:0}: Error finding container 47cd31c41c1ae97b3afbcb3c444633f2d3eb2718a556cdea5d6bc3e37a5e0a2f: Status 404 returned error can't find the container with id 47cd31c41c1ae97b3afbcb3c444633f2d3eb2718a556cdea5d6bc3e37a5e0a2f
May 25 11:22:31.498737 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:31.498699    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd23a98_c4c7_4dc5_bce7_0401cb994dc5.slice/crio-06e93b237e986eeac9fe5a4a91fb980f1073c5a367fbec2201956d8ef60b4aa6 WatchSource:0}: Error finding container 06e93b237e986eeac9fe5a4a91fb980f1073c5a367fbec2201956d8ef60b4aa6: Status 404 returned error can't find the container with id 06e93b237e986eeac9fe5a4a91fb980f1073c5a367fbec2201956d8ef60b4aa6
May 25 11:22:31.504679 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:31.504629    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848a9419_e49d_4daa_8898_1874ba85ec8d.slice/crio-a93f53b3adf952e2715efac8fc1032e9d707687714d3a89a38f1a68e0b837ea7 WatchSource:0}: Error finding container a93f53b3adf952e2715efac8fc1032e9d707687714d3a89a38f1a68e0b837ea7: Status 404 returned error can't find the container with id a93f53b3adf952e2715efac8fc1032e9d707687714d3a89a38f1a68e0b837ea7
May 25 11:22:31.506374 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:22:31.505838    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17079bf_1c65_4f8e_9aa7_378915e6f0b3.slice/crio-e71ccfa89d4fdebd5a7c0ec06d1d88bee518bb071652c69d4348d08d96f1f0ff WatchSource:0}: Error finding container e71ccfa89d4fdebd5a7c0ec06d1d88bee518bb071652c69d4348d08d96f1f0ff: Status 404 returned error can't find the container with id e71ccfa89d4fdebd5a7c0ec06d1d88bee518bb071652c69d4348d08d96f1f0ff
May 25 11:22:31.725590 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.725453    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 11:17:29 +0000 UTC" deadline="2028-01-28 20:34:37.162355734 +0000 UTC"
May 25 11:22:31.725590 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.725493    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14721h12m5.436866127s"
May 25 11:22:31.783775 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.783734    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q2nlv" event={"ID":"848a9419-e49d-4daa-8898-1874ba85ec8d","Type":"ContainerStarted","Data":"a93f53b3adf952e2715efac8fc1032e9d707687714d3a89a38f1a68e0b837ea7"}
May 25 11:22:31.784704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.784678    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4mq75" event={"ID":"931b2d21-9dcd-4749-82e8-2ab1c0ac9179","Type":"ContainerStarted","Data":"47cd31c41c1ae97b3afbcb3c444633f2d3eb2718a556cdea5d6bc3e37a5e0a2f"}
May 25 11:22:31.786026 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.785995    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal" event={"ID":"aced91851613fb93e68cce78a526b35c","Type":"ContainerStarted","Data":"7d0b2e367bae9cfc16870f0f107bb513e8c485a31520be25766b5625475d4437"}
May 25 11:22:31.787100 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.787077    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xznrj" event={"ID":"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5","Type":"ContainerStarted","Data":"06e93b237e986eeac9fe5a4a91fb980f1073c5a367fbec2201956d8ef60b4aa6"}
May 25 11:22:31.787982 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.787964    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerStarted","Data":"65cd9ce5510201657078bcd641ca8c2e63f89751a33dae1c6e5b354920ea1652"}
May 25 11:22:31.788909 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.788891    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pmf9s" event={"ID":"f5a2a926-3620-4ce1-94c1-02706cc7b79b","Type":"ContainerStarted","Data":"f337aa40e70115065cd30003535d178fada59bd58e73a9f866d834a592650c38"}
May 25 11:22:31.789767 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.789746    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb" event={"ID":"eee122b2-74c0-4806-981d-3062035d87ff","Type":"ContainerStarted","Data":"3e5b533114628f50954c8525e017552a12572efa3ca216c3d14fd46c365820ee"}
May 25 11:22:31.790625 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.790596    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6lr7v" event={"ID":"7827ba33-a921-4235-8465-322650bfb403","Type":"ContainerStarted","Data":"6c07373ed3a3db01722239a575abf92c062ad5b01c45017b4d0fbd2955a766ad"}
May 25 11:22:31.791469 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.791441    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"e71ccfa89d4fdebd5a7c0ec06d1d88bee518bb071652c69d4348d08d96f1f0ff"}
May 25 11:22:31.792511 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.792489    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6kjrw" event={"ID":"cb489b71-97f3-4f5f-85f6-e6622b92ed23","Type":"ContainerStarted","Data":"10cc237e4d8c859c02a6c4f2032d62edb8d7f31d4e9b8a2699ba47f25f28bb90"}
May 25 11:22:31.806112 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:31.806058    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-184.ec2.internal" podStartSLOduration=2.806040792 podStartE2EDuration="2.806040792s" podCreationTimestamp="2026-05-25 11:22:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:22:31.805439346 +0000 UTC m=+3.627363557" watchObservedRunningTime="2026-05-25 11:22:31.806040792 +0000 UTC m=+3.627965013"
May 25 11:22:32.400881 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:32.400832    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:32.401053 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:32.400900    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:32.401053 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.401037    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:32.401183 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.401096    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:22:34.401078168 +0000 UTC m=+6.223002374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:32.401183 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.401177    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:22:32.401297 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.401191    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:22:32.401297 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.401203    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:32.401297 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.401237    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:22:34.401225525 +0000 UTC m=+6.223149740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:32.774805 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:32.774730    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:32.775257 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.774881    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:32.775359 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:32.775334    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:32.775506 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:32.775484    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:32.804416 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:32.803339    2557 generic.go:358] "Generic (PLEG): container finished" podID="e1e621fe567b8bd8b90fe608c3826bbd" containerID="fdbc1ea0c47a322c87efe36d6ae3489b00ab6a7b5591c12142e99e07016286e6" exitCode=0
May 25 11:22:32.804416 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:32.803924    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" event={"ID":"e1e621fe567b8bd8b90fe608c3826bbd","Type":"ContainerDied","Data":"fdbc1ea0c47a322c87efe36d6ae3489b00ab6a7b5591c12142e99e07016286e6"}
May 25 11:22:33.814889 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:33.814252    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" event={"ID":"e1e621fe567b8bd8b90fe608c3826bbd","Type":"ContainerStarted","Data":"1e73547dccb7cdea457f0f957c7090d22d9bb5ed35cfdcd502309dd5388097af"}
May 25 11:22:34.416225 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:34.416184    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:34.416405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:34.416241    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:34.416405 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.416368    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:34.416517 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.416429    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:22:38.416411665 +0000 UTC m=+10.238335867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:34.416886 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.416857    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:22:34.416986 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.416892    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:22:34.416986 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.416906    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:34.416986 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.416952    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:22:38.416937305 +0000 UTC m=+10.238861509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:34.775668 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:34.775088    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:34.775668 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.775211    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:34.775668 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:34.775564    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:34.776035 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:34.775707    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:36.775234 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:36.775202    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:36.775665 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:36.775349    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:36.775665 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:36.775575    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:36.775781 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:36.775679    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:38.447538 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:38.447489    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:38.447552    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.447657    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.447684    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.447699    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.447682    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.447761    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:22:46.447740778 +0000 UTC m=+18.269664977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:38.448007 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.447807    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:22:46.447789488 +0000 UTC m=+18.269713703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:38.775550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:38.775474    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:38.775550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:38.775499    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:38.775758 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.775616    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:38.775758 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:38.775725    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:40.774934 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:40.774898    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:40.774934 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:40.774928    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:40.775425 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:40.775034    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:40.775425 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:40.775163    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:42.774644 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:42.774610    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:42.775066 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:42.774612    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:42.775066 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:42.774745    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:42.775066 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:42.774781    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:44.775088 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:44.775053    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:44.775419 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:44.775059    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:44.775419 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:44.775158    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:44.775419 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:44.775240    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:46.511835 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:46.511801    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:46.511835 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:46.511844    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:46.512402 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.511965    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:46.512402 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.511981    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:22:46.512402 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.511999    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:22:46.512402 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.512011    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:46.512402 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.512030    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:23:02.512011401 +0000 UTC m=+34.333935602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:22:46.512402 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.512045    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:23:02.512035867 +0000 UTC m=+34.333960080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:22:46.774560 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:46.774482    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:46.774715 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:46.774480    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:46.774715 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.774629    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:46.774715 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:46.774678    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:48.775779 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:48.775746    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:48.776254 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:48.775853    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:48.776254 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:48.775951    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:48.776254 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:48.776090    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:49.844053 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.843502    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6lr7v" event={"ID":"7827ba33-a921-4235-8465-322650bfb403","Type":"ContainerStarted","Data":"726e7416f68df591d92fd9d10ba0875d907599ca6d59f0c219aa2139483bc532"}
May 25 11:22:49.845535 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.845506    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"c47862a9bc5063db343c8cbba7d27c8b9d133299d35125f2b27e295596ecd8e7"}
May 25 11:22:49.845653 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.845540    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"0ae707861cf8da4647516c0b237f2bf822bd9255683ff9d1fb4edac66bb213f8"}
May 25 11:22:49.846988 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.846955    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6kjrw" event={"ID":"cb489b71-97f3-4f5f-85f6-e6622b92ed23","Type":"ContainerStarted","Data":"870cc4586ddb4e172c9c65c2feb79aef0539054af59d71398d14d74b4a807627"}
May 25 11:22:49.848233 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.848206    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q2nlv" event={"ID":"848a9419-e49d-4daa-8898-1874ba85ec8d","Type":"ContainerStarted","Data":"474164e9d27bfcc05c03eeded4450b9809b2791b207c977fd7ddefd3ab30ac91"}
May 25 11:22:49.849640 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.849617    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4mq75" event={"ID":"931b2d21-9dcd-4749-82e8-2ab1c0ac9179","Type":"ContainerStarted","Data":"9bbabbaacdfce785b2a90fbb5f0e9b6ad2a1962d94330376e8bc46ed813918c5"}
May 25 11:22:49.851456 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.851436    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ae70663-4e21-4a19-9101-e418f652c867" containerID="f907fb12035f4dbd18885941f6912febd88e54578bd2aed93ce8dd76c8f7878c" exitCode=0
May 25 11:22:49.851536 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.851490    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerDied","Data":"f907fb12035f4dbd18885941f6912febd88e54578bd2aed93ce8dd76c8f7878c"}
May 25 11:22:49.852921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.852837    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pmf9s" event={"ID":"f5a2a926-3620-4ce1-94c1-02706cc7b79b","Type":"ContainerStarted","Data":"5b1eb5d251e2145b3b18a8d023357398a4eec6b207c45d8fb66571ba5a3e3155"}
May 25 11:22:49.856032 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.855997    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb" event={"ID":"eee122b2-74c0-4806-981d-3062035d87ff","Type":"ContainerStarted","Data":"fe082a6ce0a114c3107cd5fe1e2330db340cd22a09c03cebd4720af5150cc813"}
May 25 11:22:49.876442 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.876404    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-184.ec2.internal" podStartSLOduration=20.876390891 podStartE2EDuration="20.876390891s" podCreationTimestamp="2026-05-25 11:22:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:22:33.838535518 +0000 UTC m=+5.660459742" watchObservedRunningTime="2026-05-25 11:22:49.876390891 +0000 UTC m=+21.698315110"
May 25 11:22:49.903039 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.902945    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6lr7v" podStartSLOduration=3.863751471 podStartE2EDuration="21.902832714s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.49540313 +0000 UTC m=+3.317327330" lastFinishedPulling="2026-05-25 11:22:49.53448436 +0000 UTC m=+21.356408573" observedRunningTime="2026-05-25 11:22:49.877841636 +0000 UTC m=+21.699765857" watchObservedRunningTime="2026-05-25 11:22:49.902832714 +0000 UTC m=+21.724756941"
May 25 11:22:49.903199 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.903165    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-q2nlv" podStartSLOduration=4.220873307 podStartE2EDuration="21.90315608s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.507258655 +0000 UTC m=+3.329182853" lastFinishedPulling="2026-05-25 11:22:49.189541417 +0000 UTC m=+21.011465626" observedRunningTime="2026-05-25 11:22:49.901538599 +0000 UTC m=+21.723462821" watchObservedRunningTime="2026-05-25 11:22:49.90315608 +0000 UTC m=+21.725080355"
May 25 11:22:49.941394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:49.941349    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pmf9s" podStartSLOduration=3.935033083 podStartE2EDuration="21.941334728s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.504634426 +0000 UTC m=+3.326558626" lastFinishedPulling="2026-05-25 11:22:49.510936068 +0000 UTC m=+21.332860271" observedRunningTime="2026-05-25 11:22:49.940654796 +0000 UTC m=+21.762579017" watchObservedRunningTime="2026-05-25 11:22:49.941334728 +0000 UTC m=+21.763258947"
May 25 11:22:50.016092 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.015963    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4mq75" podStartSLOduration=8.711683098 podStartE2EDuration="22.015949266s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.500256742 +0000 UTC m=+3.322180947" lastFinishedPulling="2026-05-25 11:22:44.804522903 +0000 UTC m=+16.626447115" observedRunningTime="2026-05-25 11:22:50.015783093 +0000 UTC m=+21.837707312" watchObservedRunningTime="2026-05-25 11:22:50.015949266 +0000 UTC m=+21.837873486"
May 25 11:22:50.041111 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.041066    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-6kjrw" podStartSLOduration=3.9507339420000003 podStartE2EDuration="22.041051555s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.504610968 +0000 UTC m=+3.326535180" lastFinishedPulling="2026-05-25 11:22:49.594928583 +0000 UTC m=+21.416852793" observedRunningTime="2026-05-25 11:22:50.040711242 +0000 UTC m=+21.862635461" watchObservedRunningTime="2026-05-25 11:22:50.041051555 +0000 UTC m=+21.862975774"
May 25 11:22:50.774975 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.774943    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:50.775215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.774943    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:50.775215 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:50.775069    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:50.775215 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:50.775200    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:50.861477 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.861447    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"ed33de7debcfb08b304888bec444abf5d05712ed4966e09b7af2625f267981fd"}
May 25 11:22:50.861815 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.861481    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"b9dccbb41ff817c706ecfe0d58e724f5a51d4724f2f4e9596b1cb70313548c50"}
May 25 11:22:50.861815 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.861491    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"022535f88c4435cbae51e0067df140744eda744bb7ccd62f6d600b687b5f910e"}
May 25 11:22:50.861815 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:50.861498    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"b3dcf848829d3c3c05ae44bfb6dc33db50fd5e2efabf18981ee6a9612c58ee16"}
May 25 11:22:51.073493 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.073470    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 11:22:51.750859 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.750745    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T11:22:51.073488105Z","UUID":"072e4b11-ead0-48e0-ac49-1319422fa71a","Handler":null,"Name":"","Endpoint":""}
May 25 11:22:51.754446 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.754405    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 11:22:51.754446 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.754436    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 11:22:51.864796 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.864757    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xznrj" event={"ID":"3dd23a98-c4c7-4dc5-bce7-0401cb994dc5","Type":"ContainerStarted","Data":"8b61b415d760480b78077c694de44d68a219692c218c1cc3231382aff347a1be"}
May 25 11:22:51.866748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.866713    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb" event={"ID":"eee122b2-74c0-4806-981d-3062035d87ff","Type":"ContainerStarted","Data":"71d66ea4e47607c2cf77e39c546fea7c4528f26a4d9d478f9bd436500dbf72a3"}
May 25 11:22:51.881914 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:51.881856    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xznrj" podStartSLOduration=6.197074652 podStartE2EDuration="23.881840229s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.50481054 +0000 UTC m=+3.326734745" lastFinishedPulling="2026-05-25 11:22:49.189576117 +0000 UTC m=+21.011500322" observedRunningTime="2026-05-25 11:22:51.881602576 +0000 UTC m=+23.703526820" watchObservedRunningTime="2026-05-25 11:22:51.881840229 +0000 UTC m=+23.703764450"
May 25 11:22:52.455616 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.455543    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:52.456104 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.456083    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:52.775572 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.775343    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:52.775724 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.775354    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:52.775724 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:52.775612    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:52.775819 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:52.775717    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:52.873016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.872977    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb" event={"ID":"eee122b2-74c0-4806-981d-3062035d87ff","Type":"ContainerStarted","Data":"1f77074f059fddb4da144ff101cf9ef3b851d57d2c62eb13ad8e746ad9ea4a8f"}
May 25 11:22:52.877511 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.877483    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"6fdd82db34039da04f02d95bf07ebd624cfd6488bcb2c2e2c4852e68447f7d11"}
May 25 11:22:52.877899 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.877852    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:52.878347 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.878329    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pmf9s"
May 25 11:22:52.900281 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:52.900228    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clskb" podStartSLOduration=4.49195947 podStartE2EDuration="24.900213172s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.496677015 +0000 UTC m=+3.318601213" lastFinishedPulling="2026-05-25 11:22:51.904930712 +0000 UTC m=+23.726854915" observedRunningTime="2026-05-25 11:22:52.899233307 +0000 UTC m=+24.721157530" watchObservedRunningTime="2026-05-25 11:22:52.900213172 +0000 UTC m=+24.722137392"
May 25 11:22:54.777178 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:54.777154    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:54.777721 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:54.777158    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:54.777721 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:54.777250    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:54.777721 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:54.777350    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:55.884829 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.884659    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ae70663-4e21-4a19-9101-e418f652c867" containerID="a87746d9874881527dbbc14ef88d516c9998b848b083e864448f775841e11b8c" exitCode=0
May 25 11:22:55.885357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.884747    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerDied","Data":"a87746d9874881527dbbc14ef88d516c9998b848b083e864448f775841e11b8c"}
May 25 11:22:55.888033 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.888002    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" event={"ID":"e17079bf-1c65-4f8e-9aa7-378915e6f0b3","Type":"ContainerStarted","Data":"d93e72b46d77eb8756fe12bcdad1e523727d3e852a854f4d1571b0f3e6ec9428"}
May 25 11:22:55.888344 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.888322    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:55.888420 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.888357    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:55.903500 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.903482    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:55.903595 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.903538    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:55.945570 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:55.945527    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l" podStartSLOduration=9.863399036 podStartE2EDuration="27.945517413s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.507846045 +0000 UTC m=+3.329770258" lastFinishedPulling="2026-05-25 11:22:49.589964423 +0000 UTC m=+21.411888635" observedRunningTime="2026-05-25 11:22:55.943550863 +0000 UTC m=+27.765475082" watchObservedRunningTime="2026-05-25 11:22:55.945517413 +0000 UTC m=+27.767441632"
May 25 11:22:56.777921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:56.777895    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:56.778088 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:56.777937    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:56.778088 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:56.778042    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:56.778219 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:56.778139    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:56.889712 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:56.889683    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 25 11:22:56.993418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:56.993155    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:22:57.133900 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:57.133816    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wv9l4"]
May 25 11:22:57.133991 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:57.133950    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:57.134091 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:57.134065    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:57.140699 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:57.140678    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64mv4"]
May 25 11:22:57.140787 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:57.140758    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:57.140851 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:57.140836    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:57.892794 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:57.892761    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ae70663-4e21-4a19-9101-e418f652c867" containerID="0a34602b1897cfd8e80286de8f96e5293b990fd8a7bdcc36e310b3099e457a44" exitCode=0
May 25 11:22:57.893152 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:57.892850    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerDied","Data":"0a34602b1897cfd8e80286de8f96e5293b990fd8a7bdcc36e310b3099e457a44"}
May 25 11:22:58.777240 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:58.777098    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:22:58.777371 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:58.777105    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:22:58.777371 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:58.777307    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:22:58.777444 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:22:58.777383    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:22:58.896552 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:58.896518    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ae70663-4e21-4a19-9101-e418f652c867" containerID="3512e6db3a987752e32adea974f195264f4a874c52815cf0009fa5b58da32a83" exitCode=0
May 25 11:22:58.897087 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:22:58.896580    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerDied","Data":"3512e6db3a987752e32adea974f195264f4a874c52815cf0009fa5b58da32a83"}
May 25 11:23:00.777724 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:00.777650    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:00.777724 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:00.777669    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:23:00.778181 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:00.777773    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wv9l4" podUID="1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf"
May 25 11:23:00.778181 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:00.777932    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:23:02.468609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.468577    2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-184.ec2.internal" event="NodeReady"
May 25 11:23:02.469160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.468726    2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 11:23:02.526921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.526880    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qxpvv"]
May 25 11:23:02.531798 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.531765    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:02.531970 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.531814    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:23:02.531970 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.531948    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 11:23:02.531970 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.531959    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:02.531970 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.531971    2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 11:23:02.532173 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.531984    2557 projected.go:194] Error preparing data for projected volume kube-api-access-gxjdw for pod openshift-network-diagnostics/network-check-target-wv9l4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:02.532173 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.532020    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:23:34.532002547 +0000 UTC m=+66.353926744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 11:23:02.532173 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.532041    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw podName:1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf nodeName:}" failed. No retries permitted until 2026-05-25 11:23:34.532030666 +0000 UTC m=+66.353954866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gxjdw" (UniqueName: "kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw") pod "network-check-target-wv9l4" (UID: "1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 11:23:02.558488 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.558455    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lsz24"]
May 25 11:23:02.558649 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.558627    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.565678 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.565655    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 11:23:02.565822 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.565741    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 11:23:02.566080 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.566061    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mbq6k\""
May 25 11:23:02.571941 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.571918    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qxpvv"]
May 25 11:23:02.572047 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.571947    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lsz24"]
May 25 11:23:02.572095 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.572051    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:02.574911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.574817    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7v95\""
May 25 11:23:02.575023 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.574935    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 11:23:02.575239 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.575222    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 11:23:02.575557 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.575539    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 11:23:02.632172 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.632137    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e96b221-0e15-482c-9090-21eb29d5ae79-tmp-dir\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.632346 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.632209    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.632346 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.632255    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sll7k\" (UniqueName: \"kubernetes.io/projected/5e96b221-0e15-482c-9090-21eb29d5ae79-kube-api-access-sll7k\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.632346 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.632279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e96b221-0e15-482c-9090-21eb29d5ae79-config-volume\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.732704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.732612    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:02.732704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.732657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqpvv\" (UniqueName: \"kubernetes.io/projected/f5d855d2-7bec-4015-9d26-2057cf2e20b4-kube-api-access-wqpvv\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:02.732704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.732691    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sll7k\" (UniqueName: \"kubernetes.io/projected/5e96b221-0e15-482c-9090-21eb29d5ae79-kube-api-access-sll7k\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.733049 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.732711    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e96b221-0e15-482c-9090-21eb29d5ae79-config-volume\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.733049 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.732769    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e96b221-0e15-482c-9090-21eb29d5ae79-tmp-dir\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.733049 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.732837    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.733049 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.732953    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:02.733049 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.733017    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:03.232998712 +0000 UTC m=+35.054922918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:02.733301 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.733146    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e96b221-0e15-482c-9090-21eb29d5ae79-tmp-dir\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.733355 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.733341    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5e96b221-0e15-482c-9090-21eb29d5ae79-config-volume\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.745811 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.745778    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sll7k\" (UniqueName: \"kubernetes.io/projected/5e96b221-0e15-482c-9090-21eb29d5ae79-kube-api-access-sll7k\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:02.774965 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.774926    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:02.775383 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.775194    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:23:02.781055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.781033    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:23:02.781184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.781033    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:23:02.781184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.781085    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4v4p\""
May 25 11:23:02.781184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.781088    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brg2t\""
May 25 11:23:02.781468 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.781440    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:23:02.834012 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.833977    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:02.834012 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.834019    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqpvv\" (UniqueName: \"kubernetes.io/projected/f5d855d2-7bec-4015-9d26-2057cf2e20b4-kube-api-access-wqpvv\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:02.834276 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.834159    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:02.834276 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:02.834239    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:03.334216691 +0000 UTC m=+35.156140912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:02.846413 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:02.846374    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqpvv\" (UniqueName: \"kubernetes.io/projected/f5d855d2-7bec-4015-9d26-2057cf2e20b4-kube-api-access-wqpvv\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:03.237332 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:03.237296    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:03.237529 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:03.237416    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:03.237529 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:03.237475    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:04.237457303 +0000 UTC m=+36.059381500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:03.338374 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:03.338329    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:03.338563 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:03.338512    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:03.338628 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:03.338599    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:04.338573471 +0000 UTC m=+36.160497671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:04.243915 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:04.243823    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:04.244414 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:04.243991    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:04.244414 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:04.244071    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:06.24405127 +0000 UTC m=+38.065975469 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:04.344607 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:04.344570    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:04.345075 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:04.345053    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:04.345182 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:04.345139    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:06.345117701 +0000 UTC m=+38.167041913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:05.911587 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:05.911373    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ae70663-4e21-4a19-9101-e418f652c867" containerID="a4cfb7d010e29d92c53989361831c85638a2d09d422983617d993fcb324521d4" exitCode=0
May 25 11:23:05.911587 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:05.911451    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerDied","Data":"a4cfb7d010e29d92c53989361831c85638a2d09d422983617d993fcb324521d4"}
May 25 11:23:06.261237 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:06.261160    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:06.261381 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:06.261301    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:06.261381 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:06.261366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:10.261350306 +0000 UTC m=+42.083274507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:06.361658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:06.361630    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:06.361788 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:06.361760    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:06.361835 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:06.361809    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:10.361795748 +0000 UTC m=+42.183719947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:06.915770 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:06.915743    2557 generic.go:358] "Generic (PLEG): container finished" podID="5ae70663-4e21-4a19-9101-e418f652c867" containerID="794fccedbdcdcb03c0bc23dc48b813ef91e92ffc5bdf5ba23d6d27e1a5955f89" exitCode=0
May 25 11:23:06.916099 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:06.915793    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerDied","Data":"794fccedbdcdcb03c0bc23dc48b813ef91e92ffc5bdf5ba23d6d27e1a5955f89"}
May 25 11:23:07.920543 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:07.920510    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" event={"ID":"5ae70663-4e21-4a19-9101-e418f652c867","Type":"ContainerStarted","Data":"ac3e19820e0036c4727403687511b6773ed9bc6bf32a8a561564db9c4255218c"}
May 25 11:23:07.949089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:07.949030    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4hvk5" podStartSLOduration=6.584925312 podStartE2EDuration="39.949013131s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:22:31.508069453 +0000 UTC m=+3.329993654" lastFinishedPulling="2026-05-25 11:23:04.87215727 +0000 UTC m=+36.694081473" observedRunningTime="2026-05-25 11:23:07.94729248 +0000 UTC m=+39.769216701" watchObservedRunningTime="2026-05-25 11:23:07.949013131 +0000 UTC m=+39.770937381"
May 25 11:23:10.290651 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:10.290614    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:10.291069 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:10.290737    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:10.291069 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:10.290786    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:18.290771997 +0000 UTC m=+50.112696195 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:10.391729 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:10.391696    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:10.391892 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:10.391810    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:10.391892 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:10.391858    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:18.391844307 +0000 UTC m=+50.213768504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:18.345850 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:18.345818    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:18.346275 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:18.345939    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:18.346275 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:18.346005    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:34.345989348 +0000 UTC m=+66.167913564 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:18.446935 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:18.446911    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:18.447054 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:18.446998    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:18.447054 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:18.447048    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:23:34.447033643 +0000 UTC m=+66.268957841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:28.906219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:28.906193    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8s2l"
May 25 11:23:29.272049 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.271974    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fddpw"]
May 25 11:23:29.274622 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.274607    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.277357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.277342    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 11:23:29.281673 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.281650    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fddpw"]
May 25 11:23:29.319683 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.319657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-dbus\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.319776 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.319699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-kubelet-config\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.319776 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.319716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-original-pull-secret\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.420986 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.420960    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-dbus\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.421076 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.421002    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-kubelet-config\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.421076 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.421018    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-original-pull-secret\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.421147 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.421096    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-kubelet-config\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.421180 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.421145    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-dbus\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.423945 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.423922    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69-original-pull-secret\") pod \"global-pull-secret-syncer-fddpw\" (UID: \"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69\") " pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.583407 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.583388    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddpw"
May 25 11:23:29.707993 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.707960    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fddpw"]
May 25 11:23:29.713528 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:23:29.713504    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9ff3f0_2085_4fbf_a1b9_42ca8df41c69.slice/crio-e2dba8def4cb896dc8552674b9e5449ced261f28a95c223852ccffd0faca1e5c WatchSource:0}: Error finding container e2dba8def4cb896dc8552674b9e5449ced261f28a95c223852ccffd0faca1e5c: Status 404 returned error can't find the container with id e2dba8def4cb896dc8552674b9e5449ced261f28a95c223852ccffd0faca1e5c
May 25 11:23:29.961657 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:29.961581    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fddpw" event={"ID":"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69","Type":"ContainerStarted","Data":"e2dba8def4cb896dc8552674b9e5449ced261f28a95c223852ccffd0faca1e5c"}
May 25 11:23:33.969789 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:33.969702    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fddpw" event={"ID":"9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69","Type":"ContainerStarted","Data":"228e7b2647ba65aad59ad9be14c43ec36bc1438936a8d1809ee5800913c12910"}
May 25 11:23:34.355679 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.355647    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:23:34.355835 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:34.355793    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:23:34.355895 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:34.355854    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:06.355837677 +0000 UTC m=+98.177761882 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:23:34.456745 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.456700    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:23:34.456918 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:34.456849    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:23:34.456963 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:34.456932    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:06.456915735 +0000 UTC m=+98.278839943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:23:34.557677 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.557650    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:34.557742 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.557688    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:23:34.560654 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.560631    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 11:23:34.560708 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.560635    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 11:23:34.568001 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:34.567983    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 11:23:34.568069 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:23:34.568061    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:24:38.56803942 +0000 UTC m=+130.389963634 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : secret "metrics-daemon-secret" not found
May 25 11:23:34.571073 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.571054    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 11:23:34.580704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.580679    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxjdw\" (UniqueName: \"kubernetes.io/projected/1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf-kube-api-access-gxjdw\") pod \"network-check-target-wv9l4\" (UID: \"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf\") " pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:34.589350 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.589335    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4v4p\""
May 25 11:23:34.597158 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.597143    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:34.743044 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.742995    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fddpw" podStartSLOduration=1.808109204 podStartE2EDuration="5.74298142s" podCreationTimestamp="2026-05-25 11:23:29 +0000 UTC" firstStartedPulling="2026-05-25 11:23:29.715664255 +0000 UTC m=+61.537588453" lastFinishedPulling="2026-05-25 11:23:33.65053646 +0000 UTC m=+65.472460669" observedRunningTime="2026-05-25 11:23:33.985948966 +0000 UTC m=+65.807873185" watchObservedRunningTime="2026-05-25 11:23:34.74298142 +0000 UTC m=+66.564905639"
May 25 11:23:34.743714 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.743696    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wv9l4"]
May 25 11:23:34.746652 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:23:34.746626    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a46f2e6_4f9c_4e7c_8f1b_cb9d7498bcdf.slice/crio-649d9bbe011bc11b75ba0f44d1652df37fbe7573f4eb38d935512675201d2f56 WatchSource:0}: Error finding container 649d9bbe011bc11b75ba0f44d1652df37fbe7573f4eb38d935512675201d2f56: Status 404 returned error can't find the container with id 649d9bbe011bc11b75ba0f44d1652df37fbe7573f4eb38d935512675201d2f56
May 25 11:23:34.972030 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:34.971960    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wv9l4" event={"ID":"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf","Type":"ContainerStarted","Data":"649d9bbe011bc11b75ba0f44d1652df37fbe7573f4eb38d935512675201d2f56"}
May 25 11:23:37.979551 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:37.979517    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wv9l4" event={"ID":"1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf","Type":"ContainerStarted","Data":"2228770594f465bd324e4f217fa0e0c2316a78ad537afa57c27204bf9172ac96"}
May 25 11:23:37.979901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:37.979668    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:23:37.996829 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:23:37.996787    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wv9l4" podStartSLOduration=67.432943564 podStartE2EDuration="1m9.99677626s" podCreationTimestamp="2026-05-25 11:22:28 +0000 UTC" firstStartedPulling="2026-05-25 11:23:34.7485491 +0000 UTC m=+66.570473297" lastFinishedPulling="2026-05-25 11:23:37.312381792 +0000 UTC m=+69.134305993" observedRunningTime="2026-05-25 11:23:37.99651171 +0000 UTC m=+69.818435930" watchObservedRunningTime="2026-05-25 11:23:37.99677626 +0000 UTC m=+69.818700474"
May 25 11:24:06.370004 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:06.369967    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:24:06.370449 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:06.370119    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 11:24:06.370449 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:06.370201    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls podName:5e96b221-0e15-482c-9090-21eb29d5ae79 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:10.370181878 +0000 UTC m=+162.192106098 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls") pod "dns-default-qxpvv" (UID: "5e96b221-0e15-482c-9090-21eb29d5ae79") : secret "dns-default-metrics-tls" not found
May 25 11:24:06.470461 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:06.470436    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:24:06.470558 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:06.470532    2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 11:24:06.470603 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:06.470578    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert podName:f5d855d2-7bec-4015-9d26-2057cf2e20b4 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:10.470565583 +0000 UTC m=+162.292489780 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert") pod "ingress-canary-lsz24" (UID: "f5d855d2-7bec-4015-9d26-2057cf2e20b4") : secret "canary-serving-cert" not found
May 25 11:24:08.984188 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:08.984157    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wv9l4"
May 25 11:24:24.808831 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.808797    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65d95d88cb-cq8d7"]
May 25 11:24:24.810463 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.810447    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.813160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.813131    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 25 11:24:24.813297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.813226    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 25 11:24:24.813297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.813230    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 25 11:24:24.813404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.813281    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 25 11:24:24.813608 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.813591    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 25 11:24:24.813676 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.813632    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 25 11:24:24.814456 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.814433    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s4vhg\""
May 25 11:24:24.821840 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.821818    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65d95d88cb-cq8d7"]
May 25 11:24:24.887750 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.887731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.887900 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.887800    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-stats-auth\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.887900 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.887832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.887900 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.887896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-default-certificate\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.888041 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.887928    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ff2j\" (UniqueName: \"kubernetes.io/projected/8496649f-9a5b-43fa-92cb-f139eea5b623-kube-api-access-8ff2j\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.988514 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.988490    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ff2j\" (UniqueName: \"kubernetes.io/projected/8496649f-9a5b-43fa-92cb-f139eea5b623-kube-api-access-8ff2j\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.988612 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.988523    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.988612 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.988590    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-stats-auth\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.988713 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.988630    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.988713 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:24.988653    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:25.488639489 +0000 UTC m=+117.310563704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : configmap references non-existent config key: service-ca.crt
May 25 11:24:24.988713 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.988698    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-default-certificate\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.988713 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:24.988712    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 11:24:24.988948 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:24.988770    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:25.488753342 +0000 UTC m=+117.310677540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : secret "router-metrics-certs-default" not found
May 25 11:24:24.990852 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.990825    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-stats-auth\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:24.990953 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:24.990911    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-default-certificate\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:25.009766 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:25.009743    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ff2j\" (UniqueName: \"kubernetes.io/projected/8496649f-9a5b-43fa-92cb-f139eea5b623-kube-api-access-8ff2j\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:25.491737 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:25.491693    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:25.491957 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:25.491767    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:25.491957 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:25.491856    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 11:24:25.492046 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:25.491964    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:26.491946063 +0000 UTC m=+118.313870261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : secret "router-metrics-certs-default" not found
May 25 11:24:25.492046 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:25.491980    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:26.491973252 +0000 UTC m=+118.313897450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : configmap references non-existent config key: service-ca.crt
May 25 11:24:26.499690 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:26.499654    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:26.500139 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:26.499721    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:26.500139 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:26.499808    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 11:24:26.500139 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:26.499882    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:28.499838921 +0000 UTC m=+120.321763131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : configmap references non-existent config key: service-ca.crt
May 25 11:24:26.500139 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:26.499917    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:28.499906409 +0000 UTC m=+120.321830614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : secret "router-metrics-certs-default" not found
May 25 11:24:28.514616 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.514571    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:28.515017 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.514640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:28.515017 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:28.514723    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 11:24:28.515017 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:28.514745    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:32.514726058 +0000 UTC m=+124.336650257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : configmap references non-existent config key: service-ca.crt
May 25 11:24:28.515017 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:28.514773    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:32.514759038 +0000 UTC m=+124.336683235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : secret "router-metrics-certs-default" not found
May 25 11:24:28.731625 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.731593    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8wkwr"]
May 25 11:24:28.733307 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.733293    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.736170 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.736147    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 25 11:24:28.736275 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.736148    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 25 11:24:28.737414 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.737393    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m767p\""
May 25 11:24:28.737532 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.737424    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:28.737532 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.737507    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 25 11:24:28.742367 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.742346    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 25 11:24:28.746522 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.746501    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8wkwr"]
May 25 11:24:28.816053 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.815982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-trusted-ca\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.816201 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.816052    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7724z\" (UniqueName: \"kubernetes.io/projected/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-kube-api-access-7724z\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.816201 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.816085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-serving-cert\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.816201 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.816129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-config\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.917472 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.917439    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7724z\" (UniqueName: \"kubernetes.io/projected/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-kube-api-access-7724z\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.917636 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.917485    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-serving-cert\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.917636 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.917514    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-config\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.917636 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.917537    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-trusted-ca\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.918269 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.918245    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-config\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.918586 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.918567    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-trusted-ca\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.920078 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.920051    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-serving-cert\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:28.926187 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:28.926161    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7724z\" (UniqueName: \"kubernetes.io/projected/abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb-kube-api-access-7724z\") pod \"console-operator-76dff48d59-8wkwr\" (UID: \"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb\") " pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:29.042969 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:29.042932    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:29.159209 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:29.159183    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-8wkwr"]
May 25 11:24:29.162119 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:24:29.162088    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd307cd_ea8e_45ff_b4b3_6a2dd0c798fb.slice/crio-5e280ccf8623bfbcc0a78615f3833b53225977f53055bfc06569b82d237206ed WatchSource:0}: Error finding container 5e280ccf8623bfbcc0a78615f3833b53225977f53055bfc06569b82d237206ed: Status 404 returned error can't find the container with id 5e280ccf8623bfbcc0a78615f3833b53225977f53055bfc06569b82d237206ed
May 25 11:24:30.077229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:30.077197    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" event={"ID":"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb","Type":"ContainerStarted","Data":"5e280ccf8623bfbcc0a78615f3833b53225977f53055bfc06569b82d237206ed"}
May 25 11:24:30.312808 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:30.312779    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q2nlv_848a9419-e49d-4daa-8898-1874ba85ec8d/dns-node-resolver/0.log"
May 25 11:24:31.112692 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:31.112669    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4mq75_931b2d21-9dcd-4749-82e8-2ab1c0ac9179/node-ca/0.log"
May 25 11:24:32.082961 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.082933    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/0.log"
May 25 11:24:32.083098 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.082972    2557 generic.go:358] "Generic (PLEG): container finished" podID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb" containerID="928a38a5ea8fdf7c27b59f677c0ee9b07e082c5b9bed9dc4f2367668111ccc70" exitCode=255
May 25 11:24:32.083098 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.083032    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" event={"ID":"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb","Type":"ContainerDied","Data":"928a38a5ea8fdf7c27b59f677c0ee9b07e082c5b9bed9dc4f2367668111ccc70"}
May 25 11:24:32.083305 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.083289    2557 scope.go:117] "RemoveContainer" containerID="928a38a5ea8fdf7c27b59f677c0ee9b07e082c5b9bed9dc4f2367668111ccc70"
May 25 11:24:32.544193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.544097    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:32.544193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.544161    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:32.544612 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:32.544245    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 11:24:32.544612 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:32.544289    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:40.544264882 +0000 UTC m=+132.366189081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : configmap references non-existent config key: service-ca.crt
May 25 11:24:32.544612 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:32.544319    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:40.54430826 +0000 UTC m=+132.366232465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : secret "router-metrics-certs-default" not found
May 25 11:24:32.730323 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.730293    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"]
May 25 11:24:32.732096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.732081    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.734777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.734753    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:32.735215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.735201    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 25 11:24:32.736238 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.736217    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 25 11:24:32.736342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.736218    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5hmw9\""
May 25 11:24:32.736342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.736253    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 25 11:24:32.740072 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.740053    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"]
May 25 11:24:32.847084 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.847060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gtn\" (UniqueName: \"kubernetes.io/projected/6da01c3c-835e-45a6-a78e-4c7181374b53-kube-api-access-l7gtn\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.847196 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.847120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6da01c3c-835e-45a6-a78e-4c7181374b53-config\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.847196 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.847177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6da01c3c-835e-45a6-a78e-4c7181374b53-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.948345 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.948289    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gtn\" (UniqueName: \"kubernetes.io/projected/6da01c3c-835e-45a6-a78e-4c7181374b53-kube-api-access-l7gtn\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.948524 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.948382    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6da01c3c-835e-45a6-a78e-4c7181374b53-config\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.948524 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.948413    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6da01c3c-835e-45a6-a78e-4c7181374b53-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.949048 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.949026    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6da01c3c-835e-45a6-a78e-4c7181374b53-config\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.950679 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.950652    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6da01c3c-835e-45a6-a78e-4c7181374b53-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:32.956722 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:32.956698    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gtn\" (UniqueName: \"kubernetes.io/projected/6da01c3c-835e-45a6-a78e-4c7181374b53-kube-api-access-l7gtn\") pod \"kube-storage-version-migrator-operator-565644f49-thxws\" (UID: \"6da01c3c-835e-45a6-a78e-4c7181374b53\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:33.040530 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.040495    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"
May 25 11:24:33.088033 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.087937    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/1.log"
May 25 11:24:33.088609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.088584    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/0.log"
May 25 11:24:33.088732 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.088628    2557 generic.go:358] "Generic (PLEG): container finished" podID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb" containerID="1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059" exitCode=255
May 25 11:24:33.088732 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.088663    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" event={"ID":"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb","Type":"ContainerDied","Data":"1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059"}
May 25 11:24:33.088732 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.088712    2557 scope.go:117] "RemoveContainer" containerID="928a38a5ea8fdf7c27b59f677c0ee9b07e082c5b9bed9dc4f2367668111ccc70"
May 25 11:24:33.089273 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.089162    2557 scope.go:117] "RemoveContainer" containerID="1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059"
May 25 11:24:33.089420 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:33.089377    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8wkwr_openshift-console-operator(abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb)\"" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podUID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb"
May 25 11:24:33.162906 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:33.162860    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws"]
May 25 11:24:33.165539 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:24:33.165502    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da01c3c_835e_45a6_a78e_4c7181374b53.slice/crio-a796ca24dc4e6e9d8b09624cff45ec24e3ae2da96bf83f6c9fbd6a4abd45b7ab WatchSource:0}: Error finding container a796ca24dc4e6e9d8b09624cff45ec24e3ae2da96bf83f6c9fbd6a4abd45b7ab: Status 404 returned error can't find the container with id a796ca24dc4e6e9d8b09624cff45ec24e3ae2da96bf83f6c9fbd6a4abd45b7ab
May 25 11:24:34.091966 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.091935    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/1.log"
May 25 11:24:34.092419 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.092373    2557 scope.go:117] "RemoveContainer" containerID="1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059"
May 25 11:24:34.092604 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:34.092580    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8wkwr_openshift-console-operator(abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb)\"" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podUID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb"
May 25 11:24:34.093407 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.093360    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws" event={"ID":"6da01c3c-835e-45a6-a78e-4c7181374b53","Type":"ContainerStarted","Data":"a796ca24dc4e6e9d8b09624cff45ec24e3ae2da96bf83f6c9fbd6a4abd45b7ab"}
May 25 11:24:34.799293 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.799260    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"]
May 25 11:24:34.801853 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.801827    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.804521 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.804493    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 25 11:24:34.805397 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.805302    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-56qvx\""
May 25 11:24:34.805922 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.805904    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 25 11:24:34.806151 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.806134    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 25 11:24:34.806398 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.806384    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 25 11:24:34.809601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.809559    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"]
May 25 11:24:34.863685 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.863648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a40e9db2-70de-404a-a3f9-f82eeb82174c-config\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.863841 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.863691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgpt\" (UniqueName: \"kubernetes.io/projected/a40e9db2-70de-404a-a3f9-f82eeb82174c-kube-api-access-7jgpt\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.863914 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.863852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e9db2-70de-404a-a3f9-f82eeb82174c-serving-cert\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.964905 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.964842    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e9db2-70de-404a-a3f9-f82eeb82174c-serving-cert\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.965069 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.964930    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a40e9db2-70de-404a-a3f9-f82eeb82174c-config\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.965069 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.964959    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgpt\" (UniqueName: \"kubernetes.io/projected/a40e9db2-70de-404a-a3f9-f82eeb82174c-kube-api-access-7jgpt\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.965657 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.965627    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a40e9db2-70de-404a-a3f9-f82eeb82174c-config\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.967569 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.967537    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a40e9db2-70de-404a-a3f9-f82eeb82174c-serving-cert\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:34.973974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:34.973945    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgpt\" (UniqueName: \"kubernetes.io/projected/a40e9db2-70de-404a-a3f9-f82eeb82174c-kube-api-access-7jgpt\") pod \"service-ca-operator-57b5b68b8-9fr2n\" (UID: \"a40e9db2-70de-404a-a3f9-f82eeb82174c\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:35.096088 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.096052    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws" event={"ID":"6da01c3c-835e-45a6-a78e-4c7181374b53","Type":"ContainerStarted","Data":"33d705ccf83213507e1db56ba885044ae6399aff878d6ad5366947da5f95f178"}
May 25 11:24:35.112858 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.112816    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws" podStartSLOduration=1.253080628 podStartE2EDuration="3.112801913s" podCreationTimestamp="2026-05-25 11:24:32 +0000 UTC" firstStartedPulling="2026-05-25 11:24:33.167421733 +0000 UTC m=+124.989345932" lastFinishedPulling="2026-05-25 11:24:35.027143015 +0000 UTC m=+126.849067217" observedRunningTime="2026-05-25 11:24:35.112606854 +0000 UTC m=+126.934531073" watchObservedRunningTime="2026-05-25 11:24:35.112801913 +0000 UTC m=+126.934726132"
May 25 11:24:35.116376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.115590    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"
May 25 11:24:35.186530 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.186502    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"]
May 25 11:24:35.188795 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.188777    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"
May 25 11:24:35.192027 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.192005    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xp4kf\""
May 25 11:24:35.198686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.198506    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"]
May 25 11:24:35.240733 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.240709    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n"]
May 25 11:24:35.244955 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:24:35.244930    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40e9db2_70de_404a_a3f9_f82eeb82174c.slice/crio-19294202878f81cf8c517805246cac0668b5d6c990385979afc12f13f279d7f6 WatchSource:0}: Error finding container 19294202878f81cf8c517805246cac0668b5d6c990385979afc12f13f279d7f6: Status 404 returned error can't find the container with id 19294202878f81cf8c517805246cac0668b5d6c990385979afc12f13f279d7f6
May 25 11:24:35.267569 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.267546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjkqx\" (UniqueName: \"kubernetes.io/projected/3b8d7886-274d-4745-ba8b-c0440e84b79c-kube-api-access-bjkqx\") pod \"network-check-source-7f44b6dd87-2f94r\" (UID: \"3b8d7886-274d-4745-ba8b-c0440e84b79c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"
May 25 11:24:35.368238 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.368209    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjkqx\" (UniqueName: \"kubernetes.io/projected/3b8d7886-274d-4745-ba8b-c0440e84b79c-kube-api-access-bjkqx\") pod \"network-check-source-7f44b6dd87-2f94r\" (UID: \"3b8d7886-274d-4745-ba8b-c0440e84b79c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"
May 25 11:24:35.376802 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.376779    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjkqx\" (UniqueName: \"kubernetes.io/projected/3b8d7886-274d-4745-ba8b-c0440e84b79c-kube-api-access-bjkqx\") pod \"network-check-source-7f44b6dd87-2f94r\" (UID: \"3b8d7886-274d-4745-ba8b-c0440e84b79c\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"
May 25 11:24:35.500620 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.500588    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"
May 25 11:24:35.621184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:35.621113    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r"]
May 25 11:24:35.623652 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:24:35.623624    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8d7886_274d_4745_ba8b_c0440e84b79c.slice/crio-57ee2eec9b84d122a7c9b5d99759e642e0419205d1d506c823b54e6126b5cd16 WatchSource:0}: Error finding container 57ee2eec9b84d122a7c9b5d99759e642e0419205d1d506c823b54e6126b5cd16: Status 404 returned error can't find the container with id 57ee2eec9b84d122a7c9b5d99759e642e0419205d1d506c823b54e6126b5cd16
May 25 11:24:36.102710 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:36.102675    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r" event={"ID":"3b8d7886-274d-4745-ba8b-c0440e84b79c","Type":"ContainerStarted","Data":"47474da149ad38cd5b620144f1331e62749ea02c8ebdf05e83906b1f4ed1acea"}
May 25 11:24:36.103144 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:36.102720    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r" event={"ID":"3b8d7886-274d-4745-ba8b-c0440e84b79c","Type":"ContainerStarted","Data":"57ee2eec9b84d122a7c9b5d99759e642e0419205d1d506c823b54e6126b5cd16"}
May 25 11:24:36.104313 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:36.104287    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n" event={"ID":"a40e9db2-70de-404a-a3f9-f82eeb82174c","Type":"ContainerStarted","Data":"19294202878f81cf8c517805246cac0668b5d6c990385979afc12f13f279d7f6"}
May 25 11:24:36.119187 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:36.119137    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-2f94r" podStartSLOduration=1.119120675 podStartE2EDuration="1.119120675s" podCreationTimestamp="2026-05-25 11:24:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:24:36.118529013 +0000 UTC m=+127.940453235" watchObservedRunningTime="2026-05-25 11:24:36.119120675 +0000 UTC m=+127.941044896"
May 25 11:24:38.110717 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:38.110683    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n" event={"ID":"a40e9db2-70de-404a-a3f9-f82eeb82174c","Type":"ContainerStarted","Data":"755b055b868a2bb09cbdbf785bbd04f448b955f204e4c71939ff947dd1366ddb"}
May 25 11:24:38.126460 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:38.126413    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n" podStartSLOduration=2.152653029 podStartE2EDuration="4.126398991s" podCreationTimestamp="2026-05-25 11:24:34 +0000 UTC" firstStartedPulling="2026-05-25 11:24:35.246886527 +0000 UTC m=+127.068810731" lastFinishedPulling="2026-05-25 11:24:37.220632495 +0000 UTC m=+129.042556693" observedRunningTime="2026-05-25 11:24:38.125621181 +0000 UTC m=+129.947545400" watchObservedRunningTime="2026-05-25 11:24:38.126398991 +0000 UTC m=+129.948323211"
May 25 11:24:38.595506 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:38.595468    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:24:38.595663 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:38.595610    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 11:24:38.595706 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:38.595677    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs podName:75775f92-a777-4a28-ac20-efe3d188bacc nodeName:}" failed. No retries permitted until 2026-05-25 11:26:40.595661232 +0000 UTC m=+252.417585433 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs") pod "network-metrics-daemon-64mv4" (UID: "75775f92-a777-4a28-ac20-efe3d188bacc") : secret "metrics-daemon-secret" not found
May 25 11:24:39.043188 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:39.043114    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:39.043188 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:39.043146    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:39.043479 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:39.043467    2557 scope.go:117] "RemoveContainer" containerID="1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059"
May 25 11:24:39.043629 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:39.043614    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-8wkwr_openshift-console-operator(abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb)\"" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podUID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb"
May 25 11:24:40.611673 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.611626    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:40.612140 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.611703    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:40.612140 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:40.611784    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 11:24:40.612140 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:40.611853    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:56.611831831 +0000 UTC m=+148.433756049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : configmap references non-existent config key: service-ca.crt
May 25 11:24:40.612140 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:40.611896    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs podName:8496649f-9a5b-43fa-92cb-f139eea5b623 nodeName:}" failed. No retries permitted until 2026-05-25 11:24:56.611885654 +0000 UTC m=+148.433809852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs") pod "router-default-65d95d88cb-cq8d7" (UID: "8496649f-9a5b-43fa-92cb-f139eea5b623") : secret "router-metrics-certs-default" not found
May 25 11:24:40.850951 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.850915    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-dd67s"]
May 25 11:24:40.852795 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.852774    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:40.855547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.855527    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 25 11:24:40.855674 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.855582    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 25 11:24:40.855674 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.855612    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 25 11:24:40.856930 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.856912    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 25 11:24:40.857018 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.856939    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tl5pj\""
May 25 11:24:40.861371 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.861351    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-dd67s"]
May 25 11:24:40.912614 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.912545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-signing-cabundle\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:40.912614 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.912575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-signing-key\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:40.912614 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:40.912592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr9r5\" (UniqueName: \"kubernetes.io/projected/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-kube-api-access-gr9r5\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.013152 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.013122    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-signing-cabundle\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.013152 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.013153    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-signing-key\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.013342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.013173    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gr9r5\" (UniqueName: \"kubernetes.io/projected/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-kube-api-access-gr9r5\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.013768 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.013747    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-signing-cabundle\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.015564 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.015543    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-signing-key\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.021738 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.021716    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr9r5\" (UniqueName: \"kubernetes.io/projected/e2b3ecac-af9d-46e5-ae72-f927e8518fc1-kube-api-access-gr9r5\") pod \"service-ca-67d667c7d-dd67s\" (UID: \"e2b3ecac-af9d-46e5-ae72-f927e8518fc1\") " pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.161553 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.161528    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-dd67s"
May 25 11:24:41.279518 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:41.279489    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-dd67s"]
May 25 11:24:41.282082 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:24:41.282044    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b3ecac_af9d_46e5_ae72_f927e8518fc1.slice/crio-d04dcc6ea7bc62923069d29fcc85571f253be4c9ff813cace5571aabb69997f8 WatchSource:0}: Error finding container d04dcc6ea7bc62923069d29fcc85571f253be4c9ff813cace5571aabb69997f8: Status 404 returned error can't find the container with id d04dcc6ea7bc62923069d29fcc85571f253be4c9ff813cace5571aabb69997f8
May 25 11:24:42.122574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:42.122540    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-dd67s" event={"ID":"e2b3ecac-af9d-46e5-ae72-f927e8518fc1","Type":"ContainerStarted","Data":"c44cc5704231bf32de10de58729d2b1a8b539a085a4e22291842fc758fd15e5b"}
May 25 11:24:42.122574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:42.122575    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-dd67s" event={"ID":"e2b3ecac-af9d-46e5-ae72-f927e8518fc1","Type":"ContainerStarted","Data":"d04dcc6ea7bc62923069d29fcc85571f253be4c9ff813cace5571aabb69997f8"}
May 25 11:24:42.142355 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:42.142314    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-dd67s" podStartSLOduration=2.142301449 podStartE2EDuration="2.142301449s" podCreationTimestamp="2026-05-25 11:24:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:24:42.140818796 +0000 UTC m=+133.962743018" watchObservedRunningTime="2026-05-25 11:24:42.142301449 +0000 UTC m=+133.964225668"
May 25 11:24:52.775409 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:52.775375    2557 scope.go:117] "RemoveContainer" containerID="1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059"
May 25 11:24:53.148846 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:53.148821    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:24:53.149211 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:53.149190    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/1.log"
May 25 11:24:53.149332 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:53.149223    2557 generic.go:358] "Generic (PLEG): container finished" podID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb" containerID="2430ca8900bdf7741c6d059afb9e701b3c7a539ed79b63971ac8068f8a4599d7" exitCode=255
May 25 11:24:53.149332 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:53.149276    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" event={"ID":"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb","Type":"ContainerDied","Data":"2430ca8900bdf7741c6d059afb9e701b3c7a539ed79b63971ac8068f8a4599d7"}
May 25 11:24:53.149332 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:53.149304    2557 scope.go:117] "RemoveContainer" containerID="1590752cb9d0b1eeea1d07bf9457319b263b8f825f3fb91dfcb5c530347b1059"
May 25 11:24:53.149627 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:53.149611    2557 scope.go:117] "RemoveContainer" containerID="2430ca8900bdf7741c6d059afb9e701b3c7a539ed79b63971ac8068f8a4599d7"
May 25 11:24:53.149821 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:53.149803    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8wkwr_openshift-console-operator(abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb)\"" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podUID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb"
May 25 11:24:54.152837 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:54.152742    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:24:56.625476 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:56.625436    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:56.625857 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:56.625508    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:56.626140 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:56.626123    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8496649f-9a5b-43fa-92cb-f139eea5b623-service-ca-bundle\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:56.627682 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:56.627654    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8496649f-9a5b-43fa-92cb-f139eea5b623-metrics-certs\") pod \"router-default-65d95d88cb-cq8d7\" (UID: \"8496649f-9a5b-43fa-92cb-f139eea5b623\") " pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:56.923560 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:56.923480    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-s4vhg\""
May 25 11:24:56.931170 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:56.931150    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:57.052907 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:57.052858    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65d95d88cb-cq8d7"]
May 25 11:24:57.055988 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:24:57.055947    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8496649f_9a5b_43fa_92cb_f139eea5b623.slice/crio-e6702d98d40357f530534e96d5ed1becd05663fa702ce3429f0f9adeb47c9dd2 WatchSource:0}: Error finding container e6702d98d40357f530534e96d5ed1becd05663fa702ce3429f0f9adeb47c9dd2: Status 404 returned error can't find the container with id e6702d98d40357f530534e96d5ed1becd05663fa702ce3429f0f9adeb47c9dd2
May 25 11:24:57.161262 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:57.161225    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65d95d88cb-cq8d7" event={"ID":"8496649f-9a5b-43fa-92cb-f139eea5b623","Type":"ContainerStarted","Data":"ef7d1f9b2ecf5212325eef378019bc76d9c72e3ec9abbf3fabc5855eefc6c8a4"}
May 25 11:24:57.161262 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:57.161266    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65d95d88cb-cq8d7" event={"ID":"8496649f-9a5b-43fa-92cb-f139eea5b623","Type":"ContainerStarted","Data":"e6702d98d40357f530534e96d5ed1becd05663fa702ce3429f0f9adeb47c9dd2"}
May 25 11:24:57.182792 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:57.182707    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-65d95d88cb-cq8d7" podStartSLOduration=33.182693531 podStartE2EDuration="33.182693531s" podCreationTimestamp="2026-05-25 11:24:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:24:57.181812676 +0000 UTC m=+149.003736897" watchObservedRunningTime="2026-05-25 11:24:57.182693531 +0000 UTC m=+149.004617751"
May 25 11:24:57.931394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:57.931356    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:57.933859 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:57.933841    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:58.164154 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:58.164126    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:58.165341 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:58.165319    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65d95d88cb-cq8d7"
May 25 11:24:59.043302 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:59.043276    2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:59.043302 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:59.043301    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:24:59.043673 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:24:59.043581    2557 scope.go:117] "RemoveContainer" containerID="2430ca8900bdf7741c6d059afb9e701b3c7a539ed79b63971ac8068f8a4599d7"
May 25 11:24:59.043778 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:24:59.043760    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8wkwr_openshift-console-operator(abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb)\"" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podUID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb"
May 25 11:25:03.399035 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.398995    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"]
May 25 11:25:03.401999 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.401978    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"]
May 25 11:25:03.402136 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.402117    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:03.403765 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.403748    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.405014 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.404996    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-tdbdq\""
May 25 11:25:03.406409 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.406393    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 25 11:25:03.406712 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.406696    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w59mk\""
May 25 11:25:03.406796 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.406728    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 25 11:25:03.406950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.406932    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 25 11:25:03.412808 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.412786    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 25 11:25:03.417601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.417582    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 25 11:25:03.420852 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.420830    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"]
May 25 11:25:03.421712 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.421695    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"]
May 25 11:25:03.423969 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.423952    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-76lff"]
May 25 11:25:03.425953 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.425939    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.429484 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.429468    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 11:25:03.429581 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.429483    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 11:25:03.430749 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.430723    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s56fk\""
May 25 11:25:03.431310 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.431293    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 11:25:03.435550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.435533    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 11:25:03.440941 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.440921    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-76lff"]
May 25 11:25:03.576331 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6brdw\" (UniqueName: \"kubernetes.io/projected/e046b498-6231-4380-b208-f17220f44d10-kube-api-access-6brdw\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.576331 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-registry-tls\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576331 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e046b498-6231-4380-b208-f17220f44d10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.576331 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576333    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-bound-sa-token\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b665160-cf37-40a3-97c4-3c1777912805-registry-certificates\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b665160-cf37-40a3-97c4-3c1777912805-trusted-ca\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b665160-cf37-40a3-97c4-3c1777912805-image-registry-private-configuration\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e046b498-6231-4380-b208-f17220f44d10-data-volume\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.576574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f52x\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-kube-api-access-2f52x\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e046b498-6231-4380-b208-f17220f44d10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.576752 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b665160-cf37-40a3-97c4-3c1777912805-ca-trust-extracted\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576752 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b665160-cf37-40a3-97c4-3c1777912805-installation-pull-secrets\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.576752 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e046b498-6231-4380-b208-f17220f44d10-crio-socket\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.576752 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.576645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24b6a278-b716-4838-ac56-817e4ecdb035-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv\" (UID: \"24b6a278-b716-4838-ac56-817e4ecdb035\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:03.677946 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.677904    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e046b498-6231-4380-b208-f17220f44d10-data-volume\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.677982    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f52x\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-kube-api-access-2f52x\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.677998    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e046b498-6231-4380-b208-f17220f44d10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678019    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b665160-cf37-40a3-97c4-3c1777912805-ca-trust-extracted\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678039    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b665160-cf37-40a3-97c4-3c1777912805-installation-pull-secrets\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678057    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e046b498-6231-4380-b208-f17220f44d10-crio-socket\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678338 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678232    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e046b498-6231-4380-b208-f17220f44d10-crio-socket\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678338 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678285    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e046b498-6231-4380-b208-f17220f44d10-data-volume\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678425 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678281    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24b6a278-b716-4838-ac56-817e4ecdb035-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv\" (UID: \"24b6a278-b716-4838-ac56-817e4ecdb035\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:03.678425 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678410    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6brdw\" (UniqueName: \"kubernetes.io/projected/e046b498-6231-4380-b208-f17220f44d10-kube-api-access-6brdw\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678471    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-registry-tls\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678488    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b665160-cf37-40a3-97c4-3c1777912805-ca-trust-extracted\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678501    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e046b498-6231-4380-b208-f17220f44d10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.678658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678542    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-bound-sa-token\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678568    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b665160-cf37-40a3-97c4-3c1777912805-registry-certificates\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678589    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b665160-cf37-40a3-97c4-3c1777912805-trusted-ca\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.678658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.678620    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b665160-cf37-40a3-97c4-3c1777912805-image-registry-private-configuration\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.679089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.679064    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e046b498-6231-4380-b208-f17220f44d10-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.679526 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.679501    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b665160-cf37-40a3-97c4-3c1777912805-registry-certificates\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.679890 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.679844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b665160-cf37-40a3-97c4-3c1777912805-trusted-ca\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.681041 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.680984    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/24b6a278-b716-4838-ac56-817e4ecdb035-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv\" (UID: \"24b6a278-b716-4838-ac56-817e4ecdb035\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:03.681041 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.681003    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b665160-cf37-40a3-97c4-3c1777912805-installation-pull-secrets\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.681264 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.681246    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e046b498-6231-4380-b208-f17220f44d10-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.681364 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.681347    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-registry-tls\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.681416 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.681384    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b665160-cf37-40a3-97c4-3c1777912805-image-registry-private-configuration\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.686058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.686038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-bound-sa-token\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.686201 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.686182    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6brdw\" (UniqueName: \"kubernetes.io/projected/e046b498-6231-4380-b208-f17220f44d10-kube-api-access-6brdw\") pod \"insights-runtime-extractor-76lff\" (UID: \"e046b498-6231-4380-b208-f17220f44d10\") " pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.686430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.686414    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f52x\" (UniqueName: \"kubernetes.io/projected/7b665160-cf37-40a3-97c4-3c1777912805-kube-api-access-2f52x\") pod \"image-registry-9bdd9b9d6-7pkc8\" (UID: \"7b665160-cf37-40a3-97c4-3c1777912805\") " pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.713435 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.713383    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:03.717336 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.717305    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:03.735063 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.735028    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-76lff"
May 25 11:25:03.877206 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.877176    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"]
May 25 11:25:03.880814 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:03.880780    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b6a278_b716_4838_ac56_817e4ecdb035.slice/crio-dbfa8bcddcd069a6105becb68a62fc4359ff804d1cfe6589629ca7c32695ba8f WatchSource:0}: Error finding container dbfa8bcddcd069a6105becb68a62fc4359ff804d1cfe6589629ca7c32695ba8f: Status 404 returned error can't find the container with id dbfa8bcddcd069a6105becb68a62fc4359ff804d1cfe6589629ca7c32695ba8f
May 25 11:25:03.901913 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.901835    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"]
May 25 11:25:03.905906 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:03.905882    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b665160_cf37_40a3_97c4_3c1777912805.slice/crio-55d35daa20d83db76fd7721116bee86b2edfc858db76e39215dce3d9e84a6097 WatchSource:0}: Error finding container 55d35daa20d83db76fd7721116bee86b2edfc858db76e39215dce3d9e84a6097: Status 404 returned error can't find the container with id 55d35daa20d83db76fd7721116bee86b2edfc858db76e39215dce3d9e84a6097
May 25 11:25:03.917095 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:03.917024    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-76lff"]
May 25 11:25:03.919081 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:03.919054    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode046b498_6231_4380_b208_f17220f44d10.slice/crio-c025b0dbd4c554d097f0d404603cdb443f805b1ffc77c51c19c2227a6e1bcb41 WatchSource:0}: Error finding container c025b0dbd4c554d097f0d404603cdb443f805b1ffc77c51c19c2227a6e1bcb41: Status 404 returned error can't find the container with id c025b0dbd4c554d097f0d404603cdb443f805b1ffc77c51c19c2227a6e1bcb41
May 25 11:25:04.180499 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.180458    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8" event={"ID":"7b665160-cf37-40a3-97c4-3c1777912805","Type":"ContainerStarted","Data":"461a5a66d6fe3eb7979b5bafb697930177ef07f6e93d8340ce72647193d64056"}
May 25 11:25:04.180499 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.180502    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8" event={"ID":"7b665160-cf37-40a3-97c4-3c1777912805","Type":"ContainerStarted","Data":"55d35daa20d83db76fd7721116bee86b2edfc858db76e39215dce3d9e84a6097"}
May 25 11:25:04.180758 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.180561    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:04.181755 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.181729    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76lff" event={"ID":"e046b498-6231-4380-b208-f17220f44d10","Type":"ContainerStarted","Data":"ae1c2f6dca25d9b550d9037a34f12df11e2a7852faad3df4d136bf941aac47d5"}
May 25 11:25:04.181755 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.181755    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76lff" event={"ID":"e046b498-6231-4380-b208-f17220f44d10","Type":"ContainerStarted","Data":"c025b0dbd4c554d097f0d404603cdb443f805b1ffc77c51c19c2227a6e1bcb41"}
May 25 11:25:04.182774 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.182756    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv" event={"ID":"24b6a278-b716-4838-ac56-817e4ecdb035","Type":"ContainerStarted","Data":"dbfa8bcddcd069a6105becb68a62fc4359ff804d1cfe6589629ca7c32695ba8f"}
May 25 11:25:04.200405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:04.200364    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8" podStartSLOduration=1.200351633 podStartE2EDuration="1.200351633s" podCreationTimestamp="2026-05-25 11:25:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:25:04.199706115 +0000 UTC m=+156.021630335" watchObservedRunningTime="2026-05-25 11:25:04.200351633 +0000 UTC m=+156.022275892"
May 25 11:25:05.186803 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:05.186728    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76lff" event={"ID":"e046b498-6231-4380-b208-f17220f44d10","Type":"ContainerStarted","Data":"a2fd651ac35d542984e9c3888c76eb8be1cbbc9f32f0ee9b249397095cac9c42"}
May 25 11:25:05.188068 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:05.188042    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv" event={"ID":"24b6a278-b716-4838-ac56-817e4ecdb035","Type":"ContainerStarted","Data":"29f4081769fb0c27fdb853d920d18ddc848c9e39cc1bd10027b5a53ad1e76d7d"}
May 25 11:25:05.204419 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:05.204364    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv" podStartSLOduration=1.166051572 podStartE2EDuration="2.204349153s" podCreationTimestamp="2026-05-25 11:25:03 +0000 UTC" firstStartedPulling="2026-05-25 11:25:03.883730762 +0000 UTC m=+155.705654962" lastFinishedPulling="2026-05-25 11:25:04.922028334 +0000 UTC m=+156.743952543" observedRunningTime="2026-05-25 11:25:05.20313701 +0000 UTC m=+157.025061231" watchObservedRunningTime="2026-05-25 11:25:05.204349153 +0000 UTC m=+157.026273394"
May 25 11:25:05.569926 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:05.569827    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qxpvv" podUID="5e96b221-0e15-482c-9090-21eb29d5ae79"
May 25 11:25:05.581998 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:05.581959    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-lsz24" podUID="f5d855d2-7bec-4015-9d26-2057cf2e20b4"
May 25 11:25:05.792907 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:05.792851    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-64mv4" podUID="75775f92-a777-4a28-ac20-efe3d188bacc"
May 25 11:25:06.192551 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.192513    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-76lff" event={"ID":"e046b498-6231-4380-b208-f17220f44d10","Type":"ContainerStarted","Data":"133a00a981af3caebe6bc3b4cb032509ba211c1d3617d9670fe3b3a1631277a1"}
May 25 11:25:06.192958 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.192600    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxpvv"
May 25 11:25:06.192958 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.192844    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:06.197341 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.197319    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv"
May 25 11:25:06.213843 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.213798    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-76lff" podStartSLOduration=1.111573864 podStartE2EDuration="3.213785193s" podCreationTimestamp="2026-05-25 11:25:03 +0000 UTC" firstStartedPulling="2026-05-25 11:25:03.9659638 +0000 UTC m=+155.787887998" lastFinishedPulling="2026-05-25 11:25:06.068175111 +0000 UTC m=+157.890099327" observedRunningTime="2026-05-25 11:25:06.213192361 +0000 UTC m=+158.035116581" watchObservedRunningTime="2026-05-25 11:25:06.213785193 +0000 UTC m=+158.035709412"
May 25 11:25:06.339784 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.339751    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-nh495"]
May 25 11:25:06.342750 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.342734    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.345700 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.345673    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 25 11:25:06.345700 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.345686    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 11:25:06.345903 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.345795    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 25 11:25:06.345903 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.345811    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 11:25:06.345903 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.345844    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 11:25:06.346055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.345996    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mbpsc\""
May 25 11:25:06.354109 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.354083    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-nh495"]
May 25 11:25:06.507520 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.507460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dsn8\" (UniqueName: \"kubernetes.io/projected/16837a20-c4f0-4824-911e-77a68cbeafe7-kube-api-access-8dsn8\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.507749 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.507722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16837a20-c4f0-4824-911e-77a68cbeafe7-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.507844 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.507813    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16837a20-c4f0-4824-911e-77a68cbeafe7-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.507931 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.507851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16837a20-c4f0-4824-911e-77a68cbeafe7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.608851 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.608777    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16837a20-c4f0-4824-911e-77a68cbeafe7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.608851 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.608840    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dsn8\" (UniqueName: \"kubernetes.io/projected/16837a20-c4f0-4824-911e-77a68cbeafe7-kube-api-access-8dsn8\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.609068 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.608893    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16837a20-c4f0-4824-911e-77a68cbeafe7-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.609068 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.608925    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16837a20-c4f0-4824-911e-77a68cbeafe7-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.609528 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.609506    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16837a20-c4f0-4824-911e-77a68cbeafe7-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.611264 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.611242    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16837a20-c4f0-4824-911e-77a68cbeafe7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.611333 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.611321    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/16837a20-c4f0-4824-911e-77a68cbeafe7-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.617228 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.617208    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dsn8\" (UniqueName: \"kubernetes.io/projected/16837a20-c4f0-4824-911e-77a68cbeafe7-kube-api-access-8dsn8\") pod \"prometheus-operator-7779bbdd78-nh495\" (UID: \"16837a20-c4f0-4824-911e-77a68cbeafe7\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.655991 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.655967    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495"
May 25 11:25:06.779084 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:06.779059    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-nh495"]
May 25 11:25:06.780735 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:06.780710    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16837a20_c4f0_4824_911e_77a68cbeafe7.slice/crio-b18e946f60e35c4af9b477e69ab58716512af8706039358902a81cc857f7e277 WatchSource:0}: Error finding container b18e946f60e35c4af9b477e69ab58716512af8706039358902a81cc857f7e277: Status 404 returned error can't find the container with id b18e946f60e35c4af9b477e69ab58716512af8706039358902a81cc857f7e277
May 25 11:25:07.196015 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:07.195977    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495" event={"ID":"16837a20-c4f0-4824-911e-77a68cbeafe7","Type":"ContainerStarted","Data":"b18e946f60e35c4af9b477e69ab58716512af8706039358902a81cc857f7e277"}
May 25 11:25:08.200721 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:08.200695    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495" event={"ID":"16837a20-c4f0-4824-911e-77a68cbeafe7","Type":"ContainerStarted","Data":"15e19d366b319f20f45fd7054b1dc3368d5e644521f590373dc9d051a0dc99d3"}
May 25 11:25:08.201075 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:08.200733    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495" event={"ID":"16837a20-c4f0-4824-911e-77a68cbeafe7","Type":"ContainerStarted","Data":"20c628493dc6ffcf9cdb1068a72bb117cf711486339974da25341d0dcd98d1f2"}
May 25 11:25:08.219797 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:08.219234    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-nh495" podStartSLOduration=0.929762864 podStartE2EDuration="2.219215667s" podCreationTimestamp="2026-05-25 11:25:06 +0000 UTC" firstStartedPulling="2026-05-25 11:25:06.782532516 +0000 UTC m=+158.604456713" lastFinishedPulling="2026-05-25 11:25:08.071985304 +0000 UTC m=+159.893909516" observedRunningTime="2026-05-25 11:25:08.218437966 +0000 UTC m=+160.040362198" watchObservedRunningTime="2026-05-25 11:25:08.219215667 +0000 UTC m=+160.041139888"
May 25 11:25:09.701491 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.701456    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fgxn4"]
May 25 11:25:09.706546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.706527    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.709360 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.709330    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 11:25:09.709492 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.709373    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 11:25:09.709492 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.709409    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 11:25:09.709492 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.709482    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s6tg8\""
May 25 11:25:09.734734 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.734705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-wtmp\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.734859 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.734771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be1a341-2fe9-44eb-85d1-dc0774e042d4-metrics-client-ca\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.734859 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.734806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.734979 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.734878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-sys\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.734979 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.734934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.735074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.735002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-textfile\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.735074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.735048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dp4p\" (UniqueName: \"kubernetes.io/projected/0be1a341-2fe9-44eb-85d1-dc0774e042d4-kube-api-access-4dp4p\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.735174 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.735122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-root\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.735174 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.735147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-tls\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.774630 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.774610    2557 scope.go:117] "RemoveContainer" containerID="2430ca8900bdf7741c6d059afb9e701b3c7a539ed79b63971ac8068f8a4599d7"
May 25 11:25:09.774815 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:09.774796    2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-8wkwr_openshift-console-operator(abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb)\"" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podUID="abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb"
May 25 11:25:09.835506 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.835482    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-wtmp\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.835591 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.835539    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be1a341-2fe9-44eb-85d1-dc0774e042d4-metrics-client-ca\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.835591 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.835571    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.835706 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.835677    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-wtmp\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836020 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.835994    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-sys\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836102 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836036    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836102 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836068    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-textfile\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836102 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836097    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4dp4p\" (UniqueName: \"kubernetes.io/projected/0be1a341-2fe9-44eb-85d1-dc0774e042d4-kube-api-access-4dp4p\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836251 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836036    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-sys\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836251 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836166    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-root\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836251 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836194    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-tls\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836426 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:09.836303    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 11:25:09.836426 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:09.836352    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-tls podName:0be1a341-2fe9-44eb-85d1-dc0774e042d4 nodeName:}" failed. No retries permitted until 2026-05-25 11:25:10.336336308 +0000 UTC m=+162.158260521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-tls") pod "node-exporter-fgxn4" (UID: "0be1a341-2fe9-44eb-85d1-dc0774e042d4") : secret "node-exporter-tls" not found
May 25 11:25:09.836426 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836402    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-textfile\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836585 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836433    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0be1a341-2fe9-44eb-85d1-dc0774e042d4-metrics-client-ca\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836585 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836545    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-accelerators-collector-config\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.836585 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.836551    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0be1a341-2fe9-44eb-85d1-dc0774e042d4-root\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.838488 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.838462    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:09.847938 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:09.847918    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dp4p\" (UniqueName: \"kubernetes.io/projected/0be1a341-2fe9-44eb-85d1-dc0774e042d4-kube-api-access-4dp4p\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:10.339916 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.339860    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-tls\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:10.342115 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.342095    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0be1a341-2fe9-44eb-85d1-dc0774e042d4-node-exporter-tls\") pod \"node-exporter-fgxn4\" (UID: \"0be1a341-2fe9-44eb-85d1-dc0774e042d4\") " pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:10.441027 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.440995    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:25:10.443124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.443105    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e96b221-0e15-482c-9090-21eb29d5ae79-metrics-tls\") pod \"dns-default-qxpvv\" (UID: \"5e96b221-0e15-482c-9090-21eb29d5ae79\") " pod="openshift-dns/dns-default-qxpvv"
May 25 11:25:10.541586 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.541551    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:25:10.543813 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.543794    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d855d2-7bec-4015-9d26-2057cf2e20b4-cert\") pod \"ingress-canary-lsz24\" (UID: \"f5d855d2-7bec-4015-9d26-2057cf2e20b4\") " pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:25:10.617065 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.616997    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fgxn4"
May 25 11:25:10.624798 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:10.624770    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be1a341_2fe9_44eb_85d1_dc0774e042d4.slice/crio-da89a5a0d13d2beb36dc5e102f1c04e0d28cc4a13967649ef85434aafc72dada WatchSource:0}: Error finding container da89a5a0d13d2beb36dc5e102f1c04e0d28cc4a13967649ef85434aafc72dada: Status 404 returned error can't find the container with id da89a5a0d13d2beb36dc5e102f1c04e0d28cc4a13967649ef85434aafc72dada
May 25 11:25:10.695770 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.695744    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mbq6k\""
May 25 11:25:10.703964 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.703934    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qxpvv"
May 25 11:25:10.757699 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.757670    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:25:10.764951 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.764925    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.768225 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.768203    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 11:25:10.768485 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.768463    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 11:25:10.768693 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.768674    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 11:25:10.768945 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.768924    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 11:25:10.769055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.769012    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 11:25:10.770574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.769143    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 11:25:10.770574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.769212    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 11:25:10.770574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.769239    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-shmtq\""
May 25 11:25:10.770574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.769148    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 11:25:10.770574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.769428    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 11:25:10.772001 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.771976    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:25:10.841862 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.841835    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qxpvv"]
May 25 11:25:10.843756 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.843825 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.843825 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843796    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.843945 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843824    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-volume\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.843945 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844037 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843943    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844037 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.843978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844037 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.844005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9z6z\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-kube-api-access-t9z6z\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.844036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.844084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.844137    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-out\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.844167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844378 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.844192    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-web-config\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.844957 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:10.844930    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e96b221_0e15_482c_9090_21eb29d5ae79.slice/crio-2a35d242d232e2096438bd50a10b01648399b1d8d41e5d3652b870f8d04b7dd8 WatchSource:0}: Error finding container 2a35d242d232e2096438bd50a10b01648399b1d8d41e5d3652b870f8d04b7dd8: Status 404 returned error can't find the container with id 2a35d242d232e2096438bd50a10b01648399b1d8d41e5d3652b870f8d04b7dd8
May 25 11:25:10.945516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945461    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945493    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945636 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945523    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945636 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945559    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-volume\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945718 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945640    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945718 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:10.945659    2557 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 25 11:25:10.945718 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945712    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945922 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945742    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945922 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945778    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9z6z\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-kube-api-access-t9z6z\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.945922 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:10.945811    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls podName:716f91d1-7ea1-465d-a0e2-f60cd39f218e nodeName:}" failed. No retries permitted until 2026-05-25 11:25:11.445776005 +0000 UTC m=+163.267700215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e") : secret "alertmanager-main-tls" not found
May 25 11:25:10.945922 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945898    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.946154 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.945937    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.946154 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.946000    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-out\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.946154 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.946005    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.946154 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.946034    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.946154 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.946062    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-web-config\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.946405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.946297    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.948057 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:25:10.948013    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle podName:716f91d1-7ea1-465d-a0e2-f60cd39f218e nodeName:}" failed. No retries permitted until 2026-05-25 11:25:11.447991501 +0000 UTC m=+163.269915715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e") : configmap references non-existent config key: ca-bundle.crt
May 25 11:25:10.948650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.948611    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.948745 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.948682    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-out\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.949058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.949013    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-volume\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.949234 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.949216    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-web-config\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.949304 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.949252    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.949460 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.949436    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.949496 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.949460    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.950281 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.950264    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:10.954019 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:10.953996    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9z6z\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-kube-api-access-t9z6z\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:11.209682 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.209603    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgxn4" event={"ID":"0be1a341-2fe9-44eb-85d1-dc0774e042d4","Type":"ContainerStarted","Data":"da89a5a0d13d2beb36dc5e102f1c04e0d28cc4a13967649ef85434aafc72dada"}
May 25 11:25:11.211101 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.211072    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxpvv" event={"ID":"5e96b221-0e15-482c-9090-21eb29d5ae79","Type":"ContainerStarted","Data":"2a35d242d232e2096438bd50a10b01648399b1d8d41e5d3652b870f8d04b7dd8"}
May 25 11:25:11.450796 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.450760    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:11.451001 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.450852    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:11.451726 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.451663    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:11.453607 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.453581    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:11.680833 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:11.680792    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:25:12.164453 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:12.164431    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:25:12.167738 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:12.167711    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716f91d1_7ea1_465d_a0e2_f60cd39f218e.slice/crio-f8c72241632125d41bc1f124f05c2fefda270fb68fff5059829f9afb22b80da7 WatchSource:0}: Error finding container f8c72241632125d41bc1f124f05c2fefda270fb68fff5059829f9afb22b80da7: Status 404 returned error can't find the container with id f8c72241632125d41bc1f124f05c2fefda270fb68fff5059829f9afb22b80da7
May 25 11:25:12.216183 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:12.216147    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxpvv" event={"ID":"5e96b221-0e15-482c-9090-21eb29d5ae79","Type":"ContainerStarted","Data":"b80528e347d3853caccf292f3bbc2e819469cd627fea204700ff61c10104d949"}
May 25 11:25:12.217241 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:12.217205    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"f8c72241632125d41bc1f124f05c2fefda270fb68fff5059829f9afb22b80da7"}
May 25 11:25:12.218626 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:12.218605    2557 generic.go:358] "Generic (PLEG): container finished" podID="0be1a341-2fe9-44eb-85d1-dc0774e042d4" containerID="607c5275cdde3c61a256e44d2bf2988b3eb56124c992d160b2ffb023ed04fbde" exitCode=0
May 25 11:25:12.218713 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:12.218662    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgxn4" event={"ID":"0be1a341-2fe9-44eb-85d1-dc0774e042d4","Type":"ContainerDied","Data":"607c5275cdde3c61a256e44d2bf2988b3eb56124c992d160b2ffb023ed04fbde"}
May 25 11:25:13.223978 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:13.223917    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgxn4" event={"ID":"0be1a341-2fe9-44eb-85d1-dc0774e042d4","Type":"ContainerStarted","Data":"8867cd1147aa4628580fc05ac9a88a77f28520a70d08175a9e2d2d8c627bf4a7"}
May 25 11:25:13.224435 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:13.223996    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fgxn4" event={"ID":"0be1a341-2fe9-44eb-85d1-dc0774e042d4","Type":"ContainerStarted","Data":"a1363e8f24ca7f2b4f64830560345a393d0babc54526ef3b83dc5fed8c6faeae"}
May 25 11:25:13.225844 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:13.225817    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qxpvv" event={"ID":"5e96b221-0e15-482c-9090-21eb29d5ae79","Type":"ContainerStarted","Data":"81274b871a506596095cec5f32fb28bc7ddcccbe6b040c89d88b8baecfcfb628"}
May 25 11:25:13.226003 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:13.225990    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qxpvv"
May 25 11:25:13.246144 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:13.246098    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fgxn4" podStartSLOduration=3.417730035 podStartE2EDuration="4.246081734s" podCreationTimestamp="2026-05-25 11:25:09 +0000 UTC" firstStartedPulling="2026-05-25 11:25:10.626339127 +0000 UTC m=+162.448263324" lastFinishedPulling="2026-05-25 11:25:11.454690822 +0000 UTC m=+163.276615023" observedRunningTime="2026-05-25 11:25:13.244311193 +0000 UTC m=+165.066235414" watchObservedRunningTime="2026-05-25 11:25:13.246081734 +0000 UTC m=+165.068005958"
May 25 11:25:13.260916 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:13.260853    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qxpvv" podStartSLOduration=130.038250842 podStartE2EDuration="2m11.260841432s" podCreationTimestamp="2026-05-25 11:23:02 +0000 UTC" firstStartedPulling="2026-05-25 11:25:10.846974411 +0000 UTC m=+162.668898620" lastFinishedPulling="2026-05-25 11:25:12.069565 +0000 UTC m=+163.891489210" observedRunningTime="2026-05-25 11:25:13.260146249 +0000 UTC m=+165.082070470" watchObservedRunningTime="2026-05-25 11:25:13.260841432 +0000 UTC m=+165.082765651"
May 25 11:25:14.230296 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.230265    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54" exitCode=0
May 25 11:25:14.230673 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.230360    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54"}
May 25 11:25:14.888528 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.888494    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-569dbb96b-8n9gm"]
May 25 11:25:14.891848 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.891826    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.894951 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.894696    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 25 11:25:14.894951 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.894710    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 25 11:25:14.894951 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.894821    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gv6hj\""
May 25 11:25:14.894951 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.894910    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 25 11:25:14.895272 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.895034    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 25 11:25:14.895438 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.895413    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 25 11:25:14.900453 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.900276    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 25 11:25:14.901712 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.901671    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-569dbb96b-8n9gm"]
May 25 11:25:14.981371 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-telemeter-client-tls\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981443    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-secret-telemeter-client\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-federate-client-tls\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981518    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981760 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-metrics-client-ca\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981760 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmq2w\" (UniqueName: \"kubernetes.io/projected/f7f899f2-7137-4ad4-833e-0785f348e226-kube-api-access-tmq2w\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:14.981760 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:14.981625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-serving-certs-ca-bundle\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.082679 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082629    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.082850 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082688    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-secret-telemeter-client\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.082850 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082725    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-federate-client-tls\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.082850 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082758    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.082850 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082817    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-metrics-client-ca\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.083089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082894    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tmq2w\" (UniqueName: \"kubernetes.io/projected/f7f899f2-7137-4ad4-833e-0785f348e226-kube-api-access-tmq2w\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.083089 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.082928    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-serving-certs-ca-bundle\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.083679 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.083389    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-telemeter-client-tls\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.084216 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.084159    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-telemeter-trusted-ca-bundle\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.084351 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.084228    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-serving-certs-ca-bundle\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.084487 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.084462    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7f899f2-7137-4ad4-833e-0785f348e226-metrics-client-ca\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.090404 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.087072    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-federate-client-tls\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.091491 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.091464    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-secret-telemeter-client\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.091836 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.091692    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.092203 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.092183    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7f899f2-7137-4ad4-833e-0785f348e226-telemeter-client-tls\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.094418 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.094393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmq2w\" (UniqueName: \"kubernetes.io/projected/f7f899f2-7137-4ad4-833e-0785f348e226-kube-api-access-tmq2w\") pod \"telemeter-client-569dbb96b-8n9gm\" (UID: \"f7f899f2-7137-4ad4-833e-0785f348e226\") " pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.204840 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.204770    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm"
May 25 11:25:15.574794 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:15.574771    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-569dbb96b-8n9gm"]
May 25 11:25:15.577009 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:15.576978    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f899f2_7137_4ad4_833e_0785f348e226.slice/crio-00b9fa91ef68c818d4de44c28b2604b7a1844571ad86e2757c4a8ebd55001b1d WatchSource:0}: Error finding container 00b9fa91ef68c818d4de44c28b2604b7a1844571ad86e2757c4a8ebd55001b1d: Status 404 returned error can't find the container with id 00b9fa91ef68c818d4de44c28b2604b7a1844571ad86e2757c4a8ebd55001b1d
May 25 11:25:16.240708 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.240648    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322"}
May 25 11:25:16.240708 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.240697    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a"}
May 25 11:25:16.240708 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.240714    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3"}
May 25 11:25:16.241046 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.240728    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb"}
May 25 11:25:16.241046 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.240742    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591"}
May 25 11:25:16.242182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.242135    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm" event={"ID":"f7f899f2-7137-4ad4-833e-0785f348e226","Type":"ContainerStarted","Data":"00b9fa91ef68c818d4de44c28b2604b7a1844571ad86e2757c4a8ebd55001b1d"}
May 25 11:25:16.775007 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.774974    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:25:16.778559 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.778341    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7v95\""
May 25 11:25:16.785730 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.785702    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lsz24"
May 25 11:25:16.917692 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:16.917666    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lsz24"]
May 25 11:25:17.248477 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:17.248444    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerStarted","Data":"52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5"}
May 25 11:25:17.280777 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:17.280716    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.024206916 podStartE2EDuration="7.280696446s" podCreationTimestamp="2026-05-25 11:25:10 +0000 UTC" firstStartedPulling="2026-05-25 11:25:12.170030622 +0000 UTC m=+163.991954830" lastFinishedPulling="2026-05-25 11:25:16.42652016 +0000 UTC m=+168.248444360" observedRunningTime="2026-05-25 11:25:17.278223232 +0000 UTC m=+169.100147454" watchObservedRunningTime="2026-05-25 11:25:17.280696446 +0000 UTC m=+169.102620665"
May 25 11:25:17.327394 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:17.327362    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d855d2_7bec_4015_9d26_2057cf2e20b4.slice/crio-cbcfb11e21b7111e02993a743551967d1d243e9d3776032dea17743c588aabd4 WatchSource:0}: Error finding container cbcfb11e21b7111e02993a743551967d1d243e9d3776032dea17743c588aabd4: Status 404 returned error can't find the container with id cbcfb11e21b7111e02993a743551967d1d243e9d3776032dea17743c588aabd4
May 25 11:25:17.774609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:17.774532    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:25:18.254197 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:18.254158    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm" event={"ID":"f7f899f2-7137-4ad4-833e-0785f348e226","Type":"ContainerStarted","Data":"2e940d6730cc9321752f9fae659a1c41570646cbc275d9893ce57c60063010fa"}
May 25 11:25:18.254197 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:18.254203    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm" event={"ID":"f7f899f2-7137-4ad4-833e-0785f348e226","Type":"ContainerStarted","Data":"79dc260fa610991838fcb3c5ccc7bffdf41abb42b9f1c5d1e0e2f4a4b347d9d8"}
May 25 11:25:18.254708 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:18.254218    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm" event={"ID":"f7f899f2-7137-4ad4-833e-0785f348e226","Type":"ContainerStarted","Data":"61c519edcb07005216fe1ead7e27fb954936610b401cadb1cf7bb312d9730497"}
May 25 11:25:18.255517 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:18.255491    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lsz24" event={"ID":"f5d855d2-7bec-4015-9d26-2057cf2e20b4","Type":"ContainerStarted","Data":"cbcfb11e21b7111e02993a743551967d1d243e9d3776032dea17743c588aabd4"}
May 25 11:25:18.280229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:18.280182    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-569dbb96b-8n9gm" podStartSLOduration=2.485215963 podStartE2EDuration="4.280166949s" podCreationTimestamp="2026-05-25 11:25:14 +0000 UTC" firstStartedPulling="2026-05-25 11:25:15.579346858 +0000 UTC m=+167.401271057" lastFinishedPulling="2026-05-25 11:25:17.374297827 +0000 UTC m=+169.196222043" observedRunningTime="2026-05-25 11:25:18.278802845 +0000 UTC m=+170.100727067" watchObservedRunningTime="2026-05-25 11:25:18.280166949 +0000 UTC m=+170.102091170"
May 25 11:25:19.259103 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:19.259007    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lsz24" event={"ID":"f5d855d2-7bec-4015-9d26-2057cf2e20b4","Type":"ContainerStarted","Data":"19c97c2834e4f22d33bec45d6f1d5d314708ca42c2f5fd35a95e74b88db7be71"}
May 25 11:25:19.276655 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:19.276603    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lsz24" podStartSLOduration=135.614149859 podStartE2EDuration="2m17.276590566s" podCreationTimestamp="2026-05-25 11:23:02 +0000 UTC" firstStartedPulling="2026-05-25 11:25:17.329793079 +0000 UTC m=+169.151717281" lastFinishedPulling="2026-05-25 11:25:18.992233778 +0000 UTC m=+170.814157988" observedRunningTime="2026-05-25 11:25:19.275387183 +0000 UTC m=+171.097311400" watchObservedRunningTime="2026-05-25 11:25:19.276590566 +0000 UTC m=+171.098514787"
May 25 11:25:21.775549 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:21.775507    2557 scope.go:117] "RemoveContainer" containerID="2430ca8900bdf7741c6d059afb9e701b3c7a539ed79b63971ac8068f8a4599d7"
May 25 11:25:22.269849 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.269818    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:25:22.270044 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.269971    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" event={"ID":"abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb","Type":"ContainerStarted","Data":"de0dac047e33fbaf2a0a3d205402545fdfa3a4f2466dbe1b15da7f854947f340"}
May 25 11:25:22.270319 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.270298    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:25:22.275270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.275244    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr"
May 25 11:25:22.320938 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.320879    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-8wkwr" podStartSLOduration=52.258169092 podStartE2EDuration="54.320847751s" podCreationTimestamp="2026-05-25 11:24:28 +0000 UTC" firstStartedPulling="2026-05-25 11:24:29.163965475 +0000 UTC m=+120.985889673" lastFinishedPulling="2026-05-25 11:24:31.226644134 +0000 UTC m=+123.048568332" observedRunningTime="2026-05-25 11:25:22.299997347 +0000 UTC m=+174.121921581" watchObservedRunningTime="2026-05-25 11:25:22.320847751 +0000 UTC m=+174.142771971"
May 25 11:25:22.447735 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.447700    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-v2pgb"]
May 25 11:25:22.451113 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.451089    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:22.453987 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.453961    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 11:25:22.454100 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.454017    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h7w75\""
May 25 11:25:22.454153 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.454139    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 11:25:22.459184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.459158    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-v2pgb"]
May 25 11:25:22.547650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.547582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jgml\" (UniqueName: \"kubernetes.io/projected/35556c2e-3ede-4cc1-a602-e359800dc671-kube-api-access-4jgml\") pod \"downloads-57bd96b888-v2pgb\" (UID: \"35556c2e-3ede-4cc1-a602-e359800dc671\") " pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:22.648690 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.648663    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jgml\" (UniqueName: \"kubernetes.io/projected/35556c2e-3ede-4cc1-a602-e359800dc671-kube-api-access-4jgml\") pod \"downloads-57bd96b888-v2pgb\" (UID: \"35556c2e-3ede-4cc1-a602-e359800dc671\") " pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:22.658340 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.658311    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jgml\" (UniqueName: \"kubernetes.io/projected/35556c2e-3ede-4cc1-a602-e359800dc671-kube-api-access-4jgml\") pod \"downloads-57bd96b888-v2pgb\" (UID: \"35556c2e-3ede-4cc1-a602-e359800dc671\") " pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:22.760423 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.760386    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:22.887651 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:22.887620    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-v2pgb"]
May 25 11:25:22.890255 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:22.890215    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35556c2e_3ede_4cc1_a602_e359800dc671.slice/crio-06318e3ef6766116b9b07dc224f65d8036532f0390fa48fa801698cd43e77c96 WatchSource:0}: Error finding container 06318e3ef6766116b9b07dc224f65d8036532f0390fa48fa801698cd43e77c96: Status 404 returned error can't find the container with id 06318e3ef6766116b9b07dc224f65d8036532f0390fa48fa801698cd43e77c96
May 25 11:25:23.232984 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:23.232956    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qxpvv"
May 25 11:25:23.276641 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:23.276601    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-v2pgb" event={"ID":"35556c2e-3ede-4cc1-a602-e359800dc671","Type":"ContainerStarted","Data":"06318e3ef6766116b9b07dc224f65d8036532f0390fa48fa801698cd43e77c96"}
May 25 11:25:23.723308 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:23.723269    2557 patch_prober.go:28] interesting pod/image-registry-9bdd9b9d6-7pkc8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 25 11:25:23.723494 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:23.723334    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8" podUID="7b665160-cf37-40a3-97c4-3c1777912805" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:25:25.192571 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:25.192541    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9bdd9b9d6-7pkc8"
May 25 11:25:31.881267 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.881224    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c75576bcc-66gvl"]
May 25 11:25:31.886391 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.886360    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:31.889294 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.889273    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 25 11:25:31.890648 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.890624    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 25 11:25:31.890769 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.890624    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 25 11:25:31.890769 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.890702    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 25 11:25:31.890769 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.890634    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 25 11:25:31.890769 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.890651    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-f9wng\""
May 25 11:25:31.896300 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:31.896270    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c75576bcc-66gvl"]
May 25 11:25:32.043539 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.043504    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-serving-cert\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.043711 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.043565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-console-config\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.043711 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.043644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-oauth-serving-cert\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.043813 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.043731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd7x8\" (UniqueName: \"kubernetes.io/projected/b7117aee-a846-407e-9259-58dbbe8174e9-kube-api-access-gd7x8\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.043813 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.043773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-service-ca\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.043935 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.043823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-oauth-config\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.144736 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.144659    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-oauth-serving-cert\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.144736 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.144703    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gd7x8\" (UniqueName: \"kubernetes.io/projected/b7117aee-a846-407e-9259-58dbbe8174e9-kube-api-access-gd7x8\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.144736 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.144730    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-service-ca\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.145030 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.144786    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-oauth-config\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.145030 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.144825    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-serving-cert\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.145030 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.144856    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-console-config\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.145523 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.145497    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-oauth-serving-cert\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.145632 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.145575    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-console-config\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.145632 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.145610    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-service-ca\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.147547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.147510    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-oauth-config\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.147664 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.147638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-serving-cert\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.154105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.154078    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd7x8\" (UniqueName: \"kubernetes.io/projected/b7117aee-a846-407e-9259-58dbbe8174e9-kube-api-access-gd7x8\") pod \"console-c75576bcc-66gvl\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") " pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.198158 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.198124    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:32.351823 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:32.351791    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c75576bcc-66gvl"]
May 25 11:25:32.355460 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:32.355433    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7117aee_a846_407e_9259_58dbbe8174e9.slice/crio-b2114141689d7961a800adda882a8a02fbb22cde5b0fb047c3186ecb96f38a4a WatchSource:0}: Error finding container b2114141689d7961a800adda882a8a02fbb22cde5b0fb047c3186ecb96f38a4a: Status 404 returned error can't find the container with id b2114141689d7961a800adda882a8a02fbb22cde5b0fb047c3186ecb96f38a4a
May 25 11:25:33.308160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:33.308120    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c75576bcc-66gvl" event={"ID":"b7117aee-a846-407e-9259-58dbbe8174e9","Type":"ContainerStarted","Data":"b2114141689d7961a800adda882a8a02fbb22cde5b0fb047c3186ecb96f38a4a"}
May 25 11:25:40.166295 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.166258    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb47598d4-mfslv"]
May 25 11:25:40.169783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.169763    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.180849 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.180823    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 25 11:25:40.200740 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.198304    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb47598d4-mfslv"]
May 25 11:25:40.323566 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-trusted-ca-bundle\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.323735 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-oauth-serving-cert\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.323735 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpxs\" (UniqueName: \"kubernetes.io/projected/efa234e6-e568-4a3c-9a65-eed3ac4facb9-kube-api-access-xdpxs\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.323735 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323685    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-oauth-config\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.323897 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-serving-cert\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.323897 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-service-ca\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.323983 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.323906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-config\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424488 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424415    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-config\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424488 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424484    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-trusted-ca-bundle\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424513    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-oauth-serving-cert\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424529    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpxs\" (UniqueName: \"kubernetes.io/projected/efa234e6-e568-4a3c-9a65-eed3ac4facb9-kube-api-access-xdpxs\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424559    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-oauth-config\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424615    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-serving-cert\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.424772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.424659    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-service-ca\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.425358 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.425303    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-config\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.425465 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.425394    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-trusted-ca-bundle\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.425620 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.425589    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-service-ca\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.425690 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.425617    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-oauth-serving-cert\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.427474 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.427452    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-oauth-config\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.427652 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.427618    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-serving-cert\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.433405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.433380    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpxs\" (UniqueName: \"kubernetes.io/projected/efa234e6-e568-4a3c-9a65-eed3ac4facb9-kube-api-access-xdpxs\") pod \"console-bb47598d4-mfslv\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") " pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:40.482401 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:40.482359    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:41.259429 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.259399    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb47598d4-mfslv"]
May 25 11:25:41.261082 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:25:41.261057    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefa234e6_e568_4a3c_9a65_eed3ac4facb9.slice/crio-88f2baa18df958b52fdb87b9b56853983c37eb74b40a4403efdb441b8078070b WatchSource:0}: Error finding container 88f2baa18df958b52fdb87b9b56853983c37eb74b40a4403efdb441b8078070b: Status 404 returned error can't find the container with id 88f2baa18df958b52fdb87b9b56853983c37eb74b40a4403efdb441b8078070b
May 25 11:25:41.336943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.336910    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb47598d4-mfslv" event={"ID":"efa234e6-e568-4a3c-9a65-eed3ac4facb9","Type":"ContainerStarted","Data":"24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b"}
May 25 11:25:41.337069 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.336954    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb47598d4-mfslv" event={"ID":"efa234e6-e568-4a3c-9a65-eed3ac4facb9","Type":"ContainerStarted","Data":"88f2baa18df958b52fdb87b9b56853983c37eb74b40a4403efdb441b8078070b"}
May 25 11:25:41.338417 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.338371    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c75576bcc-66gvl" event={"ID":"b7117aee-a846-407e-9259-58dbbe8174e9","Type":"ContainerStarted","Data":"33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24"}
May 25 11:25:41.339990 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.339958    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-v2pgb" event={"ID":"35556c2e-3ede-4cc1-a602-e359800dc671","Type":"ContainerStarted","Data":"3f1432f23c163dd2f9dbb62b203315213191f4d70c62ebad7b85f05be073c590"}
May 25 11:25:41.340214 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.340194    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:41.341360 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.341340    2557 patch_prober.go:28] interesting pod/downloads-57bd96b888-v2pgb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused" start-of-body=
May 25 11:25:41.341438 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.341378    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-v2pgb" podUID="35556c2e-3ede-4cc1-a602-e359800dc671" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.20:8080/\": dial tcp 10.133.0.20:8080: connect: connection refused"
May 25 11:25:41.382704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.382582    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-bb47598d4-mfslv" podStartSLOduration=1.382566197 podStartE2EDuration="1.382566197s" podCreationTimestamp="2026-05-25 11:25:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:25:41.381645656 +0000 UTC m=+193.203569887" watchObservedRunningTime="2026-05-25 11:25:41.382566197 +0000 UTC m=+193.204490417"
May 25 11:25:41.411669 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.411620    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-v2pgb" podStartSLOduration=1.130765445 podStartE2EDuration="19.411605017s" podCreationTimestamp="2026-05-25 11:25:22 +0000 UTC" firstStartedPulling="2026-05-25 11:25:22.89213921 +0000 UTC m=+174.714063411" lastFinishedPulling="2026-05-25 11:25:41.172978785 +0000 UTC m=+192.994902983" observedRunningTime="2026-05-25 11:25:41.410608697 +0000 UTC m=+193.232532918" watchObservedRunningTime="2026-05-25 11:25:41.411605017 +0000 UTC m=+193.233529238"
May 25 11:25:41.430783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:41.430722    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c75576bcc-66gvl" podStartSLOduration=1.653081154 podStartE2EDuration="10.430709131s" podCreationTimestamp="2026-05-25 11:25:31 +0000 UTC" firstStartedPulling="2026-05-25 11:25:32.35794485 +0000 UTC m=+184.179869049" lastFinishedPulling="2026-05-25 11:25:41.135572829 +0000 UTC m=+192.957497026" observedRunningTime="2026-05-25 11:25:41.429281367 +0000 UTC m=+193.251205587" watchObservedRunningTime="2026-05-25 11:25:41.430709131 +0000 UTC m=+193.252633351"
May 25 11:25:42.198324 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:42.198283    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:42.198324 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:42.198330    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:42.204200 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:42.204171    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:42.348738 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:42.348705    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:25:42.355964 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:42.355943    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-v2pgb"
May 25 11:25:50.482728 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:50.482696    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:50.483152 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:50.482737    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:50.487355 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:50.487337    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:51.372990 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:51.372955    2557 generic.go:358] "Generic (PLEG): container finished" podID="6da01c3c-835e-45a6-a78e-4c7181374b53" containerID="33d705ccf83213507e1db56ba885044ae6399aff878d6ad5366947da5f95f178" exitCode=0
May 25 11:25:51.373176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:51.373034    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws" event={"ID":"6da01c3c-835e-45a6-a78e-4c7181374b53","Type":"ContainerDied","Data":"33d705ccf83213507e1db56ba885044ae6399aff878d6ad5366947da5f95f178"}
May 25 11:25:51.373430 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:51.373411    2557 scope.go:117] "RemoveContainer" containerID="33d705ccf83213507e1db56ba885044ae6399aff878d6ad5366947da5f95f178"
May 25 11:25:51.377135 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:51.377113    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:25:51.438640 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:51.438601    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c75576bcc-66gvl"]
May 25 11:25:52.377887 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:52.377835    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-thxws" event={"ID":"6da01c3c-835e-45a6-a78e-4c7181374b53","Type":"ContainerStarted","Data":"6ee03aee7d5eb909b82cf38b5266556c3e3fac96f1d9ebab8828bba742fe2231"}
May 25 11:25:53.381510 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:53.381481    2557 generic.go:358] "Generic (PLEG): container finished" podID="a40e9db2-70de-404a-a3f9-f82eeb82174c" containerID="755b055b868a2bb09cbdbf785bbd04f448b955f204e4c71939ff947dd1366ddb" exitCode=0
May 25 11:25:53.381909 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:53.381551    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n" event={"ID":"a40e9db2-70de-404a-a3f9-f82eeb82174c","Type":"ContainerDied","Data":"755b055b868a2bb09cbdbf785bbd04f448b955f204e4c71939ff947dd1366ddb"}
May 25 11:25:53.382276 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:53.382261    2557 scope.go:117] "RemoveContainer" containerID="755b055b868a2bb09cbdbf785bbd04f448b955f204e4c71939ff947dd1366ddb"
May 25 11:25:54.386581 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:25:54.386546    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9fr2n" event={"ID":"a40e9db2-70de-404a-a3f9-f82eeb82174c","Type":"ContainerStarted","Data":"f0e9ec8b193722e04375721776f6ffcd924f537404ab3a9372a4f866bbc3e23b"}
May 25 11:26:16.463438 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.463376    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c75576bcc-66gvl" podUID="b7117aee-a846-407e-9259-58dbbe8174e9" containerName="console" containerID="cri-o://33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24" gracePeriod=15
May 25 11:26:16.765134 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.765114    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c75576bcc-66gvl_b7117aee-a846-407e-9259-58dbbe8174e9/console/0.log"
May 25 11:26:16.765236 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.765181    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:26:16.851847 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.851814    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-oauth-serving-cert\") pod \"b7117aee-a846-407e-9259-58dbbe8174e9\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") "
May 25 11:26:16.852018 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.851861    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd7x8\" (UniqueName: \"kubernetes.io/projected/b7117aee-a846-407e-9259-58dbbe8174e9-kube-api-access-gd7x8\") pod \"b7117aee-a846-407e-9259-58dbbe8174e9\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") "
May 25 11:26:16.852018 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.851899    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-serving-cert\") pod \"b7117aee-a846-407e-9259-58dbbe8174e9\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") "
May 25 11:26:16.852093 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852064    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-console-config\") pod \"b7117aee-a846-407e-9259-58dbbe8174e9\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") "
May 25 11:26:16.852137 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852121    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-service-ca\") pod \"b7117aee-a846-407e-9259-58dbbe8174e9\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") "
May 25 11:26:16.852192 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852181    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-oauth-config\") pod \"b7117aee-a846-407e-9259-58dbbe8174e9\" (UID: \"b7117aee-a846-407e-9259-58dbbe8174e9\") "
May 25 11:26:16.852244 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852222    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7117aee-a846-407e-9259-58dbbe8174e9" (UID: "b7117aee-a846-407e-9259-58dbbe8174e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:16.852467 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852423    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-console-config" (OuterVolumeSpecName: "console-config") pod "b7117aee-a846-407e-9259-58dbbe8174e9" (UID: "b7117aee-a846-407e-9259-58dbbe8174e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:16.852467 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852451    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7117aee-a846-407e-9259-58dbbe8174e9" (UID: "b7117aee-a846-407e-9259-58dbbe8174e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:16.852609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852503    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:16.852609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.852520    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:16.854198 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.854169    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7117aee-a846-407e-9259-58dbbe8174e9" (UID: "b7117aee-a846-407e-9259-58dbbe8174e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:16.854304 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.854212    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7117aee-a846-407e-9259-58dbbe8174e9" (UID: "b7117aee-a846-407e-9259-58dbbe8174e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:16.854304 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.854223    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7117aee-a846-407e-9259-58dbbe8174e9-kube-api-access-gd7x8" (OuterVolumeSpecName: "kube-api-access-gd7x8") pod "b7117aee-a846-407e-9259-58dbbe8174e9" (UID: "b7117aee-a846-407e-9259-58dbbe8174e9"). InnerVolumeSpecName "kube-api-access-gd7x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:16.953094 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.953070    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd7x8\" (UniqueName: \"kubernetes.io/projected/b7117aee-a846-407e-9259-58dbbe8174e9-kube-api-access-gd7x8\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:16.953094 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.953092    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:16.953239 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.953102    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7117aee-a846-407e-9259-58dbbe8174e9-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:16.953239 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:16.953111    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7117aee-a846-407e-9259-58dbbe8174e9-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:17.449863 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.449838    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c75576bcc-66gvl_b7117aee-a846-407e-9259-58dbbe8174e9/console/0.log"
May 25 11:26:17.450032 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.449893    2557 generic.go:358] "Generic (PLEG): container finished" podID="b7117aee-a846-407e-9259-58dbbe8174e9" containerID="33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24" exitCode=2
May 25 11:26:17.450032 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.449949    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c75576bcc-66gvl" event={"ID":"b7117aee-a846-407e-9259-58dbbe8174e9","Type":"ContainerDied","Data":"33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24"}
May 25 11:26:17.450032 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.449962    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c75576bcc-66gvl"
May 25 11:26:17.450032 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.449984    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c75576bcc-66gvl" event={"ID":"b7117aee-a846-407e-9259-58dbbe8174e9","Type":"ContainerDied","Data":"b2114141689d7961a800adda882a8a02fbb22cde5b0fb047c3186ecb96f38a4a"}
May 25 11:26:17.450032 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.450003    2557 scope.go:117] "RemoveContainer" containerID="33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24"
May 25 11:26:17.461270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.461253    2557 scope.go:117] "RemoveContainer" containerID="33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24"
May 25 11:26:17.461534 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:17.461509    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24\": container with ID starting with 33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24 not found: ID does not exist" containerID="33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24"
May 25 11:26:17.461607 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.461543    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24"} err="failed to get container status \"33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24\": rpc error: code = NotFound desc = could not find container \"33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24\": container with ID starting with 33ce8dd41a0b3c5d3f97deae016cd942d21909356cf6584e1a792ed3a76b6e24 not found: ID does not exist"
May 25 11:26:17.472521 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.472499    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c75576bcc-66gvl"]
May 25 11:26:17.477299 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:17.477275    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c75576bcc-66gvl"]
May 25 11:26:18.779444 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:18.779410    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7117aee-a846-407e-9259-58dbbe8174e9" path="/var/lib/kubelet/pods/b7117aee-a846-407e-9259-58dbbe8174e9/volumes"
May 25 11:26:29.986454 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.986418    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:26:29.986903 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.986844    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="alertmanager" containerID="cri-o://4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591" gracePeriod=120
May 25 11:26:29.987048 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.986928    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-web" containerID="cri-o://7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3" gracePeriod=120
May 25 11:26:29.987048 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.986929    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-metric" containerID="cri-o://b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322" gracePeriod=120
May 25 11:26:29.987048 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.986978    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="prom-label-proxy" containerID="cri-o://52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5" gracePeriod=120
May 25 11:26:29.987222 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.987022    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy" containerID="cri-o://38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a" gracePeriod=120
May 25 11:26:29.987222 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:29.987067    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="config-reloader" containerID="cri-o://52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb" gracePeriod=120
May 25 11:26:30.489974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.489945    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5" exitCode=0
May 25 11:26:30.489974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.489967    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a" exitCode=0
May 25 11:26:30.489974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.489973    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3" exitCode=0
May 25 11:26:30.489974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.489981    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb" exitCode=0
May 25 11:26:30.490243 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.489986    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591" exitCode=0
May 25 11:26:30.490243 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.490015    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5"}
May 25 11:26:30.490243 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.490055    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a"}
May 25 11:26:30.490243 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.490068    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3"}
May 25 11:26:30.490243 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.490081    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb"}
May 25 11:26:30.490243 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:30.490093    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591"}
May 25 11:26:31.226349 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.226325    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.371187 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371157    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-out\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371213    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-web\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371244    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-main-db\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371264    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371287    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-tls-assets\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371318    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371345    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371373    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9z6z\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-kube-api-access-t9z6z\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371400    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-metrics-client-ca\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371445    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-web-config\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371478    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-cluster-tls-config\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371502    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-volume\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.371650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371532    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy\") pod \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\" (UID: \"716f91d1-7ea1-465d-a0e2-f60cd39f218e\") "
May 25 11:26:31.372031 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371731    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:26:31.372031 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371815    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-main-db\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.372031 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.371886    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:31.374282 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.374254    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-out" (OuterVolumeSpecName: "config-out") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:26:31.374436 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.374336    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:26:31.374954 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.374924    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-volume" (OuterVolumeSpecName: "config-volume") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.375301 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.375256    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.375420 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.375381    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:31.375506 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.375467    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.375581 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.375527    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-kube-api-access-t9z6z" (OuterVolumeSpecName: "kube-api-access-t9z6z") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "kube-api-access-t9z6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:26:31.376009 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.375973    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.377045 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.377009    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.379613 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.379526    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.386283 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.386256    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-web-config" (OuterVolumeSpecName: "web-config") pod "716f91d1-7ea1-465d-a0e2-f60cd39f218e" (UID: "716f91d1-7ea1-465d-a0e2-f60cd39f218e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:26:31.472683 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472659    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472683 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472682    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-out\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472692    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472701    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472711    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-tls-assets\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472720    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472729    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-secret-alertmanager-main-tls\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472738    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9z6z\" (UniqueName: \"kubernetes.io/projected/716f91d1-7ea1-465d-a0e2-f60cd39f218e-kube-api-access-t9z6z\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472746    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716f91d1-7ea1-465d-a0e2-f60cd39f218e-metrics-client-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472755    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-web-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472763    2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-cluster-tls-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.472804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.472771    2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/716f91d1-7ea1-465d-a0e2-f60cd39f218e-config-volume\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:26:31.495920 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.495898    2557 generic.go:358] "Generic (PLEG): container finished" podID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerID="b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322" exitCode=0
May 25 11:26:31.496015 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.495939    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322"}
May 25 11:26:31.496015 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.495960    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"716f91d1-7ea1-465d-a0e2-f60cd39f218e","Type":"ContainerDied","Data":"f8c72241632125d41bc1f124f05c2fefda270fb68fff5059829f9afb22b80da7"}
May 25 11:26:31.496015 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.495980    2557 scope.go:117] "RemoveContainer" containerID="52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5"
May 25 11:26:31.496151 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.496023    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.502830 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.502815    2557 scope.go:117] "RemoveContainer" containerID="b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322"
May 25 11:26:31.509523 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.509507    2557 scope.go:117] "RemoveContainer" containerID="38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a"
May 25 11:26:31.515439 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.515424    2557 scope.go:117] "RemoveContainer" containerID="7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3"
May 25 11:26:31.521654 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.521636    2557 scope.go:117] "RemoveContainer" containerID="52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb"
May 25 11:26:31.522157 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.522137    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:26:31.526670 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.526648    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:26:31.528364 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.528352    2557 scope.go:117] "RemoveContainer" containerID="4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591"
May 25 11:26:31.534340 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.534324    2557 scope.go:117] "RemoveContainer" containerID="d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54"
May 25 11:26:31.540150 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540136    2557 scope.go:117] "RemoveContainer" containerID="52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5"
May 25 11:26:31.540369 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.540351    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5\": container with ID starting with 52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5 not found: ID does not exist" containerID="52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5"
May 25 11:26:31.540420 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540375    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5"} err="failed to get container status \"52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5\": rpc error: code = NotFound desc = could not find container \"52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5\": container with ID starting with 52037cca064b9238a26e124fd861a8979aea985e70ca549a051f3502bcd3c3a5 not found: ID does not exist"
May 25 11:26:31.540420 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540392    2557 scope.go:117] "RemoveContainer" containerID="b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322"
May 25 11:26:31.540612 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.540595    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322\": container with ID starting with b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322 not found: ID does not exist" containerID="b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322"
May 25 11:26:31.540675 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540617    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322"} err="failed to get container status \"b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322\": rpc error: code = NotFound desc = could not find container \"b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322\": container with ID starting with b9b5678dfebaeee550c895f28cec660d842cf676670a8040ba9bde3fa1f32322 not found: ID does not exist"
May 25 11:26:31.540675 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540633    2557 scope.go:117] "RemoveContainer" containerID="38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a"
May 25 11:26:31.540857 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.540842    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a\": container with ID starting with 38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a not found: ID does not exist" containerID="38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a"
May 25 11:26:31.540929 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540879    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a"} err="failed to get container status \"38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a\": rpc error: code = NotFound desc = could not find container \"38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a\": container with ID starting with 38febf37226bb4faa31a4151b0a87b2c14824a618493f81f0217afbbc2916f0a not found: ID does not exist"
May 25 11:26:31.540929 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.540897    2557 scope.go:117] "RemoveContainer" containerID="7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3"
May 25 11:26:31.541165 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.541131    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3\": container with ID starting with 7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3 not found: ID does not exist" containerID="7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3"
May 25 11:26:31.541268 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541171    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3"} err="failed to get container status \"7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3\": rpc error: code = NotFound desc = could not find container \"7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3\": container with ID starting with 7993a3d9ac447b21798c9dc9268eb4b70357b9360c0eb8e3475dfd00b737deb3 not found: ID does not exist"
May 25 11:26:31.541268 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541190    2557 scope.go:117] "RemoveContainer" containerID="52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb"
May 25 11:26:31.541430 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.541413    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb\": container with ID starting with 52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb not found: ID does not exist" containerID="52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb"
May 25 11:26:31.541475 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541435    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb"} err="failed to get container status \"52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb\": rpc error: code = NotFound desc = could not find container \"52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb\": container with ID starting with 52dfd0a0e423760f4b542ce7e6e9fb3eb809dba7df0c4b1d8ca1830e7b9ccecb not found: ID does not exist"
May 25 11:26:31.541475 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541452    2557 scope.go:117] "RemoveContainer" containerID="4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591"
May 25 11:26:31.541639 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.541621    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591\": container with ID starting with 4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591 not found: ID does not exist" containerID="4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591"
May 25 11:26:31.541676 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541645    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591"} err="failed to get container status \"4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591\": rpc error: code = NotFound desc = could not find container \"4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591\": container with ID starting with 4f7f36c07378f6c5ea62392c53ba3eb77a9086e688902d6902e14fb94dd79591 not found: ID does not exist"
May 25 11:26:31.541676 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541661    2557 scope.go:117] "RemoveContainer" containerID="d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54"
May 25 11:26:31.541847 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:26:31.541833    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54\": container with ID starting with d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54 not found: ID does not exist" containerID="d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54"
May 25 11:26:31.541911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.541849    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54"} err="failed to get container status \"d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54\": rpc error: code = NotFound desc = could not find container \"d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54\": container with ID starting with d5004804b419a5cb59b3b857a800fcd879cba6c18471602df07de69f4d155e54 not found: ID does not exist"
May 25 11:26:31.555768 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.555745    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:26:31.556074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556060    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy"
May 25 11:26:31.556074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556075    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556087    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="init-config-reloader"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556093    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="init-config-reloader"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556100    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-metric"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556106    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-metric"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556113    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="prom-label-proxy"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556122    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="prom-label-proxy"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556133    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-web"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556137    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-web"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556144    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="config-reloader"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556148    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="config-reloader"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556154    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7117aee-a846-407e-9259-58dbbe8174e9" containerName="console"
May 25 11:26:31.556160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556159    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7117aee-a846-407e-9259-58dbbe8174e9" containerName="console"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556166    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="alertmanager"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556171    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="alertmanager"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556225    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-web"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556235    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556242    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="kube-rbac-proxy-metric"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556248    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="prom-label-proxy"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556254    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="config-reloader"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556260    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" containerName="alertmanager"
May 25 11:26:31.556482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.556271    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="b7117aee-a846-407e-9259-58dbbe8174e9" containerName="console"
May 25 11:26:31.559608 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.559594    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.564047 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564033    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 11:26:31.564210 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564192    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 11:26:31.564670 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564640    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 11:26:31.564766 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564682    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-shmtq\""
May 25 11:26:31.564766 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564709    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 11:26:31.564922 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564777    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 11:26:31.565012 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.564997    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 11:26:31.565616 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.565598    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 11:26:31.565677 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.565629    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 11:26:31.569130 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.569111    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 11:26:31.579588 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.579560    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:26:31.674819 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674740    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.674819 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.674819 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c6febc8e-51cf-4b27-8604-cd7d4404b57f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675025 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675025 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6febc8e-51cf-4b27-8604-cd7d4404b57f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675025 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674918    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675025 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675025 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.674953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6febc8e-51cf-4b27-8604-cd7d4404b57f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675025 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.675004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-web-config\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675227 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.675044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6febc8e-51cf-4b27-8604-cd7d4404b57f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675227 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.675064    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvsrv\" (UniqueName: \"kubernetes.io/projected/c6febc8e-51cf-4b27-8604-cd7d4404b57f-kube-api-access-lvsrv\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675227 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.675082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.675227 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.675134    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6febc8e-51cf-4b27-8604-cd7d4404b57f-config-out\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775501 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775467    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775501 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775501    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c6febc8e-51cf-4b27-8604-cd7d4404b57f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775546    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775573    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6febc8e-51cf-4b27-8604-cd7d4404b57f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775609    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775638    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775664    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6febc8e-51cf-4b27-8604-cd7d4404b57f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.775704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775701    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-web-config\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776023 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.775954    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6febc8e-51cf-4b27-8604-cd7d4404b57f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776023 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776018    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvsrv\" (UniqueName: \"kubernetes.io/projected/c6febc8e-51cf-4b27-8604-cd7d4404b57f-kube-api-access-lvsrv\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776134 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776046    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776134 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776105    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6febc8e-51cf-4b27-8604-cd7d4404b57f-config-out\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776240 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776176    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776568 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776542    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6febc8e-51cf-4b27-8604-cd7d4404b57f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.776692 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776658    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6febc8e-51cf-4b27-8604-cd7d4404b57f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.777156 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.776101    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c6febc8e-51cf-4b27-8604-cd7d4404b57f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.778606 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.778580    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.778706 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.778681    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.778838 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.778810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.778974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.778956    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6febc8e-51cf-4b27-8604-cd7d4404b57f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.779386 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.779365    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-web-config\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.779456 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.779393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.779456 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.779428    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.779734 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.779719    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c6febc8e-51cf-4b27-8604-cd7d4404b57f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.780333 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.780315    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6febc8e-51cf-4b27-8604-cd7d4404b57f-config-out\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.785090 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.785069    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvsrv\" (UniqueName: \"kubernetes.io/projected/c6febc8e-51cf-4b27-8604-cd7d4404b57f-kube-api-access-lvsrv\") pod \"alertmanager-main-0\" (UID: \"c6febc8e-51cf-4b27-8604-cd7d4404b57f\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:31.868974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:31.868952    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 11:26:32.003107 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:32.003076    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 11:26:32.006768 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:26:32.006734    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6febc8e_51cf_4b27_8604_cd7d4404b57f.slice/crio-c6bda6b85f3fc0db92f52ddabeb18e17130a94fb7483651495fbddf6062c5afc WatchSource:0}: Error finding container c6bda6b85f3fc0db92f52ddabeb18e17130a94fb7483651495fbddf6062c5afc: Status 404 returned error can't find the container with id c6bda6b85f3fc0db92f52ddabeb18e17130a94fb7483651495fbddf6062c5afc
May 25 11:26:32.499753 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:32.499726    2557 generic.go:358] "Generic (PLEG): container finished" podID="c6febc8e-51cf-4b27-8604-cd7d4404b57f" containerID="930070d6f64f3e5861fff3cc99fb57c0ca65ce4e861eed395eb3a43bee8c83b2" exitCode=0
May 25 11:26:32.500139 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:32.499813    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerDied","Data":"930070d6f64f3e5861fff3cc99fb57c0ca65ce4e861eed395eb3a43bee8c83b2"}
May 25 11:26:32.500139 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:32.499848    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"c6bda6b85f3fc0db92f52ddabeb18e17130a94fb7483651495fbddf6062c5afc"}
May 25 11:26:32.783461 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:32.783423    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="716f91d1-7ea1-465d-a0e2-f60cd39f218e" path="/var/lib/kubelet/pods/716f91d1-7ea1-465d-a0e2-f60cd39f218e/volumes"
May 25 11:26:33.506811 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.506779    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"17359eca7bd07529d1135ea652160457f62ea0da4d225376c1bd0ad0ef8bf0b1"}
May 25 11:26:33.506811 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.506812    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"afa5dbb17408b2a041f1eb070bcac2970ac23164de68034c171382496d6f2ee5"}
May 25 11:26:33.507215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.506823    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"9cf3d6c18d53a9247424c7a199057a4c4521a58fabcbea0d9234c3c352653b6d"}
May 25 11:26:33.507215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.506833    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"d0955cfe2873da7a544b594baa3d5382f703663ab995bf2f538f51bf45d17138"}
May 25 11:26:33.507215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.506851    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"1fba0c9c0e4a303cb6828d52aca93fa69203e12ae760a6baa7aa449bc5c44193"}
May 25 11:26:33.507215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.506859    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c6febc8e-51cf-4b27-8604-cd7d4404b57f","Type":"ContainerStarted","Data":"1e6b1a8f248ae9e7368349e3ced495761e8b01e0e36219527d197f526563b0ed"}
May 25 11:26:33.537652 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:33.537266    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5372484269999998 podStartE2EDuration="2.537248427s" podCreationTimestamp="2026-05-25 11:26:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:26:33.535461467 +0000 UTC m=+245.357385687" watchObservedRunningTime="2026-05-25 11:26:33.537248427 +0000 UTC m=+245.359172647"
May 25 11:26:40.652157 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:40.652104    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:26:40.654478 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:40.654453    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75775f92-a777-4a28-ac20-efe3d188bacc-metrics-certs\") pod \"network-metrics-daemon-64mv4\" (UID: \"75775f92-a777-4a28-ac20-efe3d188bacc\") " pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:26:40.878316 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:40.878278    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-brg2t\""
May 25 11:26:40.885709 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:40.885677    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-64mv4"
May 25 11:26:41.006801 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:41.006762    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-64mv4"]
May 25 11:26:41.009418 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:26:41.009393    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75775f92_a777_4a28_ac20_efe3d188bacc.slice/crio-82327bf1067c6a3383a8626386c1b70c906fca1f64832817528d0f9a3e06ddc0 WatchSource:0}: Error finding container 82327bf1067c6a3383a8626386c1b70c906fca1f64832817528d0f9a3e06ddc0: Status 404 returned error can't find the container with id 82327bf1067c6a3383a8626386c1b70c906fca1f64832817528d0f9a3e06ddc0
May 25 11:26:41.532244 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:41.532205    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64mv4" event={"ID":"75775f92-a777-4a28-ac20-efe3d188bacc","Type":"ContainerStarted","Data":"82327bf1067c6a3383a8626386c1b70c906fca1f64832817528d0f9a3e06ddc0"}
May 25 11:26:42.536783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:42.536750    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64mv4" event={"ID":"75775f92-a777-4a28-ac20-efe3d188bacc","Type":"ContainerStarted","Data":"72d6d64f00efbf57a3c238734e6e71108087247b045756c5c1e558dfe0b92c6b"}
May 25 11:26:42.536783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:42.536782    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-64mv4" event={"ID":"75775f92-a777-4a28-ac20-efe3d188bacc","Type":"ContainerStarted","Data":"b4ec8261a722cf959bab23180d800dcc40ff5552ed6e6863ed11d5394d051af3"}
May 25 11:26:42.556137 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:42.556093    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-64mv4" podStartSLOduration=252.666290201 podStartE2EDuration="4m13.556080173s" podCreationTimestamp="2026-05-25 11:22:29 +0000 UTC" firstStartedPulling="2026-05-25 11:26:41.011089 +0000 UTC m=+252.833013199" lastFinishedPulling="2026-05-25 11:26:41.900878973 +0000 UTC m=+253.722803171" observedRunningTime="2026-05-25 11:26:42.553400336 +0000 UTC m=+254.375324555" watchObservedRunningTime="2026-05-25 11:26:42.556080173 +0000 UTC m=+254.378004393"
May 25 11:26:51.300644 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.300575    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d664d5796-lbfb4"]
May 25 11:26:51.302621 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.302605    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.314661 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.314592    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d664d5796-lbfb4"]
May 25 11:26:51.328880 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.328833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-oauth-config\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.329000 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.328910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-trusted-ca-bundle\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.329000 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.328947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-serving-cert\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.329000 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.328974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-config\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.329115 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.329020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-984vr\" (UniqueName: \"kubernetes.io/projected/e7a9f300-0075-4cb9-ae12-a1e82b712384-kube-api-access-984vr\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.329115 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.329092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-oauth-serving-cert\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.329183 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.329146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-service-ca\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429541 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429509    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-config\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429707 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429553    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-984vr\" (UniqueName: \"kubernetes.io/projected/e7a9f300-0075-4cb9-ae12-a1e82b712384-kube-api-access-984vr\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429707 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429596    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-oauth-serving-cert\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429707 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429633    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-service-ca\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429707 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429663    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-oauth-config\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429967 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429823    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-trusted-ca-bundle\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.429967 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.429909    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-serving-cert\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.430384 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.430348    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-oauth-serving-cert\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.430502 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.430386    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-config\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.430502 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.430458    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-service-ca\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.430675 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.430656    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-trusted-ca-bundle\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.432148 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.432119    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-oauth-config\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.432278 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.432263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-serving-cert\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.437762 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.437732    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-984vr\" (UniqueName: \"kubernetes.io/projected/e7a9f300-0075-4cb9-ae12-a1e82b712384-kube-api-access-984vr\") pod \"console-6d664d5796-lbfb4\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") " pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.612832 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.612810    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:26:51.735653 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:51.735627    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d664d5796-lbfb4"]
May 25 11:26:51.737474 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:26:51.737442    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a9f300_0075_4cb9_ae12_a1e82b712384.slice/crio-f11cf8196b0c9824421f500b9a82d6f8094f91626fe56ec9da35560549574ebf WatchSource:0}: Error finding container f11cf8196b0c9824421f500b9a82d6f8094f91626fe56ec9da35560549574ebf: Status 404 returned error can't find the container with id f11cf8196b0c9824421f500b9a82d6f8094f91626fe56ec9da35560549574ebf
May 25 11:26:52.567001 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:52.566969    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d664d5796-lbfb4" event={"ID":"e7a9f300-0075-4cb9-ae12-a1e82b712384","Type":"ContainerStarted","Data":"5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db"}
May 25 11:26:52.567001 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:52.567003    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d664d5796-lbfb4" event={"ID":"e7a9f300-0075-4cb9-ae12-a1e82b712384","Type":"ContainerStarted","Data":"f11cf8196b0c9824421f500b9a82d6f8094f91626fe56ec9da35560549574ebf"}
May 25 11:26:52.586134 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:26:52.586085    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6d664d5796-lbfb4" podStartSLOduration=1.586067941 podStartE2EDuration="1.586067941s" podCreationTimestamp="2026-05-25 11:26:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:26:52.58558618 +0000 UTC m=+264.407510416" watchObservedRunningTime="2026-05-25 11:26:52.586067941 +0000 UTC m=+264.407992162"
May 25 11:27:01.613394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:01.613358    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:27:01.613394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:01.613398    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:27:01.618002 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:01.617976    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:27:02.600312 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:02.600286    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:27:02.648950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:02.648918    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb47598d4-mfslv"]
May 25 11:27:27.670098 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:27.670040    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-bb47598d4-mfslv" podUID="efa234e6-e568-4a3c-9a65-eed3ac4facb9" containerName="console" containerID="cri-o://24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b" gracePeriod=15
May 25 11:27:27.906883 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:27.906842    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bb47598d4-mfslv_efa234e6-e568-4a3c-9a65-eed3ac4facb9/console/0.log"
May 25 11:27:27.906976 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:27.906917    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:27:28.021124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021063    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdpxs\" (UniqueName: \"kubernetes.io/projected/efa234e6-e568-4a3c-9a65-eed3ac4facb9-kube-api-access-xdpxs\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021109    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-trusted-ca-bundle\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021259 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021127    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-oauth-config\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021259 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021150    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-config\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021259 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021204    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-oauth-serving-cert\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021259 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021224    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-service-ca\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021259 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021251    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-serving-cert\") pod \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\" (UID: \"efa234e6-e568-4a3c-9a65-eed3ac4facb9\") "
May 25 11:27:28.021658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021597    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:27:28.021658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021603    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:27:28.021658 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021633    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-config" (OuterVolumeSpecName: "console-config") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:27:28.021794 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.021651    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-service-ca" (OuterVolumeSpecName: "service-ca") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:27:28.023365 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.023342    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:27:28.023670 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.023644    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:27:28.023670 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.023654    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efa234e6-e568-4a3c-9a65-eed3ac4facb9-kube-api-access-xdpxs" (OuterVolumeSpecName: "kube-api-access-xdpxs") pod "efa234e6-e568-4a3c-9a65-eed3ac4facb9" (UID: "efa234e6-e568-4a3c-9a65-eed3ac4facb9"). InnerVolumeSpecName "kube-api-access-xdpxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:27:28.121921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121889    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdpxs\" (UniqueName: \"kubernetes.io/projected/efa234e6-e568-4a3c-9a65-eed3ac4facb9-kube-api-access-xdpxs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.121921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121920    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.121921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121930    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.122080 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121939    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.122080 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121949    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.122080 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121957    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/efa234e6-e568-4a3c-9a65-eed3ac4facb9-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.122080 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.121967    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/efa234e6-e568-4a3c-9a65-eed3ac4facb9-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:27:28.672564 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.672538    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bb47598d4-mfslv_efa234e6-e568-4a3c-9a65-eed3ac4facb9/console/0.log"
May 25 11:27:28.672564 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.672573    2557 generic.go:358] "Generic (PLEG): container finished" podID="efa234e6-e568-4a3c-9a65-eed3ac4facb9" containerID="24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b" exitCode=2
May 25 11:27:28.673121 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.672623    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb47598d4-mfslv" event={"ID":"efa234e6-e568-4a3c-9a65-eed3ac4facb9","Type":"ContainerDied","Data":"24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b"}
May 25 11:27:28.673121 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.672643    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb47598d4-mfslv" event={"ID":"efa234e6-e568-4a3c-9a65-eed3ac4facb9","Type":"ContainerDied","Data":"88f2baa18df958b52fdb87b9b56853983c37eb74b40a4403efdb441b8078070b"}
May 25 11:27:28.673121 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.672657    2557 scope.go:117] "RemoveContainer" containerID="24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b"
May 25 11:27:28.673121 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.672758    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb47598d4-mfslv"
May 25 11:27:28.683394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.683370    2557 scope.go:117] "RemoveContainer" containerID="24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b"
May 25 11:27:28.683648 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:27:28.683616    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b\": container with ID starting with 24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b not found: ID does not exist" containerID="24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b"
May 25 11:27:28.683739 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.683657    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b"} err="failed to get container status \"24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b\": rpc error: code = NotFound desc = could not find container \"24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b\": container with ID starting with 24b8943e0b6b7d45f6ed66b90b9e53013d6d0d03796678f79c91458a2c781d1b not found: ID does not exist"
May 25 11:27:28.684675 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.684657    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:27:28.693492 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.692918    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:27:28.698042 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.698021    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb47598d4-mfslv"]
May 25 11:27:28.701957 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.701936    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bb47598d4-mfslv"]
May 25 11:27:28.702377 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.702346    2557 kubelet.go:1628] "Image garbage collection succeeded"
May 25 11:27:28.779925 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:28.779791    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efa234e6-e568-4a3c-9a65-eed3ac4facb9" path="/var/lib/kubelet/pods/efa234e6-e568-4a3c-9a65-eed3ac4facb9/volumes"
May 25 11:27:59.675099 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.675067    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"]
May 25 11:27:59.675546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.675378    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efa234e6-e568-4a3c-9a65-eed3ac4facb9" containerName="console"
May 25 11:27:59.675546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.675388    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="efa234e6-e568-4a3c-9a65-eed3ac4facb9" containerName="console"
May 25 11:27:59.675546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.675440    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="efa234e6-e568-4a3c-9a65-eed3ac4facb9" containerName="console"
May 25 11:27:59.678353 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.678338    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.681412 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.681389    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
May 25 11:27:59.681613 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.681600    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
May 25 11:27:59.681668 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.681629    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
May 25 11:27:59.682306 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.682279    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-8sr54\""
May 25 11:27:59.688326 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.688305    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"]
May 25 11:27:59.774322 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.774299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcnf\" (UniqueName: \"kubernetes.io/projected/261f7b2a-b80b-4ccb-884d-e78f5c8adc73-kube-api-access-wkcnf\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h\" (UID: \"261f7b2a-b80b-4ccb-884d-e78f5c8adc73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.774422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.774357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/261f7b2a-b80b-4ccb-884d-e78f5c8adc73-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h\" (UID: \"261f7b2a-b80b-4ccb-884d-e78f5c8adc73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.875264 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.875245    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcnf\" (UniqueName: \"kubernetes.io/projected/261f7b2a-b80b-4ccb-884d-e78f5c8adc73-kube-api-access-wkcnf\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h\" (UID: \"261f7b2a-b80b-4ccb-884d-e78f5c8adc73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.875336 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.875271    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/261f7b2a-b80b-4ccb-884d-e78f5c8adc73-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h\" (UID: \"261f7b2a-b80b-4ccb-884d-e78f5c8adc73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.877420 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.877404    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/261f7b2a-b80b-4ccb-884d-e78f5c8adc73-certificates\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h\" (UID: \"261f7b2a-b80b-4ccb-884d-e78f5c8adc73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.886241 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.886222    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcnf\" (UniqueName: \"kubernetes.io/projected/261f7b2a-b80b-4ccb-884d-e78f5c8adc73-kube-api-access-wkcnf\") pod \"custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h\" (UID: \"261f7b2a-b80b-4ccb-884d-e78f5c8adc73\") " pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:27:59.988417 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:27:59.988361    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:28:00.116395 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:00.116368    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"]
May 25 11:28:00.119853 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:28:00.119826    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261f7b2a_b80b_4ccb_884d_e78f5c8adc73.slice/crio-76ad552f91fbf90c4a84528723e752ed52e982a175046e043ae26789d54b56ac WatchSource:0}: Error finding container 76ad552f91fbf90c4a84528723e752ed52e982a175046e043ae26789d54b56ac: Status 404 returned error can't find the container with id 76ad552f91fbf90c4a84528723e752ed52e982a175046e043ae26789d54b56ac
May 25 11:28:00.121599 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:00.121576    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:28:00.770405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:00.770366    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h" event={"ID":"261f7b2a-b80b-4ccb-884d-e78f5c8adc73","Type":"ContainerStarted","Data":"76ad552f91fbf90c4a84528723e752ed52e982a175046e043ae26789d54b56ac"}
May 25 11:28:03.790699 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:03.790655    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h" event={"ID":"261f7b2a-b80b-4ccb-884d-e78f5c8adc73","Type":"ContainerStarted","Data":"bad3b99bb8da7368b9a516fc0ec4fcaba083a08c9c74dde28b3586cc72e8ad75"}
May 25 11:28:03.791151 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:03.790725    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:28:03.817443 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:03.817396    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h" podStartSLOduration=1.2802302779999999 podStartE2EDuration="4.817382326s" podCreationTimestamp="2026-05-25 11:27:59 +0000 UTC" firstStartedPulling="2026-05-25 11:28:00.121775638 +0000 UTC m=+331.943699842" lastFinishedPulling="2026-05-25 11:28:03.65892769 +0000 UTC m=+335.480851890" observedRunningTime="2026-05-25 11:28:03.816079609 +0000 UTC m=+335.638003829" watchObservedRunningTime="2026-05-25 11:28:03.817382326 +0000 UTC m=+335.639306546"
May 25 11:28:04.912655 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:04.912617    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-cf49989db-b4z6t"]
May 25 11:28:04.915921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:04.915888    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:04.920354 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:04.920335    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
May 25 11:28:04.920473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:04.920352    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
May 25 11:28:04.920473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:04.920333    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-lrlk9\""
May 25 11:28:04.932027 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:04.932004    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-b4z6t"]
May 25 11:28:05.026447 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.026411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgcp5\" (UniqueName: \"kubernetes.io/projected/bbad7f28-f532-47ba-ae5f-88735b7e51f5-kube-api-access-wgcp5\") pod \"keda-admission-cf49989db-b4z6t\" (UID: \"bbad7f28-f532-47ba-ae5f-88735b7e51f5\") " pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.026714 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.026694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bbad7f28-f532-47ba-ae5f-88735b7e51f5-certificates\") pod \"keda-admission-cf49989db-b4z6t\" (UID: \"bbad7f28-f532-47ba-ae5f-88735b7e51f5\") " pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.127831 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.127800    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgcp5\" (UniqueName: \"kubernetes.io/projected/bbad7f28-f532-47ba-ae5f-88735b7e51f5-kube-api-access-wgcp5\") pod \"keda-admission-cf49989db-b4z6t\" (UID: \"bbad7f28-f532-47ba-ae5f-88735b7e51f5\") " pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.128010 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.127850    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bbad7f28-f532-47ba-ae5f-88735b7e51f5-certificates\") pod \"keda-admission-cf49989db-b4z6t\" (UID: \"bbad7f28-f532-47ba-ae5f-88735b7e51f5\") " pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.130403 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.130382    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/bbad7f28-f532-47ba-ae5f-88735b7e51f5-certificates\") pod \"keda-admission-cf49989db-b4z6t\" (UID: \"bbad7f28-f532-47ba-ae5f-88735b7e51f5\") " pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.137655 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.137630    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgcp5\" (UniqueName: \"kubernetes.io/projected/bbad7f28-f532-47ba-ae5f-88735b7e51f5-kube-api-access-wgcp5\") pod \"keda-admission-cf49989db-b4z6t\" (UID: \"bbad7f28-f532-47ba-ae5f-88735b7e51f5\") " pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.226240 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.225784    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:05.368921 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.368695    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-cf49989db-b4z6t"]
May 25 11:28:05.371623 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:28:05.371590    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbad7f28_f532_47ba_ae5f_88735b7e51f5.slice/crio-04ec912c8c8865b521d6c59bd6897408dfac07e9155421545f8e16daab51d29d WatchSource:0}: Error finding container 04ec912c8c8865b521d6c59bd6897408dfac07e9155421545f8e16daab51d29d: Status 404 returned error can't find the container with id 04ec912c8c8865b521d6c59bd6897408dfac07e9155421545f8e16daab51d29d
May 25 11:28:05.798689 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:05.798652    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-b4z6t" event={"ID":"bbad7f28-f532-47ba-ae5f-88735b7e51f5","Type":"ContainerStarted","Data":"04ec912c8c8865b521d6c59bd6897408dfac07e9155421545f8e16daab51d29d"}
May 25 11:28:06.803040 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:06.803012    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-cf49989db-b4z6t" event={"ID":"bbad7f28-f532-47ba-ae5f-88735b7e51f5","Type":"ContainerStarted","Data":"1254c1f007987e21e6adc0dfc37c523bed8f564d4b441eeeacec6d0302480520"}
May 25 11:28:06.803361 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:06.803068    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:28:06.824912 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:06.824854    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-keda/keda-admission-cf49989db-b4z6t" podStartSLOduration=1.48617282 podStartE2EDuration="2.824838653s" podCreationTimestamp="2026-05-25 11:28:04 +0000 UTC" firstStartedPulling="2026-05-25 11:28:05.373058604 +0000 UTC m=+337.194982808" lastFinishedPulling="2026-05-25 11:28:06.711724443 +0000 UTC m=+338.533648641" observedRunningTime="2026-05-25 11:28:06.821753653 +0000 UTC m=+338.643677884" watchObservedRunningTime="2026-05-25 11:28:06.824838653 +0000 UTC m=+338.646762874"
May 25 11:28:24.796758 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:24.796689    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-bbf89fd5d-gvs7h"
May 25 11:28:27.807456 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:28:27.807423    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-cf49989db-b4z6t"
May 25 11:29:33.789335 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.789306    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"]
May 25 11:29:33.792532 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.792517    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:33.795225 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.795205    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 25 11:29:33.795320 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.795248    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 25 11:29:33.796641 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.796622    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l4fk7\""
May 25 11:29:33.800199 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.800179    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"]
May 25 11:29:33.928050 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.928025    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26sk\" (UniqueName: \"kubernetes.io/projected/59466856-eac4-4cf6-beda-68b7654a9e2e-kube-api-access-k26sk\") pod \"openshift-lws-operator-bfc7f696d-vcdcn\" (UID: \"59466856-eac4-4cf6-beda-68b7654a9e2e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:33.928176 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:33.928142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59466856-eac4-4cf6-beda-68b7654a9e2e-tmp\") pod \"openshift-lws-operator-bfc7f696d-vcdcn\" (UID: \"59466856-eac4-4cf6-beda-68b7654a9e2e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:34.028761 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:34.028726    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59466856-eac4-4cf6-beda-68b7654a9e2e-tmp\") pod \"openshift-lws-operator-bfc7f696d-vcdcn\" (UID: \"59466856-eac4-4cf6-beda-68b7654a9e2e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:34.028956 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:34.028777    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k26sk\" (UniqueName: \"kubernetes.io/projected/59466856-eac4-4cf6-beda-68b7654a9e2e-kube-api-access-k26sk\") pod \"openshift-lws-operator-bfc7f696d-vcdcn\" (UID: \"59466856-eac4-4cf6-beda-68b7654a9e2e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:34.029195 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:34.029173    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59466856-eac4-4cf6-beda-68b7654a9e2e-tmp\") pod \"openshift-lws-operator-bfc7f696d-vcdcn\" (UID: \"59466856-eac4-4cf6-beda-68b7654a9e2e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:34.037519 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:34.037497    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26sk\" (UniqueName: \"kubernetes.io/projected/59466856-eac4-4cf6-beda-68b7654a9e2e-kube-api-access-k26sk\") pod \"openshift-lws-operator-bfc7f696d-vcdcn\" (UID: \"59466856-eac4-4cf6-beda-68b7654a9e2e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:34.109731 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:34.109704    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"
May 25 11:29:34.236092 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:34.236062    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn"]
May 25 11:29:34.239190 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:29:34.239164    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59466856_eac4_4cf6_beda_68b7654a9e2e.slice/crio-58990bfb584826067f988d617f09f5c53f9215bf565539288c70b5119968cb86 WatchSource:0}: Error finding container 58990bfb584826067f988d617f09f5c53f9215bf565539288c70b5119968cb86: Status 404 returned error can't find the container with id 58990bfb584826067f988d617f09f5c53f9215bf565539288c70b5119968cb86
May 25 11:29:35.079102 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:35.079064    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn" event={"ID":"59466856-eac4-4cf6-beda-68b7654a9e2e","Type":"ContainerStarted","Data":"58990bfb584826067f988d617f09f5c53f9215bf565539288c70b5119968cb86"}
May 25 11:29:37.086711 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:37.086680    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn" event={"ID":"59466856-eac4-4cf6-beda-68b7654a9e2e","Type":"ContainerStarted","Data":"d4bff665fd0491e5866ab0c73cabd1dcde09b2183edd001c871fbb5d5590db25"}
May 25 11:29:37.105783 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:29:37.105736    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-vcdcn" podStartSLOduration=1.565215774 podStartE2EDuration="4.105720008s" podCreationTimestamp="2026-05-25 11:29:33 +0000 UTC" firstStartedPulling="2026-05-25 11:29:34.24049985 +0000 UTC m=+426.062424049" lastFinishedPulling="2026-05-25 11:29:36.781004072 +0000 UTC m=+428.602928283" observedRunningTime="2026-05-25 11:29:37.104157585 +0000 UTC m=+428.926081805" watchObservedRunningTime="2026-05-25 11:29:37.105720008 +0000 UTC m=+428.927644230"
May 25 11:30:18.012593 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.012556    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"]
May 25 11:30:18.019561 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.019540    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.022686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.022664    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 25 11:30:18.022806 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.022687    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 25 11:30:18.022983 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.022970    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 25 11:30:18.023395 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.023379    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qbr4v\""
May 25 11:30:18.023484 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.023432    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 25 11:30:18.029012 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.028994    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"]
May 25 11:30:18.088531 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088499    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-token\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.088661 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-cacerts\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.088661 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.088661 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.088661 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.088800 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkdr\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-kube-api-access-gmkdr\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.088800 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.088729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-local-certs\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.189974 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.189939    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190133 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.189982    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190133 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.190020    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190133 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.190043    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkdr\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-kube-api-access-gmkdr\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190133 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.190063    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-local-certs\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190133 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.190123    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-token\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190413 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.190150    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-cacerts\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.190737 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.190708    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.192419 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.192400    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-local-certs\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.192516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.192446    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-kubeconfig\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.192691 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.192674    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.192751 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.192690    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-cacerts\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.201159 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.201139    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-token\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.201415 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.201397    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkdr\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-kube-api-access-gmkdr\") pod \"istiod-openshift-gateway-767cf5cf55-drj97\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") " pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.329105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.329079    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:18.458343 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:18.458319    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"]
May 25 11:30:18.460287 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:30:18.460263    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61f7d5b_4b8e_4497_9acf_d69dace81c3d.slice/crio-e5ff00eb8286bdb00d18f93f5acd823cf3b0e199c30dfcda2087c777d69b33e3 WatchSource:0}: Error finding container e5ff00eb8286bdb00d18f93f5acd823cf3b0e199c30dfcda2087c777d69b33e3: Status 404 returned error can't find the container with id e5ff00eb8286bdb00d18f93f5acd823cf3b0e199c30dfcda2087c777d69b33e3
May 25 11:30:19.218846 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:19.218810    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" event={"ID":"c61f7d5b-4b8e-4497-9acf-d69dace81c3d","Type":"ContainerStarted","Data":"e5ff00eb8286bdb00d18f93f5acd823cf3b0e199c30dfcda2087c777d69b33e3"}
May 25 11:30:24.621222 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:24.621183    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:30:24.621572 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:24.621262    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:30:25.247683 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:25.247604    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" event={"ID":"c61f7d5b-4b8e-4497-9acf-d69dace81c3d","Type":"ContainerStarted","Data":"bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f"}
May 25 11:30:25.247918 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:25.247795    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:25.249411 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:25.249385    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-767cf5cf55-drj97 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 25 11:30:25.249520 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:25.249445    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" podUID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:30:25.275229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:25.275181    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" podStartSLOduration=2.116176313 podStartE2EDuration="8.275148165s" podCreationTimestamp="2026-05-25 11:30:17 +0000 UTC" firstStartedPulling="2026-05-25 11:30:18.461992805 +0000 UTC m=+470.283917003" lastFinishedPulling="2026-05-25 11:30:24.620964657 +0000 UTC m=+476.442888855" observedRunningTime="2026-05-25 11:30:25.274100516 +0000 UTC m=+477.096024737" watchObservedRunningTime="2026-05-25 11:30:25.275148165 +0000 UTC m=+477.097072385"
May 25 11:30:26.251863 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.251830    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:30:26.613256 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.613226    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"]
May 25 11:30:26.616607 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.616582    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.619333 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.619314    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-default-dockercfg-wn9qb\""
May 25 11:30:26.631221 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.631194    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"]
May 25 11:30:26.771950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.771920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-credential-socket\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772101 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.771959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772101 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.771986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772101 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.772028    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-workload-certs\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772101 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.772050    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-token\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772308 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.772118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-workload-socket\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772308 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.772163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj5r9\" (UniqueName: \"kubernetes.io/projected/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-kube-api-access-zj5r9\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772308 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.772197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-data\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.772308 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.772236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.872959 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.872888    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-credential-socket\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.872959 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.872921    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.872959 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.872939    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.872959 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.872957    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-workload-certs\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873230 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.872974    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-token\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873230 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873008    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-workload-socket\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873230 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873036    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj5r9\" (UniqueName: \"kubernetes.io/projected/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-kube-api-access-zj5r9\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873230 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873073    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-data\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873230 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873099    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873482 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873455    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-workload-certs\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873534 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873486    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-data\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873637 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873614    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-credential-socket\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873734 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873709    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.873901 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.873862    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-workload-socket\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.875300 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.875283    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-envoy\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.875453 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.875439    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-podinfo\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.881186 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.881162    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-istio-token\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.881379 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.881359    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj5r9\" (UniqueName: \"kubernetes.io/projected/f803fbfa-e0d0-41e3-9364-55e3dd0a752b-kube-api-access-zj5r9\") pod \"openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b\" (UID: \"f803fbfa-e0d0-41e3-9364-55e3dd0a752b\") " pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:26.929287 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:26.929259    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:27.064323 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:27.064296    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"]
May 25 11:30:27.066169 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:30:27.066143    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf803fbfa_e0d0_41e3_9364_55e3dd0a752b.slice/crio-e6da17ba7419da21f7c0a8d05acae165f178b75c67f3703eec46569c5052f379 WatchSource:0}: Error finding container e6da17ba7419da21f7c0a8d05acae165f178b75c67f3703eec46569c5052f379: Status 404 returned error can't find the container with id e6da17ba7419da21f7c0a8d05acae165f178b75c67f3703eec46569c5052f379
May 25 11:30:27.255459 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:27.255388    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b" event={"ID":"f803fbfa-e0d0-41e3-9364-55e3dd0a752b","Type":"ContainerStarted","Data":"e6da17ba7419da21f7c0a8d05acae165f178b75c67f3703eec46569c5052f379"}
May 25 11:30:38.836911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.836880    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-dbc4ffb98-7krqt"]
May 25 11:30:38.840681 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.840661    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.850747 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.850218    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dbc4ffb98-7krqt"]
May 25 11:30:38.968204 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968174    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-serving-cert\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.968347 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-config\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.968347 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968231    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28k5s\" (UniqueName: \"kubernetes.io/projected/339ccd60-a9d4-4f64-b795-e8efb077aeef-kube-api-access-28k5s\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.968347 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-oauth-config\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.968452 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-trusted-ca-bundle\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.968452 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-oauth-serving-cert\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:38.968452 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:38.968423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-service-ca\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.068851 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.068817    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-oauth-serving-cert\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.068851 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.068854    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-service-ca\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.068911    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-serving-cert\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.068938    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-config\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.068959    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28k5s\" (UniqueName: \"kubernetes.io/projected/339ccd60-a9d4-4f64-b795-e8efb077aeef-kube-api-access-28k5s\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.068991    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-oauth-config\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069105 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.069028    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-trusted-ca-bundle\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069559 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.069537    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-oauth-serving-cert\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069660 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.069609    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-service-ca\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.069660 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.069640    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-config\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.070257 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.070226    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/339ccd60-a9d4-4f64-b795-e8efb077aeef-trusted-ca-bundle\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.071327 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.071303    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-oauth-config\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.071619 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.071602    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/339ccd60-a9d4-4f64-b795-e8efb077aeef-console-serving-cert\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.079965 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.079945    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28k5s\" (UniqueName: \"kubernetes.io/projected/339ccd60-a9d4-4f64-b795-e8efb077aeef-kube-api-access-28k5s\") pod \"console-dbc4ffb98-7krqt\" (UID: \"339ccd60-a9d4-4f64-b795-e8efb077aeef\") " pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.154102 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.154021    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:39.286058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:39.285928    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dbc4ffb98-7krqt"]
May 25 11:30:39.288679 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:30:39.288650    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod339ccd60_a9d4_4f64_b795_e8efb077aeef.slice/crio-1ffcdb07fa47dfadb701cb3d2f154914776021dac4cc34694ad949e0744c2837 WatchSource:0}: Error finding container 1ffcdb07fa47dfadb701cb3d2f154914776021dac4cc34694ad949e0744c2837: Status 404 returned error can't find the container with id 1ffcdb07fa47dfadb701cb3d2f154914776021dac4cc34694ad949e0744c2837
May 25 11:30:40.295993 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:40.295957    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dbc4ffb98-7krqt" event={"ID":"339ccd60-a9d4-4f64-b795-e8efb077aeef","Type":"ContainerStarted","Data":"1a38624512d85b3feec2c0763438e6baf0509fe42ae7ef76bf8f451802784756"}
May 25 11:30:40.295993 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:40.295995    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dbc4ffb98-7krqt" event={"ID":"339ccd60-a9d4-4f64-b795-e8efb077aeef","Type":"ContainerStarted","Data":"1ffcdb07fa47dfadb701cb3d2f154914776021dac4cc34694ad949e0744c2837"}
May 25 11:30:40.317764 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:40.317721    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-dbc4ffb98-7krqt" podStartSLOduration=2.317706334 podStartE2EDuration="2.317706334s" podCreationTimestamp="2026-05-25 11:30:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:30:40.316378502 +0000 UTC m=+492.138302722" watchObservedRunningTime="2026-05-25 11:30:40.317706334 +0000 UTC m=+492.139630553"
May 25 11:30:43.209066 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:43.209024    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:30:43.209318 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:43.209098    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:30:43.209318 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:43.209126    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:30:43.308162 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:43.308127    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b" event={"ID":"f803fbfa-e0d0-41e3-9364-55e3dd0a752b","Type":"ContainerStarted","Data":"74155b96dfd01e8563b073fe8c80a987fdbd7d3de90985ac4a56b0a43b1afbe8"}
May 25 11:30:43.332657 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:43.332601    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b" podStartSLOduration=1.19204293 podStartE2EDuration="17.332585723s" podCreationTimestamp="2026-05-25 11:30:26 +0000 UTC" firstStartedPulling="2026-05-25 11:30:27.0682581 +0000 UTC m=+478.890182301" lastFinishedPulling="2026-05-25 11:30:43.208800885 +0000 UTC m=+495.030725094" observedRunningTime="2026-05-25 11:30:43.329725625 +0000 UTC m=+495.151649845" watchObservedRunningTime="2026-05-25 11:30:43.332585723 +0000 UTC m=+495.154509943"
May 25 11:30:43.930140 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:43.930113    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:44.933989 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:44.933959    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:45.315277 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:45.315201    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:45.316013 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:45.315997    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b"
May 25 11:30:49.155047 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:49.155014    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:49.155047 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:49.155053    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:49.159992 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:49.159970    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:49.332162 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:49.332139    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dbc4ffb98-7krqt"
May 25 11:30:49.385102 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:30:49.385071    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d664d5796-lbfb4"]
May 25 11:31:00.807044 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.807010    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"]
May 25 11:31:00.816574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.816546    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:00.822158 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.822133    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 25 11:31:00.822393 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.822381    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 25 11:31:00.822514 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.822488    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tqg96\""
May 25 11:31:00.831252 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.831230    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"]
May 25 11:31:00.841394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.841367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6255g\" (UniqueName: \"kubernetes.io/projected/d2c37b57-4779-4029-9f1b-4f4e89ca72aa-kube-api-access-6255g\") pod \"limitador-operator-controller-manager-c7fb4c8d5-7lqpv\" (UID: \"d2c37b57-4779-4029-9f1b-4f4e89ca72aa\") " pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:00.942342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.942312    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6255g\" (UniqueName: \"kubernetes.io/projected/d2c37b57-4779-4029-9f1b-4f4e89ca72aa-kube-api-access-6255g\") pod \"limitador-operator-controller-manager-c7fb4c8d5-7lqpv\" (UID: \"d2c37b57-4779-4029-9f1b-4f4e89ca72aa\") " pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:00.951022 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:00.951002    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6255g\" (UniqueName: \"kubernetes.io/projected/d2c37b57-4779-4029-9f1b-4f4e89ca72aa-kube-api-access-6255g\") pod \"limitador-operator-controller-manager-c7fb4c8d5-7lqpv\" (UID: \"d2c37b57-4779-4029-9f1b-4f4e89ca72aa\") " pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:01.127134 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:01.127103    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:01.255937 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:01.255908    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"]
May 25 11:31:01.258960 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:31:01.258933    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c37b57_4779_4029_9f1b_4f4e89ca72aa.slice/crio-3980da33f727ec141dea5f7439e939dad94423c7ba755b7d8d07b0d8c5d67b6e WatchSource:0}: Error finding container 3980da33f727ec141dea5f7439e939dad94423c7ba755b7d8d07b0d8c5d67b6e: Status 404 returned error can't find the container with id 3980da33f727ec141dea5f7439e939dad94423c7ba755b7d8d07b0d8c5d67b6e
May 25 11:31:01.372877 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:01.372822    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv" event={"ID":"d2c37b57-4779-4029-9f1b-4f4e89ca72aa","Type":"ContainerStarted","Data":"3980da33f727ec141dea5f7439e939dad94423c7ba755b7d8d07b0d8c5d67b6e"}
May 25 11:31:03.548099 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.548060    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-tkk4v"]
May 25 11:31:03.551923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.551895    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:03.557691 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.557465    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jnjfw\""
May 25 11:31:03.578210 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.578173    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-tkk4v"]
May 25 11:31:03.670012 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.669975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfmw7\" (UniqueName: \"kubernetes.io/projected/c5321d00-68da-4d16-b0bf-71f082bfbbc0-kube-api-access-nfmw7\") pod \"authorino-operator-7587b89b76-tkk4v\" (UID: \"c5321d00-68da-4d16-b0bf-71f082bfbbc0\") " pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:03.770735 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.770702    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfmw7\" (UniqueName: \"kubernetes.io/projected/c5321d00-68da-4d16-b0bf-71f082bfbbc0-kube-api-access-nfmw7\") pod \"authorino-operator-7587b89b76-tkk4v\" (UID: \"c5321d00-68da-4d16-b0bf-71f082bfbbc0\") " pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:03.782333 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.782306    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfmw7\" (UniqueName: \"kubernetes.io/projected/c5321d00-68da-4d16-b0bf-71f082bfbbc0-kube-api-access-nfmw7\") pod \"authorino-operator-7587b89b76-tkk4v\" (UID: \"c5321d00-68da-4d16-b0bf-71f082bfbbc0\") " pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:03.864565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:03.864541    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:04.007361 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:04.007332    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7587b89b76-tkk4v"]
May 25 11:31:04.009629 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:31:04.009596    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5321d00_68da_4d16_b0bf_71f082bfbbc0.slice/crio-6b58834cacfaf652f8e0e0e45640bbfdda102352e8184bf0baadc0b4ca971954 WatchSource:0}: Error finding container 6b58834cacfaf652f8e0e0e45640bbfdda102352e8184bf0baadc0b4ca971954: Status 404 returned error can't find the container with id 6b58834cacfaf652f8e0e0e45640bbfdda102352e8184bf0baadc0b4ca971954
May 25 11:31:04.387436 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:04.387407    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv" event={"ID":"d2c37b57-4779-4029-9f1b-4f4e89ca72aa","Type":"ContainerStarted","Data":"f4125c2c8c495702ee165c225a9bc2f2a369636e10decc171258aca87ce3ea99"}
May 25 11:31:04.387624 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:04.387519    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:04.388543 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:04.388522    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v" event={"ID":"c5321d00-68da-4d16-b0bf-71f082bfbbc0","Type":"ContainerStarted","Data":"6b58834cacfaf652f8e0e0e45640bbfdda102352e8184bf0baadc0b4ca971954"}
May 25 11:31:04.428575 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:04.428527    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv" podStartSLOduration=1.873944232 podStartE2EDuration="4.428512515s" podCreationTimestamp="2026-05-25 11:31:00 +0000 UTC" firstStartedPulling="2026-05-25 11:31:01.261063514 +0000 UTC m=+513.082987715" lastFinishedPulling="2026-05-25 11:31:03.815631796 +0000 UTC m=+515.637555998" observedRunningTime="2026-05-25 11:31:04.42661755 +0000 UTC m=+516.248541773" watchObservedRunningTime="2026-05-25 11:31:04.428512515 +0000 UTC m=+516.250436735"
May 25 11:31:06.396939 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:06.396903    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v" event={"ID":"c5321d00-68da-4d16-b0bf-71f082bfbbc0","Type":"ContainerStarted","Data":"f5758d3c6423ff900de874b62ccc702709623aece605f7919d1b6af70271838d"}
May 25 11:31:06.397423 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:06.397053    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:06.417856 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:06.417815    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v" podStartSLOduration=2.017061178 podStartE2EDuration="3.417800748s" podCreationTimestamp="2026-05-25 11:31:03 +0000 UTC" firstStartedPulling="2026-05-25 11:31:04.011855433 +0000 UTC m=+515.833779631" lastFinishedPulling="2026-05-25 11:31:05.412594989 +0000 UTC m=+517.234519201" observedRunningTime="2026-05-25 11:31:06.416918565 +0000 UTC m=+518.238842785" watchObservedRunningTime="2026-05-25 11:31:06.417800748 +0000 UTC m=+518.239724968"
May 25 11:31:14.412942 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.412900    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6d664d5796-lbfb4" podUID="e7a9f300-0075-4cb9-ae12-a1e82b712384" containerName="console" containerID="cri-o://5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db" gracePeriod=15
May 25 11:31:14.656535 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.656516    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d664d5796-lbfb4_e7a9f300-0075-4cb9-ae12-a1e82b712384/console/0.log"
May 25 11:31:14.656638 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.656578    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:31:14.765363 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765282    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-trusted-ca-bundle\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765363 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765321    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-serving-cert\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765363 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765349    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-oauth-serving-cert\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765642 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765386    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-oauth-config\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765642 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765403    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-config\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765642 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765446    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-984vr\" (UniqueName: \"kubernetes.io/projected/e7a9f300-0075-4cb9-ae12-a1e82b712384-kube-api-access-984vr\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765642 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765497    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-service-ca\") pod \"e7a9f300-0075-4cb9-ae12-a1e82b712384\" (UID: \"e7a9f300-0075-4cb9-ae12-a1e82b712384\") "
May 25 11:31:14.765848 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765759    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:31:14.765941 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.765901    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-config" (OuterVolumeSpecName: "console-config") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:31:14.766034 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.766003    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-service-ca" (OuterVolumeSpecName: "service-ca") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:31:14.766158 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.766105    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:31:14.767577 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.767554    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:31:14.767674 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.767579    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:31:14.767674 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.767622    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a9f300-0075-4cb9-ae12-a1e82b712384-kube-api-access-984vr" (OuterVolumeSpecName: "kube-api-access-984vr") pod "e7a9f300-0075-4cb9-ae12-a1e82b712384" (UID: "e7a9f300-0075-4cb9-ae12-a1e82b712384"). InnerVolumeSpecName "kube-api-access-984vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:31:14.866491 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866439    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-oauth-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:14.866491 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866492    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-config\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:14.866703 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866512    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-984vr\" (UniqueName: \"kubernetes.io/projected/e7a9f300-0075-4cb9-ae12-a1e82b712384-kube-api-access-984vr\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:14.866703 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866528    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-service-ca\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:14.866703 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866545    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-trusted-ca-bundle\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:14.866703 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866570    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e7a9f300-0075-4cb9-ae12-a1e82b712384-console-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:14.866703 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:14.866589    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e7a9f300-0075-4cb9-ae12-a1e82b712384-oauth-serving-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:31:15.395077 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.395043    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-7lqpv"
May 25 11:31:15.433183 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.433158    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6d664d5796-lbfb4_e7a9f300-0075-4cb9-ae12-a1e82b712384/console/0.log"
May 25 11:31:15.433565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.433199    2557 generic.go:358] "Generic (PLEG): container finished" podID="e7a9f300-0075-4cb9-ae12-a1e82b712384" containerID="5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db" exitCode=2
May 25 11:31:15.433565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.433254    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d664d5796-lbfb4" event={"ID":"e7a9f300-0075-4cb9-ae12-a1e82b712384","Type":"ContainerDied","Data":"5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db"}
May 25 11:31:15.433565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.433279    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d664d5796-lbfb4" event={"ID":"e7a9f300-0075-4cb9-ae12-a1e82b712384","Type":"ContainerDied","Data":"f11cf8196b0c9824421f500b9a82d6f8094f91626fe56ec9da35560549574ebf"}
May 25 11:31:15.433565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.433280    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d664d5796-lbfb4"
May 25 11:31:15.433565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.433301    2557 scope.go:117] "RemoveContainer" containerID="5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db"
May 25 11:31:15.441096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.441081    2557 scope.go:117] "RemoveContainer" containerID="5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db"
May 25 11:31:15.441334 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:31:15.441316    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db\": container with ID starting with 5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db not found: ID does not exist" containerID="5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db"
May 25 11:31:15.441397 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.441342    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db"} err="failed to get container status \"5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db\": rpc error: code = NotFound desc = could not find container \"5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db\": container with ID starting with 5e2d57258a4167d9ee448047f455eb7b1d9a1cbad4f2c9464cf03338a4aa76db not found: ID does not exist"
May 25 11:31:15.489099 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.489070    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d664d5796-lbfb4"]
May 25 11:31:15.506029 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:15.505998    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d664d5796-lbfb4"]
May 25 11:31:16.778937 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:16.778907    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7a9f300-0075-4cb9-ae12-a1e82b712384" path="/var/lib/kubelet/pods/e7a9f300-0075-4cb9-ae12-a1e82b712384/volumes"
May 25 11:31:17.403113 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:17.403079    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7587b89b76-tkk4v"
May 25 11:31:58.155518 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.155481    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:31:58.156055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.155911    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7a9f300-0075-4cb9-ae12-a1e82b712384" containerName="console"
May 25 11:31:58.156055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.155949    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7a9f300-0075-4cb9-ae12-a1e82b712384" containerName="console"
May 25 11:31:58.156055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.156047    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e7a9f300-0075-4cb9-ae12-a1e82b712384" containerName="console"
May 25 11:31:58.158965 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.158950    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.161672 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.161654    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 25 11:31:58.161816 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.161800    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-26pd8\""
May 25 11:31:58.165372 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.165345    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:31:58.240215 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.240183    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ba25801-6bc5-4440-bfcd-ddae506aba4b-config-file\") pod \"limitador-limitador-64c8f475fb-n8945\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.240371 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.240244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5pmh\" (UniqueName: \"kubernetes.io/projected/7ba25801-6bc5-4440-bfcd-ddae506aba4b-kube-api-access-t5pmh\") pod \"limitador-limitador-64c8f475fb-n8945\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.250576 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.250550    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:31:58.340847 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.340817    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ba25801-6bc5-4440-bfcd-ddae506aba4b-config-file\") pod \"limitador-limitador-64c8f475fb-n8945\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.341037 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.340858    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t5pmh\" (UniqueName: \"kubernetes.io/projected/7ba25801-6bc5-4440-bfcd-ddae506aba4b-kube-api-access-t5pmh\") pod \"limitador-limitador-64c8f475fb-n8945\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.341479 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.341462    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ba25801-6bc5-4440-bfcd-ddae506aba4b-config-file\") pod \"limitador-limitador-64c8f475fb-n8945\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.349528 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.349503    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5pmh\" (UniqueName: \"kubernetes.io/projected/7ba25801-6bc5-4440-bfcd-ddae506aba4b-kube-api-access-t5pmh\") pod \"limitador-limitador-64c8f475fb-n8945\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") " pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.470568 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.470486    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:31:58.599149 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:58.599125    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:31:58.601533 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:31:58.601506    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba25801_6bc5_4440_bfcd_ddae506aba4b.slice/crio-049ba0d0ab1deab7074773c6387a00d333fc254b55507a40197eef3b431f7dd7 WatchSource:0}: Error finding container 049ba0d0ab1deab7074773c6387a00d333fc254b55507a40197eef3b431f7dd7: Status 404 returned error can't find the container with id 049ba0d0ab1deab7074773c6387a00d333fc254b55507a40197eef3b431f7dd7
May 25 11:31:59.581376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:31:59.581340    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945" event={"ID":"7ba25801-6bc5-4440-bfcd-ddae506aba4b","Type":"ContainerStarted","Data":"049ba0d0ab1deab7074773c6387a00d333fc254b55507a40197eef3b431f7dd7"}
May 25 11:32:03.597943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:03.597910    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945" event={"ID":"7ba25801-6bc5-4440-bfcd-ddae506aba4b","Type":"ContainerStarted","Data":"604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847"}
May 25 11:32:03.598358 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:03.598034    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:32:03.616316 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:03.616263    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945" podStartSLOduration=1.6759483560000001 podStartE2EDuration="5.616246986s" podCreationTimestamp="2026-05-25 11:31:58 +0000 UTC" firstStartedPulling="2026-05-25 11:31:58.603707258 +0000 UTC m=+570.425631459" lastFinishedPulling="2026-05-25 11:32:02.544005876 +0000 UTC m=+574.365930089" observedRunningTime="2026-05-25 11:32:03.615165471 +0000 UTC m=+575.437089692" watchObservedRunningTime="2026-05-25 11:32:03.616246986 +0000 UTC m=+575.438171238"
May 25 11:32:14.549763 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:14.549725    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:32:14.550186 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:14.549962    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945" podUID="7ba25801-6bc5-4440-bfcd-ddae506aba4b" containerName="limitador" containerID="cri-o://604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847" gracePeriod=30
May 25 11:32:14.550617 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:14.550599    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:32:15.097681 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.097661    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:32:15.187892 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.187810    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5pmh\" (UniqueName: \"kubernetes.io/projected/7ba25801-6bc5-4440-bfcd-ddae506aba4b-kube-api-access-t5pmh\") pod \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") "
May 25 11:32:15.188016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.187958    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ba25801-6bc5-4440-bfcd-ddae506aba4b-config-file\") pod \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\" (UID: \"7ba25801-6bc5-4440-bfcd-ddae506aba4b\") "
May 25 11:32:15.188313 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.188283    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba25801-6bc5-4440-bfcd-ddae506aba4b-config-file" (OuterVolumeSpecName: "config-file") pod "7ba25801-6bc5-4440-bfcd-ddae506aba4b" (UID: "7ba25801-6bc5-4440-bfcd-ddae506aba4b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:32:15.190113 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.190079    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba25801-6bc5-4440-bfcd-ddae506aba4b-kube-api-access-t5pmh" (OuterVolumeSpecName: "kube-api-access-t5pmh") pod "7ba25801-6bc5-4440-bfcd-ddae506aba4b" (UID: "7ba25801-6bc5-4440-bfcd-ddae506aba4b"). InnerVolumeSpecName "kube-api-access-t5pmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:32:15.289639 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.289608    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7ba25801-6bc5-4440-bfcd-ddae506aba4b-config-file\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:15.289639 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.289640    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5pmh\" (UniqueName: \"kubernetes.io/projected/7ba25801-6bc5-4440-bfcd-ddae506aba4b-kube-api-access-t5pmh\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:15.640897 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.640850    2557 generic.go:358] "Generic (PLEG): container finished" podID="7ba25801-6bc5-4440-bfcd-ddae506aba4b" containerID="604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847" exitCode=0
May 25 11:32:15.641297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.640920    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945"
May 25 11:32:15.641297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.640944    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945" event={"ID":"7ba25801-6bc5-4440-bfcd-ddae506aba4b","Type":"ContainerDied","Data":"604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847"}
May 25 11:32:15.641297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.640982    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c8f475fb-n8945" event={"ID":"7ba25801-6bc5-4440-bfcd-ddae506aba4b","Type":"ContainerDied","Data":"049ba0d0ab1deab7074773c6387a00d333fc254b55507a40197eef3b431f7dd7"}
May 25 11:32:15.641297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.641000    2557 scope.go:117] "RemoveContainer" containerID="604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847"
May 25 11:32:15.649907 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.649891    2557 scope.go:117] "RemoveContainer" containerID="604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847"
May 25 11:32:15.650135 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:32:15.650118    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847\": container with ID starting with 604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847 not found: ID does not exist" containerID="604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847"
May 25 11:32:15.650193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.650147    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847"} err="failed to get container status \"604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847\": rpc error: code = NotFound desc = could not find container \"604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847\": container with ID starting with 604160345fee644219e3ba7e9af521d470df580f8ebe289a9a9b521c2f656847 not found: ID does not exist"
May 25 11:32:15.672322 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.672294    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:32:15.681077 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:15.681059    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c8f475fb-n8945"]
May 25 11:32:16.778938 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:16.778906    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba25801-6bc5-4440-bfcd-ddae506aba4b" path="/var/lib/kubelet/pods/7ba25801-6bc5-4440-bfcd-ddae506aba4b/volumes"
May 25 11:32:28.718987 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:28.718963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:32:28.719396 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:28.719352    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:32:34.310292 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.310253    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"]
May 25 11:32:34.431229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.310662    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba25801-6bc5-4440-bfcd-ddae506aba4b" containerName="limitador"
May 25 11:32:34.431229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.310676    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba25801-6bc5-4440-bfcd-ddae506aba4b" containerName="limitador"
May 25 11:32:34.431229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.310739    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ba25801-6bc5-4440-bfcd-ddae506aba4b" containerName="limitador"
May 25 11:32:34.431229 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.431185    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"]
May 25 11:32:34.431405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.431299    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.450981 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.450954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcddq\" (UniqueName: \"kubernetes.io/projected/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-kube-api-access-dcddq\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.451116 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.450996    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.451116 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.451072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.451235 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.451170    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.451235 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.451202    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.451346 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.451238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.451346 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.451274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552232 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552188    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552244    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552288    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552318    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552352    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcddq\" (UniqueName: \"kubernetes.io/projected/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-kube-api-access-dcddq\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552393    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.552644 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.552426    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.553151 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.553124    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.554741 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.554712    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.554849 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.554770    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.554986 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.554965    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-local-certs\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.555028 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.554995    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-cacerts\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.562522 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.562473    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-istio-token\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.565199 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.565177    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcddq\" (UniqueName: \"kubernetes.io/projected/56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6-kube-api-access-dcddq\") pod \"istiod-openshift-gateway-798958bb55-dsbkj\" (UID: \"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.739952 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.739916    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:34.902571 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.902536    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"]
May 25 11:32:34.907506 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:32:34.907481    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56dcb5d1_7da4_40a3_bd9e_8bcc8121eae6.slice/crio-838f3d9b57514e27ed771d03b1ceedbdeb95ba3e0d8d2be3c28bc33aace4c81d WatchSource:0}: Error finding container 838f3d9b57514e27ed771d03b1ceedbdeb95ba3e0d8d2be3c28bc33aace4c81d: Status 404 returned error can't find the container with id 838f3d9b57514e27ed771d03b1ceedbdeb95ba3e0d8d2be3c28bc33aace4c81d
May 25 11:32:34.909605 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.909572    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:32:34.909695 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:34.909632    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:32:35.711083 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:35.711044    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj" event={"ID":"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6","Type":"ContainerStarted","Data":"b18eda1bb8c1cc930e74948e6ff233ccf6a13228b2b2c379237c44b3a7c82412"}
May 25 11:32:35.711083 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:35.711076    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj" event={"ID":"56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6","Type":"ContainerStarted","Data":"838f3d9b57514e27ed771d03b1ceedbdeb95ba3e0d8d2be3c28bc33aace4c81d"}
May 25 11:32:35.711559 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:35.711269    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:35.712981 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:35.712961    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-dsbkj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 25 11:32:35.713088 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:35.712996    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj" podUID="56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 25 11:32:35.754953 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:35.754384    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj" podStartSLOduration=1.754367039 podStartE2EDuration="1.754367039s" podCreationTimestamp="2026-05-25 11:32:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:32:35.749444225 +0000 UTC m=+607.571368444" watchObservedRunningTime="2026-05-25 11:32:35.754367039 +0000 UTC m=+607.576291259"
May 25 11:32:36.715155 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:36.715127    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-dsbkj"
May 25 11:32:36.797535 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:36.797507    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"]
May 25 11:32:36.797727 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:36.797693    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" podUID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" containerName="discovery" containerID="cri-o://bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f" gracePeriod=30
May 25 11:32:37.051325 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.051304    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:32:37.069943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.069924    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-dns-cert\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.070023 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.069962    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-ca-configmap\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.070088 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.070072    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-local-certs\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.070152 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.070137    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-cacerts\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.070209 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.070167    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmkdr\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-kube-api-access-gmkdr\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.070275 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.070221    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-kubeconfig\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.070328 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.070292    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 11:32:37.070532 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.070510    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-ca-configmap\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.072353 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.072325    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-kube-api-access-gmkdr" (OuterVolumeSpecName: "kube-api-access-gmkdr") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "kube-api-access-gmkdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:32:37.072569 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.072537    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:32:37.072656 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.072579    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-cacerts" (OuterVolumeSpecName: "cacerts") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:32:37.072656 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.072596    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:32:37.072656 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.072580    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-local-certs" (OuterVolumeSpecName: "local-certs") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:32:37.171466 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.171417    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-token\") pod \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\" (UID: \"c61f7d5b-4b8e-4497-9acf-d69dace81c3d\") "
May 25 11:32:37.171807 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.171790    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-cacerts\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.171891 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.171813    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmkdr\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-kube-api-access-gmkdr\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.171891 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.171831    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-kubeconfig\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.171891 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.171845    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-csr-dns-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.171891 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.171859    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-local-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.173419 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.173394    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-token" (OuterVolumeSpecName: "istio-token") pod "c61f7d5b-4b8e-4497-9acf-d69dace81c3d" (UID: "c61f7d5b-4b8e-4497-9acf-d69dace81c3d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:32:37.272677 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.272643    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c61f7d5b-4b8e-4497-9acf-d69dace81c3d-istio-token\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:32:37.718656 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.718616    2557 generic.go:358] "Generic (PLEG): container finished" podID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" containerID="bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f" exitCode=0
May 25 11:32:37.719143 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.718680    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"
May 25 11:32:37.719143 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.718700    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" event={"ID":"c61f7d5b-4b8e-4497-9acf-d69dace81c3d","Type":"ContainerDied","Data":"bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f"}
May 25 11:32:37.719143 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.718739    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97" event={"ID":"c61f7d5b-4b8e-4497-9acf-d69dace81c3d","Type":"ContainerDied","Data":"e5ff00eb8286bdb00d18f93f5acd823cf3b0e199c30dfcda2087c777d69b33e3"}
May 25 11:32:37.719143 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.718758    2557 scope.go:117] "RemoveContainer" containerID="bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f"
May 25 11:32:37.740403 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.740342    2557 scope.go:117] "RemoveContainer" containerID="bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f"
May 25 11:32:37.740932 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:32:37.740905    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f\": container with ID starting with bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f not found: ID does not exist" containerID="bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f"
May 25 11:32:37.741011 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.740944    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f"} err="failed to get container status \"bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f\": rpc error: code = NotFound desc = could not find container \"bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f\": container with ID starting with bd08acff6b3f6a903bf77a15a3657940c5106779dd5404473e5b37082e8a049f not found: ID does not exist"
May 25 11:32:37.753709 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.753677    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"]
May 25 11:32:37.775818 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:37.775787    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-767cf5cf55-drj97"]
May 25 11:32:38.779548 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:38.779514    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" path="/var/lib/kubelet/pods/c61f7d5b-4b8e-4497-9acf-d69dace81c3d/volumes"
May 25 11:32:45.500181 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.500147    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-645dd747db-z2b4k"]
May 25 11:32:45.500534 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.500524    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" containerName="discovery"
May 25 11:32:45.500534 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.500535    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" containerName="discovery"
May 25 11:32:45.500634 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.500584    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="c61f7d5b-4b8e-4497-9acf-d69dace81c3d" containerName="discovery"
May 25 11:32:45.503230 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.503211    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:45.506062 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.506037    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
May 25 11:32:45.507254 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.507230    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
May 25 11:32:45.507363 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.507235    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-tdhvk\""
May 25 11:32:45.507363 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.507261    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
May 25 11:32:45.513325 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.513304    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-z2b4k"]
May 25 11:32:45.525569 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.525546    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-9f484b96b-brlsg"]
May 25 11:32:45.527858 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.527750    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:45.530817 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.530797    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
May 25 11:32:45.531056 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.531041    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-gjkmg\""
May 25 11:32:45.539093 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.539068    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-9f484b96b-brlsg"]
May 25 11:32:45.548900 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.548860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:45.549082 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.549063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmzz\" (UniqueName: \"kubernetes.io/projected/d4be5f59-0444-4649-9e66-b335c5154263-kube-api-access-jmmzz\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:45.650078 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.650047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn9wj\" (UniqueName: \"kubernetes.io/projected/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-kube-api-access-gn9wj\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:45.650217 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.650145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:45.650217 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.650182    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:45.650321 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:32:45.650277    2557 secret.go:189] Couldn't get secret kserve/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 25 11:32:45.650321 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.650285    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmzz\" (UniqueName: \"kubernetes.io/projected/d4be5f59-0444-4649-9e66-b335c5154263-kube-api-access-jmmzz\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:45.650394 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:32:45.650336    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert podName:d4be5f59-0444-4649-9e66-b335c5154263 nodeName:}" failed. No retries permitted until 2026-05-25 11:32:46.150318104 +0000 UTC m=+617.972242303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert") pod "kserve-controller-manager-645dd747db-z2b4k" (UID: "d4be5f59-0444-4649-9e66-b335c5154263") : secret "kserve-webhook-server-cert" not found
May 25 11:32:45.659455 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.659426    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmzz\" (UniqueName: \"kubernetes.io/projected/d4be5f59-0444-4649-9e66-b335c5154263-kube-api-access-jmmzz\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:45.751289 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.751205    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:45.751289 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.751277    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn9wj\" (UniqueName: \"kubernetes.io/projected/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-kube-api-access-gn9wj\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:45.751512 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:32:45.751356    2557 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
May 25 11:32:45.751512 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:32:45.751422    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert podName:a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec nodeName:}" failed. No retries permitted until 2026-05-25 11:32:46.251403593 +0000 UTC m=+618.073327808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert") pod "llmisvc-controller-manager-9f484b96b-brlsg" (UID: "a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec") : secret "llmisvc-webhook-server-cert" not found
May 25 11:32:45.761135 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:45.761107    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn9wj\" (UniqueName: \"kubernetes.io/projected/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-kube-api-access-gn9wj\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:46.155021 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.154991    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:46.157281 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.157263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert\") pod \"kserve-controller-manager-645dd747db-z2b4k\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") " pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:46.256002 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.255980    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:46.262390 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.259358    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert\") pod \"llmisvc-controller-manager-9f484b96b-brlsg\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") " pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:46.416933 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.416825    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:46.440922 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.440849    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:46.559244 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.559208    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-z2b4k"]
May 25 11:32:46.560608 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:32:46.560579    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4be5f59_0444_4649_9e66_b335c5154263.slice/crio-cfeeb03ef60cc0146992c827fe953bffc741e63498547997da5567a69860a51e WatchSource:0}: Error finding container cfeeb03ef60cc0146992c827fe953bffc741e63498547997da5567a69860a51e: Status 404 returned error can't find the container with id cfeeb03ef60cc0146992c827fe953bffc741e63498547997da5567a69860a51e
May 25 11:32:46.584546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.584524    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-9f484b96b-brlsg"]
May 25 11:32:46.586504 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:32:46.586478    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda0c06c66_cfb8_4d4c_ba7e_31928bbf87ec.slice/crio-5cbadb15514cec30103e8bffb56e9ffd3ec414c19f342222bd987256a279ad88 WatchSource:0}: Error finding container 5cbadb15514cec30103e8bffb56e9ffd3ec414c19f342222bd987256a279ad88: Status 404 returned error can't find the container with id 5cbadb15514cec30103e8bffb56e9ffd3ec414c19f342222bd987256a279ad88
May 25 11:32:46.752263 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.752176    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-645dd747db-z2b4k" event={"ID":"d4be5f59-0444-4649-9e66-b335c5154263","Type":"ContainerStarted","Data":"cfeeb03ef60cc0146992c827fe953bffc741e63498547997da5567a69860a51e"}
May 25 11:32:46.753189 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:46.753165    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg" event={"ID":"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec","Type":"ContainerStarted","Data":"5cbadb15514cec30103e8bffb56e9ffd3ec414c19f342222bd987256a279ad88"}
May 25 11:32:50.771139 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:50.771093    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-645dd747db-z2b4k" event={"ID":"d4be5f59-0444-4649-9e66-b335c5154263","Type":"ContainerStarted","Data":"91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346"}
May 25 11:32:50.771609 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:50.771220    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:32:50.772361 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:50.772338    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg" event={"ID":"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec","Type":"ContainerStarted","Data":"9372141261a233c30865802cadf270467aeb64d6bebd8f4382685a428a4e158c"}
May 25 11:32:50.772483 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:50.772472    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:32:50.789861 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:50.789820    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-645dd747db-z2b4k" podStartSLOduration=2.494729742 podStartE2EDuration="5.789808279s" podCreationTimestamp="2026-05-25 11:32:45 +0000 UTC" firstStartedPulling="2026-05-25 11:32:46.561989262 +0000 UTC m=+618.383913464" lastFinishedPulling="2026-05-25 11:32:49.857067802 +0000 UTC m=+621.678992001" observedRunningTime="2026-05-25 11:32:50.788303934 +0000 UTC m=+622.610228231" watchObservedRunningTime="2026-05-25 11:32:50.789808279 +0000 UTC m=+622.611732499"
May 25 11:32:50.812354 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:32:50.812311    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg" podStartSLOduration=2.543349711 podStartE2EDuration="5.812298689s" podCreationTimestamp="2026-05-25 11:32:45 +0000 UTC" firstStartedPulling="2026-05-25 11:32:46.58811471 +0000 UTC m=+618.410038908" lastFinishedPulling="2026-05-25 11:32:49.857063685 +0000 UTC m=+621.678987886" observedRunningTime="2026-05-25 11:32:50.810599646 +0000 UTC m=+622.632523891" watchObservedRunningTime="2026-05-25 11:32:50.812298689 +0000 UTC m=+622.634222909"
May 25 11:33:21.777915 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:21.777859    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:33:21.780724 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:21.780703    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:33:23.274361 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.274327    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-z2b4k"]
May 25 11:33:23.274761 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.274585    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/kserve-controller-manager-645dd747db-z2b4k" podUID="d4be5f59-0444-4649-9e66-b335c5154263" containerName="manager" containerID="cri-o://91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346" gracePeriod=10
May 25 11:33:23.314312 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.314289    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-645dd747db-2d7zv"]
May 25 11:33:23.316794 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.316779    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.338384 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.338359    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-2d7zv"]
May 25 11:33:23.378669 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.378633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6798c56b-a57b-43d3-b4a5-d9606c853ebe-cert\") pod \"kserve-controller-manager-645dd747db-2d7zv\" (UID: \"6798c56b-a57b-43d3-b4a5-d9606c853ebe\") " pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.378848 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.378689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgsnz\" (UniqueName: \"kubernetes.io/projected/6798c56b-a57b-43d3-b4a5-d9606c853ebe-kube-api-access-bgsnz\") pod \"kserve-controller-manager-645dd747db-2d7zv\" (UID: \"6798c56b-a57b-43d3-b4a5-d9606c853ebe\") " pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.479320 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.479286    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6798c56b-a57b-43d3-b4a5-d9606c853ebe-cert\") pod \"kserve-controller-manager-645dd747db-2d7zv\" (UID: \"6798c56b-a57b-43d3-b4a5-d9606c853ebe\") " pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.479455 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.479357    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgsnz\" (UniqueName: \"kubernetes.io/projected/6798c56b-a57b-43d3-b4a5-d9606c853ebe-kube-api-access-bgsnz\") pod \"kserve-controller-manager-645dd747db-2d7zv\" (UID: \"6798c56b-a57b-43d3-b4a5-d9606c853ebe\") " pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.481630 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.481608    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6798c56b-a57b-43d3-b4a5-d9606c853ebe-cert\") pod \"kserve-controller-manager-645dd747db-2d7zv\" (UID: \"6798c56b-a57b-43d3-b4a5-d9606c853ebe\") " pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.488617 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.488582    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgsnz\" (UniqueName: \"kubernetes.io/projected/6798c56b-a57b-43d3-b4a5-d9606c853ebe-kube-api-access-bgsnz\") pod \"kserve-controller-manager-645dd747db-2d7zv\" (UID: \"6798c56b-a57b-43d3-b4a5-d9606c853ebe\") " pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.513971 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.513953    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:33:23.580437 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.580417    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert\") pod \"d4be5f59-0444-4649-9e66-b335c5154263\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") "
May 25 11:33:23.580602 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.580460    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmmzz\" (UniqueName: \"kubernetes.io/projected/d4be5f59-0444-4649-9e66-b335c5154263-kube-api-access-jmmzz\") pod \"d4be5f59-0444-4649-9e66-b335c5154263\" (UID: \"d4be5f59-0444-4649-9e66-b335c5154263\") "
May 25 11:33:23.582634 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.582602    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4be5f59-0444-4649-9e66-b335c5154263-kube-api-access-jmmzz" (OuterVolumeSpecName: "kube-api-access-jmmzz") pod "d4be5f59-0444-4649-9e66-b335c5154263" (UID: "d4be5f59-0444-4649-9e66-b335c5154263"). InnerVolumeSpecName "kube-api-access-jmmzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:33:23.582733 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.582680    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert" (OuterVolumeSpecName: "cert") pod "d4be5f59-0444-4649-9e66-b335c5154263" (UID: "d4be5f59-0444-4649-9e66-b335c5154263"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:33:23.664651 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.664623    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:23.681768 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.681742    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmmzz\" (UniqueName: \"kubernetes.io/projected/d4be5f59-0444-4649-9e66-b335c5154263-kube-api-access-jmmzz\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:33:23.681768 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.681769    2557 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4be5f59-0444-4649-9e66-b335c5154263-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:33:23.805240 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.805209    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-2d7zv"]
May 25 11:33:23.808514 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:33:23.808483    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6798c56b_a57b_43d3_b4a5_d9606c853ebe.slice/crio-bcbcb33a4ba87fc27f04268b466acff05ce2a79f2bbfa5e77b66e0a67b67b565 WatchSource:0}: Error finding container bcbcb33a4ba87fc27f04268b466acff05ce2a79f2bbfa5e77b66e0a67b67b565: Status 404 returned error can't find the container with id bcbcb33a4ba87fc27f04268b466acff05ce2a79f2bbfa5e77b66e0a67b67b565
May 25 11:33:23.809745 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.809729    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:33:23.881928 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.881840    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-645dd747db-2d7zv" event={"ID":"6798c56b-a57b-43d3-b4a5-d9606c853ebe","Type":"ContainerStarted","Data":"bcbcb33a4ba87fc27f04268b466acff05ce2a79f2bbfa5e77b66e0a67b67b565"}
May 25 11:33:23.885260 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.883371    2557 generic.go:358] "Generic (PLEG): container finished" podID="d4be5f59-0444-4649-9e66-b335c5154263" containerID="91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346" exitCode=0
May 25 11:33:23.885260 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.883469    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-645dd747db-z2b4k" event={"ID":"d4be5f59-0444-4649-9e66-b335c5154263","Type":"ContainerDied","Data":"91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346"}
May 25 11:33:23.885260 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.883494    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-645dd747db-z2b4k" event={"ID":"d4be5f59-0444-4649-9e66-b335c5154263","Type":"ContainerDied","Data":"cfeeb03ef60cc0146992c827fe953bffc741e63498547997da5567a69860a51e"}
May 25 11:33:23.885260 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.883515    2557 scope.go:117] "RemoveContainer" containerID="91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346"
May 25 11:33:23.885260 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.883669    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-645dd747db-z2b4k"
May 25 11:33:23.893843 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.893827    2557 scope.go:117] "RemoveContainer" containerID="91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346"
May 25 11:33:23.894197 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:33:23.894168    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346\": container with ID starting with 91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346 not found: ID does not exist" containerID="91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346"
May 25 11:33:23.894263 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.894198    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346"} err="failed to get container status \"91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346\": rpc error: code = NotFound desc = could not find container \"91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346\": container with ID starting with 91b1acb8860e5f7c67c8a7af628422ece2dd76c845dcf5dc94e510206e8a4346 not found: ID does not exist"
May 25 11:33:23.911188 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.911166    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-z2b4k"]
May 25 11:33:23.917195 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:23.917176    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-645dd747db-z2b4k"]
May 25 11:33:24.779316 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:24.779283    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4be5f59-0444-4649-9e66-b335c5154263" path="/var/lib/kubelet/pods/d4be5f59-0444-4649-9e66-b335c5154263/volumes"
May 25 11:33:24.888580 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:24.888539    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-645dd747db-2d7zv" event={"ID":"6798c56b-a57b-43d3-b4a5-d9606c853ebe","Type":"ContainerStarted","Data":"d15271b0d9a96194ab93ee656a65e7db8789beb3e0ef9e522a1f130b1ff2d92d"}
May 25 11:33:24.888773 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:24.888635    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:33:24.908060 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:24.908017    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve/kserve-controller-manager-645dd747db-2d7zv" podStartSLOduration=1.591644152 podStartE2EDuration="1.90800385s" podCreationTimestamp="2026-05-25 11:33:23 +0000 UTC" firstStartedPulling="2026-05-25 11:33:23.809850862 +0000 UTC m=+655.631775060" lastFinishedPulling="2026-05-25 11:33:24.126210545 +0000 UTC m=+655.948134758" observedRunningTime="2026-05-25 11:33:24.905557867 +0000 UTC m=+656.727482089" watchObservedRunningTime="2026-05-25 11:33:24.90800385 +0000 UTC m=+656.729928069"
May 25 11:33:55.899835 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:33:55.899799    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-645dd747db-2d7zv"
May 25 11:34:34.692686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.692608    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"]
May 25 11:34:34.693191 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.693035    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4be5f59-0444-4649-9e66-b335c5154263" containerName="manager"
May 25 11:34:34.693191 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.693050    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4be5f59-0444-4649-9e66-b335c5154263" containerName="manager"
May 25 11:34:34.693191 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.693114    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4be5f59-0444-4649-9e66-b335c5154263" containerName="manager"
May 25 11:34:34.696281 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.696240    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.699405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.699383    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
May 25 11:34:34.700054 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.700029    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-gateway-1-openshift-default-dockercfg-zjmqh\""
May 25 11:34:34.700054 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.700045    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-gw-ca-root-cert\""
May 25 11:34:34.700210 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.700079    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
May 25 11:34:34.714653 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.714629    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"]
May 25 11:34:34.799781 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-istio-envoy\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.799924 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799786    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1358dc19-024b-4193-98ec-f810f4234879-istio-token\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.799924 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-istio-data\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.799924 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1358dc19-024b-4193-98ec-f810f4234879-istio-podinfo\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.800050 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-workload-socket\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.800050 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1358dc19-024b-4193-98ec-f810f4234879-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.800050 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.799988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-credential-socket\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.800150 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.800054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-workload-certs\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.800150 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.800073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnx7k\" (UniqueName: \"kubernetes.io/projected/1358dc19-024b-4193-98ec-f810f4234879-kube-api-access-nnx7k\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901309 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901278    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-workload-socket\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901332    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1358dc19-024b-4193-98ec-f810f4234879-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901364    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-credential-socket\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901390    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-workload-certs\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901473 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901416    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnx7k\" (UniqueName: \"kubernetes.io/projected/1358dc19-024b-4193-98ec-f810f4234879-kube-api-access-nnx7k\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901684 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901506    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-istio-envoy\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901684 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901533    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1358dc19-024b-4193-98ec-f810f4234879-istio-token\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901684 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901568    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-istio-data\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901684 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901620    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1358dc19-024b-4193-98ec-f810f4234879-istio-podinfo\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.901907 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.901735    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-workload-socket\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.902029 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.902011    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-istio-data\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.902096 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.902076    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-workload-certs\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.902144 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.902126    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-credential-socket\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.902183 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.902170    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1358dc19-024b-4193-98ec-f810f4234879-istiod-ca-cert\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.903819 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.903792    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1358dc19-024b-4193-98ec-f810f4234879-istio-envoy\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.904066 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.904051    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1358dc19-024b-4193-98ec-f810f4234879-istio-podinfo\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.910544 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.910526    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1358dc19-024b-4193-98ec-f810f4234879-istio-token\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:34.910719 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:34.910699    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnx7k\" (UniqueName: \"kubernetes.io/projected/1358dc19-024b-4193-98ec-f810f4234879-kube-api-access-nnx7k\") pod \"router-gateway-1-openshift-default-7b9cf87876-zjvkg\" (UID: \"1358dc19-024b-4193-98ec-f810f4234879\") " pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:35.008276 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:35.008206    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:35.144567 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:35.144469    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"]
May 25 11:34:35.147048 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:34:35.147024    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1358dc19_024b_4193_98ec_f810f4234879.slice/crio-dd7a074ff25438830bd4be1ca41a465c681e763edcf727ded95480b73c848c5f WatchSource:0}: Error finding container dd7a074ff25438830bd4be1ca41a465c681e763edcf727ded95480b73c848c5f: Status 404 returned error can't find the container with id dd7a074ff25438830bd4be1ca41a465c681e763edcf727ded95480b73c848c5f
May 25 11:34:35.149421 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:35.149382    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:34:35.149496 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:35.149449    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:34:35.149496 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:35.149484    2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 25 11:34:36.128205 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:36.128168    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg" event={"ID":"1358dc19-024b-4193-98ec-f810f4234879","Type":"ContainerStarted","Data":"09dc731be224676a608dc1eed96ce3d56a7bdb52ed3d389d36a7426be40d67bd"}
May 25 11:34:36.128205 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:36.128204    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg" event={"ID":"1358dc19-024b-4193-98ec-f810f4234879","Type":"ContainerStarted","Data":"dd7a074ff25438830bd4be1ca41a465c681e763edcf727ded95480b73c848c5f"}
May 25 11:34:36.150119 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:36.150065    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg" podStartSLOduration=2.150046086 podStartE2EDuration="2.150046086s" podCreationTimestamp="2026-05-25 11:34:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:34:36.149318167 +0000 UTC m=+727.971242388" watchObservedRunningTime="2026-05-25 11:34:36.150046086 +0000 UTC m=+727.971970307"
May 25 11:34:37.009177 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:37.009142    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:37.013741 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:37.013718    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:37.132112 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:37.132084    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:34:37.133068 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:34:37.133050    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-gateway-1-openshift-default-7b9cf87876-zjvkg"
May 25 11:35:03.052422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.052389    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"]
May 25 11:35:03.056834 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.056811    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.065017 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.064995    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:35:03.065158 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.065026    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-epp-sa-dockercfg-r6898\""
May 25 11:35:03.065158 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.065116    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-inline-config-test-kserve-self-signed-certs\""
May 25 11:35:03.079414 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.079381    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"]
May 25 11:35:03.155979 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.155934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qrxq\" (UniqueName: \"kubernetes.io/projected/00418f19-47a7-473f-a369-bdf297890b24-kube-api-access-4qrxq\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.156193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.156000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-cache\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.156193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.156103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.156193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.156191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-uds\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.156366 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.156243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00418f19-47a7-473f-a369-bdf297890b24-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.156366 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.156297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-tmp\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.257780 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.257742    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4qrxq\" (UniqueName: \"kubernetes.io/projected/00418f19-47a7-473f-a369-bdf297890b24-kube-api-access-4qrxq\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.257980 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.257787    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-cache\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.257980 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.257876    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.257980 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.257911    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-uds\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.257980 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.257967    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00418f19-47a7-473f-a369-bdf297890b24-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.258187 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.257989    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-tmp\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.258329 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.258305    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-cache\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.258396 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.258310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-kserve-provision-location\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.258455 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.258387    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-uds\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.258455 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.258394    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-tmp\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.260562 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.260538    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00418f19-47a7-473f-a369-bdf297890b24-tls-certs\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.286514 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.286480    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qrxq\" (UniqueName: \"kubernetes.io/projected/00418f19-47a7-473f-a369-bdf297890b24-kube-api-access-4qrxq\") pod \"scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") " pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.367343 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.367305    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:03.508124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:03.508098    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"]
May 25 11:35:03.510303 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:35:03.510277    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00418f19_47a7_473f_a369_bdf297890b24.slice/crio-d392774468b4eb479e2069380a4e93d14251402d4b88107fa70fb4903cb6d4a9 WatchSource:0}: Error finding container d392774468b4eb479e2069380a4e93d14251402d4b88107fa70fb4903cb6d4a9: Status 404 returned error can't find the container with id d392774468b4eb479e2069380a4e93d14251402d4b88107fa70fb4903cb6d4a9
May 25 11:35:04.225757 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:04.225705    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerStarted","Data":"d392774468b4eb479e2069380a4e93d14251402d4b88107fa70fb4903cb6d4a9"}
May 25 11:35:07.241358 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:07.241320    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerStarted","Data":"b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c"}
May 25 11:35:08.246496 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:08.246407    2557 generic.go:358] "Generic (PLEG): container finished" podID="00418f19-47a7-473f-a369-bdf297890b24" containerID="b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c" exitCode=0
May 25 11:35:08.246959 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:08.246491    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerDied","Data":"b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c"}
May 25 11:35:10.257406 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:10.257369    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerStarted","Data":"bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840"}
May 25 11:35:38.370389 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:38.370300    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerStarted","Data":"7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8"}
May 25 11:35:38.370822 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:38.370435    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:38.412081 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:38.412035    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" podStartSLOduration=0.805645279 podStartE2EDuration="35.412023144s" podCreationTimestamp="2026-05-25 11:35:03 +0000 UTC" firstStartedPulling="2026-05-25 11:35:03.512225077 +0000 UTC m=+755.334149275" lastFinishedPulling="2026-05-25 11:35:38.118602942 +0000 UTC m=+789.940527140" observedRunningTime="2026-05-25 11:35:38.411133198 +0000 UTC m=+790.233057419" watchObservedRunningTime="2026-05-25 11:35:38.412023144 +0000 UTC m=+790.233947363"
May 25 11:35:39.380399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:39.380369    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:43.368407 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:43.368370    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:43.368918 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:43.368537    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:43.368918 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:43.368840    2557 prober.go:120] "Probe failed" probeType="Startup" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="tokenizer" probeResult="failure" output="Get \"http://10.133.0.39:8082/healthz\": dial tcp 10.133.0.39:8082: connect: connection refused"
May 25 11:35:53.369741 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:53.369709    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:35:53.370940 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:35:53.370919    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:36:35.735100 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:35.735066    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"]
May 25 11:36:35.735574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:35.735358    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="main" containerID="cri-o://bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840" gracePeriod=30
May 25 11:36:35.735574 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:35.735392    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="tokenizer" containerID="cri-o://7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8" gracePeriod=30
May 25 11:36:36.578805 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:36.578775    2557 generic.go:358] "Generic (PLEG): container finished" podID="00418f19-47a7-473f-a369-bdf297890b24" containerID="bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840" exitCode=0
May 25 11:36:36.579002 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:36.578823    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerDied","Data":"bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840"}
May 25 11:36:36.881042 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:36.881019    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:36:37.016290 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016255    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qrxq\" (UniqueName: \"kubernetes.io/projected/00418f19-47a7-473f-a369-bdf297890b24-kube-api-access-4qrxq\") pod \"00418f19-47a7-473f-a369-bdf297890b24\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") "
May 25 11:36:37.016476 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016344    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-uds\") pod \"00418f19-47a7-473f-a369-bdf297890b24\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") "
May 25 11:36:37.016476 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016370    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-kserve-provision-location\") pod \"00418f19-47a7-473f-a369-bdf297890b24\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") "
May 25 11:36:37.016476 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016410    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00418f19-47a7-473f-a369-bdf297890b24-tls-certs\") pod \"00418f19-47a7-473f-a369-bdf297890b24\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") "
May 25 11:36:37.016476 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016454    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-cache\") pod \"00418f19-47a7-473f-a369-bdf297890b24\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") "
May 25 11:36:37.016682 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016506    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-tmp\") pod \"00418f19-47a7-473f-a369-bdf297890b24\" (UID: \"00418f19-47a7-473f-a369-bdf297890b24\") "
May 25 11:36:37.016682 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016607    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "00418f19-47a7-473f-a369-bdf297890b24" (UID: "00418f19-47a7-473f-a369-bdf297890b24"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:37.016772 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016707    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "00418f19-47a7-473f-a369-bdf297890b24" (UID: "00418f19-47a7-473f-a369-bdf297890b24"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:37.016849 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016828    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:36:37.016943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016854    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:36:37.016943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.016862    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "00418f19-47a7-473f-a369-bdf297890b24" (UID: "00418f19-47a7-473f-a369-bdf297890b24"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:37.017179 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.017152    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "00418f19-47a7-473f-a369-bdf297890b24" (UID: "00418f19-47a7-473f-a369-bdf297890b24"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:36:37.018508 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.018486    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00418f19-47a7-473f-a369-bdf297890b24-kube-api-access-4qrxq" (OuterVolumeSpecName: "kube-api-access-4qrxq") pod "00418f19-47a7-473f-a369-bdf297890b24" (UID: "00418f19-47a7-473f-a369-bdf297890b24"). InnerVolumeSpecName "kube-api-access-4qrxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:36:37.018601 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.018539    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00418f19-47a7-473f-a369-bdf297890b24-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "00418f19-47a7-473f-a369-bdf297890b24" (UID: "00418f19-47a7-473f-a369-bdf297890b24"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:36:37.117931 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.117813    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qrxq\" (UniqueName: \"kubernetes.io/projected/00418f19-47a7-473f-a369-bdf297890b24-kube-api-access-4qrxq\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:36:37.117931 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.117850    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:36:37.117931 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.117878    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/00418f19-47a7-473f-a369-bdf297890b24-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:36:37.117931 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.117892    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/00418f19-47a7-473f-a369-bdf297890b24-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:36:37.583774 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.583739    2557 generic.go:358] "Generic (PLEG): container finished" podID="00418f19-47a7-473f-a369-bdf297890b24" containerID="7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8" exitCode=0
May 25 11:36:37.583988 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.583821    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"
May 25 11:36:37.583988 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.583821    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerDied","Data":"7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8"}
May 25 11:36:37.583988 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.583861    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5" event={"ID":"00418f19-47a7-473f-a369-bdf297890b24","Type":"ContainerDied","Data":"d392774468b4eb479e2069380a4e93d14251402d4b88107fa70fb4903cb6d4a9"}
May 25 11:36:37.583988 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.583900    2557 scope.go:117] "RemoveContainer" containerID="7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8"
May 25 11:36:37.592363 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.592343    2557 scope.go:117] "RemoveContainer" containerID="bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840"
May 25 11:36:37.599250 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.599230    2557 scope.go:117] "RemoveContainer" containerID="b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c"
May 25 11:36:37.605937 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.605922    2557 scope.go:117] "RemoveContainer" containerID="7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8"
May 25 11:36:37.606179 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:36:37.606156    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8\": container with ID starting with 7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8 not found: ID does not exist" containerID="7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8"
May 25 11:36:37.606233 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.606187    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8"} err="failed to get container status \"7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8\": rpc error: code = NotFound desc = could not find container \"7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8\": container with ID starting with 7c1b823963d4ceb3164d57b2798827fc77977264f494ceeadb2f1f99b6a2b8e8 not found: ID does not exist"
May 25 11:36:37.606233 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.606206    2557 scope.go:117] "RemoveContainer" containerID="bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840"
May 25 11:36:37.606446 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:36:37.606427    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840\": container with ID starting with bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840 not found: ID does not exist" containerID="bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840"
May 25 11:36:37.606513 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.606456    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840"} err="failed to get container status \"bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840\": rpc error: code = NotFound desc = could not find container \"bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840\": container with ID starting with bc6c5d316bf5e858316916ed6e26d4b621251885eeaea15e0502612ff528e840 not found: ID does not exist"
May 25 11:36:37.606513 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.606478    2557 scope.go:117] "RemoveContainer" containerID="b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c"
May 25 11:36:37.606723 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:36:37.606704    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c\": container with ID starting with b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c not found: ID does not exist" containerID="b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c"
May 25 11:36:37.606765 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.606730    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c"} err="failed to get container status \"b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c\": rpc error: code = NotFound desc = could not find container \"b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c\": container with ID starting with b1ee8145c7819b4e5db654ec78966954bc4360bf597d6e8f4087b62ce532078c not found: ID does not exist"
May 25 11:36:37.617291 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.617269    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"]
May 25 11:36:37.628698 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:37.628680    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7f5cd6d2d5"]
May 25 11:36:38.786065 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:38.786026    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00418f19-47a7-473f-a369-bdf297890b24" path="/var/lib/kubelet/pods/00418f19-47a7-473f-a369-bdf297890b24/volumes"
May 25 11:36:49.802188 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802153    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"]
May 25 11:36:49.802546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802517    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="tokenizer"
May 25 11:36:49.802546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="tokenizer"
May 25 11:36:49.802546 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802544    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="main"
May 25 11:36:49.802643 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802549    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="main"
May 25 11:36:49.802643 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802561    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="storage-initializer"
May 25 11:36:49.802643 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802566    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="storage-initializer"
May 25 11:36:49.802643 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802628    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="main"
May 25 11:36:49.802643 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.802634    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="00418f19-47a7-473f-a369-bdf297890b24" containerName="tokenizer"
May 25 11:36:49.806551 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.806534    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:49.811894 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.811855    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:36:49.812033 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.811856    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-epp-sa-dockercfg-pmb4p\""
May 25 11:36:49.812322 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.812304    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-configmap-ref-test-kserve-self-signed-certs\""
May 25 11:36:49.820070 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.820044    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"]
May 25 11:36:49.926420 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.926394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:49.926570 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.926427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-cache\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:49.926570 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.926503    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-tmp\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:49.926570 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.926533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqng\" (UniqueName: \"kubernetes.io/projected/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kube-api-access-9rqng\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:49.926709 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.926576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:49.926766 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:49.926699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.027836 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.027801    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-tmp\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.027836 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.027840    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqng\" (UniqueName: \"kubernetes.io/projected/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kube-api-access-9rqng\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028081 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.027908    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028081 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.027944    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028081 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.028016    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028081 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.028046    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-cache\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028286 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.028243    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-tmp\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.028291    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kserve-provision-location\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028391 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.028359    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-uds\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.028427 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.028403    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-cache\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.030315 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.030294    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tls-certs\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.038090 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.038074    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqng\" (UniqueName: \"kubernetes.io/projected/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kube-api-access-9rqng\") pod \"scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") " pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.116476 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.116445    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:50.278387 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.278321    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"]
May 25 11:36:50.630450 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.630412    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerStarted","Data":"92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787"}
May 25 11:36:50.630450 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:50.630451    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerStarted","Data":"713400d6932ace4f26271b73e5789136367b082b94e4682f13b432d96e0c8a24"}
May 25 11:36:51.635269 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:51.635235    2557 generic.go:358] "Generic (PLEG): container finished" podID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerID="92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787" exitCode=0
May 25 11:36:51.635606 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:51.635322    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerDied","Data":"92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787"}
May 25 11:36:52.642543 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:52.642502    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerStarted","Data":"c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5"}
May 25 11:36:52.642543 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:52.642545    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerStarted","Data":"7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3"}
May 25 11:36:52.642976 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:52.642718    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:36:52.677660 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:36:52.677609    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" podStartSLOduration=3.677593575 podStartE2EDuration="3.677593575s" podCreationTimestamp="2026-05-25 11:36:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:36:52.674270594 +0000 UTC m=+864.496194815" watchObservedRunningTime="2026-05-25 11:36:52.677593575 +0000 UTC m=+864.499517831"
May 25 11:37:00.116855 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:00.116811    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:00.117376 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:00.116987    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:00.119649 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:00.119626    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:00.672663 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:00.672627    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:22.679841 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:22.679767    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:28.743263 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:28.743235    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:37:28.744224 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:28.744203    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:37:32.680044 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.680013    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"]
May 25 11:37:32.683486 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.683467    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.692497 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.692479    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-kserve-self-signed-certs\""
May 25 11:37:32.692621 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.692480    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"scheduler-ha-replicas-test-epp-sa-dockercfg-8mc2f\""
May 25 11:37:32.770804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.770772    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"]
May 25 11:37:32.815617 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.815581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.815617 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.815623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.815880 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.815683    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.815880 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.815768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.815880 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.815818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpcxz\" (UniqueName: \"kubernetes.io/projected/685e86cf-afed-4ffc-81a1-92ad14541801-kube-api-access-xpcxz\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.815880 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.815852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685e86cf-afed-4ffc-81a1-92ad14541801-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917159 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917126    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685e86cf-afed-4ffc-81a1-92ad14541801-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917345 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917205    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917345 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917229    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917345 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917256    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917345 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917315    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917552 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917355    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpcxz\" (UniqueName: \"kubernetes.io/projected/685e86cf-afed-4ffc-81a1-92ad14541801-kube-api-access-xpcxz\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917697 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917675    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-tmp\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917767 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917733    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-cache\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917821 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917771    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-kserve-provision-location\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.917821 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.917787    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-uds\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.919555 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.919538    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685e86cf-afed-4ffc-81a1-92ad14541801-tls-certs\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.930706 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.930652    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpcxz\" (UniqueName: \"kubernetes.io/projected/685e86cf-afed-4ffc-81a1-92ad14541801-kube-api-access-xpcxz\") pod \"scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") " pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:32.992539 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:32.992508    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:33.160065 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:33.160039    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"]
May 25 11:37:33.161201 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:37:33.161171    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod685e86cf_afed_4ffc_81a1_92ad14541801.slice/crio-7d670389ce1a26e48be199c3c1a5fd07961b38fe112bbe72bfd2df356806b854 WatchSource:0}: Error finding container 7d670389ce1a26e48be199c3c1a5fd07961b38fe112bbe72bfd2df356806b854: Status 404 returned error can't find the container with id 7d670389ce1a26e48be199c3c1a5fd07961b38fe112bbe72bfd2df356806b854
May 25 11:37:33.789823 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:33.789790    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerStarted","Data":"f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4"}
May 25 11:37:33.789823 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:33.789826    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerStarted","Data":"7d670389ce1a26e48be199c3c1a5fd07961b38fe112bbe72bfd2df356806b854"}
May 25 11:37:34.183858 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.183823    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"]
May 25 11:37:34.184211 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.184174    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="main" containerID="cri-o://7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3" gracePeriod=30
May 25 11:37:34.184274 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.184202    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="tokenizer" containerID="cri-o://c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5" gracePeriod=30
May 25 11:37:34.795691 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.795647    2557 generic.go:358] "Generic (PLEG): container finished" podID="685e86cf-afed-4ffc-81a1-92ad14541801" containerID="f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4" exitCode=0
May 25 11:37:34.798058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.795691    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerDied","Data":"f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4"}
May 25 11:37:34.798058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.797913    2557 generic.go:358] "Generic (PLEG): container finished" podID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerID="7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3" exitCode=0
May 25 11:37:34.798058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:34.797983    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerDied","Data":"7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3"}
May 25 11:37:35.444100 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.444075    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:35.544165 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544075    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tls-certs\") pod \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") "
May 25 11:37:35.544334 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544169    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-uds\") pod \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") "
May 25 11:37:35.544334 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544240    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-cache\") pod \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") "
May 25 11:37:35.544334 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544268    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-tmp\") pod \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") "
May 25 11:37:35.544334 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544308    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rqng\" (UniqueName: \"kubernetes.io/projected/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kube-api-access-9rqng\") pod \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") "
May 25 11:37:35.544550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544369    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kserve-provision-location\") pod \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\" (UID: \"ec4cac8c-d94a-4667-b5cc-563727e6cfd1\") "
May 25 11:37:35.544550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544480    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "ec4cac8c-d94a-4667-b5cc-563727e6cfd1" (UID: "ec4cac8c-d94a-4667-b5cc-563727e6cfd1"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:35.544550 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544537    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "ec4cac8c-d94a-4667-b5cc-563727e6cfd1" (UID: "ec4cac8c-d94a-4667-b5cc-563727e6cfd1"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:35.544699 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544623    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "ec4cac8c-d94a-4667-b5cc-563727e6cfd1" (UID: "ec4cac8c-d94a-4667-b5cc-563727e6cfd1"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:35.544752 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544741    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:37:35.544802 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544761    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:37:35.544802 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.544771    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:37:35.545271 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.545243    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "ec4cac8c-d94a-4667-b5cc-563727e6cfd1" (UID: "ec4cac8c-d94a-4667-b5cc-563727e6cfd1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:37:35.546208 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.546182    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec4cac8c-d94a-4667-b5cc-563727e6cfd1" (UID: "ec4cac8c-d94a-4667-b5cc-563727e6cfd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:37:35.546436 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.546415    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kube-api-access-9rqng" (OuterVolumeSpecName: "kube-api-access-9rqng") pod "ec4cac8c-d94a-4667-b5cc-563727e6cfd1" (UID: "ec4cac8c-d94a-4667-b5cc-563727e6cfd1"). InnerVolumeSpecName "kube-api-access-9rqng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:37:35.646272 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.646240    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rqng\" (UniqueName: \"kubernetes.io/projected/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kube-api-access-9rqng\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:37:35.646272 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.646266    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:37:35.646272 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.646280    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec4cac8c-d94a-4667-b5cc-563727e6cfd1-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:37:35.803595 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.803514    2557 generic.go:358] "Generic (PLEG): container finished" podID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerID="c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5" exitCode=0
May 25 11:37:35.803595 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.803585    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"
May 25 11:37:35.804125 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.803602    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerDied","Data":"c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5"}
May 25 11:37:35.804125 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.803641    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc" event={"ID":"ec4cac8c-d94a-4667-b5cc-563727e6cfd1","Type":"ContainerDied","Data":"713400d6932ace4f26271b73e5789136367b082b94e4682f13b432d96e0c8a24"}
May 25 11:37:35.804125 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.803662    2557 scope.go:117] "RemoveContainer" containerID="c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5"
May 25 11:37:35.806055 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.806025    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerStarted","Data":"72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4"}
May 25 11:37:35.806172 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.806060    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerStarted","Data":"787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce"}
May 25 11:37:35.806236 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.806221    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:35.815127 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.815049    2557 scope.go:117] "RemoveContainer" containerID="7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3"
May 25 11:37:35.824448 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.824430    2557 scope.go:117] "RemoveContainer" containerID="92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787"
May 25 11:37:35.831269 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.831254    2557 scope.go:117] "RemoveContainer" containerID="c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5"
May 25 11:37:35.831584 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:37:35.831563    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5\": container with ID starting with c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5 not found: ID does not exist" containerID="c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5"
May 25 11:37:35.831650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.831596    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5"} err="failed to get container status \"c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5\": rpc error: code = NotFound desc = could not find container \"c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5\": container with ID starting with c0785983cfe603b6c89919b5329484708c310b9d82205fef2b2da7e3888840f5 not found: ID does not exist"
May 25 11:37:35.831650 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.831622    2557 scope.go:117] "RemoveContainer" containerID="7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3"
May 25 11:37:35.831893 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:37:35.831849    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3\": container with ID starting with 7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3 not found: ID does not exist" containerID="7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3"
May 25 11:37:35.832011 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.831895    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3"} err="failed to get container status \"7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3\": rpc error: code = NotFound desc = could not find container \"7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3\": container with ID starting with 7445bf4e7022d2496b8bc945cb729bfc09fa2c9a3f9b02a11ef4dab60a3930c3 not found: ID does not exist"
May 25 11:37:35.832011 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.831917    2557 scope.go:117] "RemoveContainer" containerID="92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787"
May 25 11:37:35.832167 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:37:35.832148    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787\": container with ID starting with 92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787 not found: ID does not exist" containerID="92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787"
May 25 11:37:35.832209 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.832173    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787"} err="failed to get container status \"92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787\": rpc error: code = NotFound desc = could not find container \"92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787\": container with ID starting with 92a3304e927f9cc609795ce89ced04146faa37d4fe4b7746c70a99931fa15787 not found: ID does not exist"
May 25 11:37:35.838583 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.838563    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"]
May 25 11:37:35.847183 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.847162    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-87bc5ksjjc"]
May 25 11:37:35.887124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:35.887082    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" podStartSLOduration=3.8870706779999997 podStartE2EDuration="3.887070678s" podCreationTimestamp="2026-05-25 11:37:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:37:35.886221788 +0000 UTC m=+907.708146020" watchObservedRunningTime="2026-05-25 11:37:35.887070678 +0000 UTC m=+907.708994898"
May 25 11:37:36.780328 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:36.780289    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" path="/var/lib/kubelet/pods/ec4cac8c-d94a-4667-b5cc-563727e6cfd1/volumes"
May 25 11:37:42.992862 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:42.992821    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:42.992862 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:42.992880    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:42.995911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:42.995888    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:37:43.836152 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:37:43.836125    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:38:04.498555 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.498509    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"]
May 25 11:38:04.499138 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499121    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="storage-initializer"
May 25 11:38:04.499184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499141    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="storage-initializer"
May 25 11:38:04.499219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499188    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="tokenizer"
May 25 11:38:04.499219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499197    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="tokenizer"
May 25 11:38:04.499219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499208    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="main"
May 25 11:38:04.499219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499216    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="main"
May 25 11:38:04.499340 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499295    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="tokenizer"
May 25 11:38:04.499340 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.499311    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec4cac8c-d94a-4667-b5cc-563727e6cfd1" containerName="main"
May 25 11:38:04.503168 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.503141    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.507643 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.507619    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-sa-dockercfg-fxjf5\""
May 25 11:38:04.508018 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.507999    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs\""
May 25 11:38:04.515378 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.515347    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"]
May 25 11:38:04.604331 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.604292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65825f57-1540-40b9-9752-2c089721ccbb-tls-certs\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.604331 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.604336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-cache\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.604686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.604412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw9gb\" (UniqueName: \"kubernetes.io/projected/65825f57-1540-40b9-9752-2c089721ccbb-kube-api-access-nw9gb\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.604686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.604472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-tmp\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.604686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.604501    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-kserve-provision-location\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.604686 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.604565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-uds\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.705622 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.705577    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-uds\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.705622 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.705631    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65825f57-1540-40b9-9752-2c089721ccbb-tls-certs\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.705923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.705651    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-cache\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.705923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.705685    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nw9gb\" (UniqueName: \"kubernetes.io/projected/65825f57-1540-40b9-9752-2c089721ccbb-kube-api-access-nw9gb\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.705923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.705725    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-tmp\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.705923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.705746    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-kserve-provision-location\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.706148 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.706088    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-uds\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.706148 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.706130    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-cache\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.706227 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.706170    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-kserve-provision-location\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.706227 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.706207    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-tmp\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.708191 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.708169    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65825f57-1540-40b9-9752-2c089721ccbb-tls-certs\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.715697 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.715672    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw9gb\" (UniqueName: \"kubernetes.io/projected/65825f57-1540-40b9-9752-2c089721ccbb-kube-api-access-nw9gb\") pod \"llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") " pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.812976 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.812880    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:04.839315 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.839288    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:38:04.962088 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:04.962061    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"]
May 25 11:38:04.964768 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:38:04.964728    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65825f57_1540_40b9_9752_2c089721ccbb.slice/crio-b180746c21a37e616eb69d53af6e4b17e23b5c630205595bc64dcf732a6bf9b0 WatchSource:0}: Error finding container b180746c21a37e616eb69d53af6e4b17e23b5c630205595bc64dcf732a6bf9b0: Status 404 returned error can't find the container with id b180746c21a37e616eb69d53af6e4b17e23b5c630205595bc64dcf732a6bf9b0
May 25 11:38:05.917804 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:05.917768    2557 generic.go:358] "Generic (PLEG): container finished" podID="65825f57-1540-40b9-9752-2c089721ccbb" containerID="775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941" exitCode=0
May 25 11:38:05.918241 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:05.917854    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerDied","Data":"775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941"}
May 25 11:38:05.918241 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:05.917910    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerStarted","Data":"b180746c21a37e616eb69d53af6e4b17e23b5c630205595bc64dcf732a6bf9b0"}
May 25 11:38:06.924264 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:06.924232    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerStarted","Data":"62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05"}
May 25 11:38:06.924692 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:06.924272    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerStarted","Data":"f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047"}
May 25 11:38:06.924692 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:06.924377    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:06.955315 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:06.955263    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" podStartSLOduration=2.955245174 podStartE2EDuration="2.955245174s" podCreationTimestamp="2026-05-25 11:38:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:38:06.95247328 +0000 UTC m=+938.774397500" watchObservedRunningTime="2026-05-25 11:38:06.955245174 +0000 UTC m=+938.777169394"
May 25 11:38:14.813163 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:14.813107    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:14.813163 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:14.813170    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:14.816054 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:14.816029    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:14.956730 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:14.956698    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:38:35.961207 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:38:35.961181    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:39:43.555358 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:43.555318    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"]
May 25 11:39:43.555969 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:43.555722    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="main" containerID="cri-o://787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce" gracePeriod=30
May 25 11:39:43.556182 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:43.556146    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="tokenizer" containerID="cri-o://72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4" gracePeriod=30
May 25 11:39:43.836193 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:43.836152    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="tokenizer" probeResult="failure" output="Get \"http://10.133.0.41:8082/healthz\": dial tcp 10.133.0.41:8082: connect: connection refused"
May 25 11:39:44.273231 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.273151    2557 generic.go:358] "Generic (PLEG): container finished" podID="685e86cf-afed-4ffc-81a1-92ad14541801" containerID="787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce" exitCode=0
May 25 11:39:44.273366 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.273231    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerDied","Data":"787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce"}
May 25 11:39:44.709513 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.709485    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:39:44.807366 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807294    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-cache\") pod \"685e86cf-afed-4ffc-81a1-92ad14541801\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") "
May 25 11:39:44.807366 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807337    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-uds\") pod \"685e86cf-afed-4ffc-81a1-92ad14541801\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") "
May 25 11:39:44.807583 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807374    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685e86cf-afed-4ffc-81a1-92ad14541801-tls-certs\") pod \"685e86cf-afed-4ffc-81a1-92ad14541801\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") "
May 25 11:39:44.807583 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807396    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpcxz\" (UniqueName: \"kubernetes.io/projected/685e86cf-afed-4ffc-81a1-92ad14541801-kube-api-access-xpcxz\") pod \"685e86cf-afed-4ffc-81a1-92ad14541801\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") "
May 25 11:39:44.807583 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807433    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-kserve-provision-location\") pod \"685e86cf-afed-4ffc-81a1-92ad14541801\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") "
May 25 11:39:44.807583 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807501    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-tmp\") pod \"685e86cf-afed-4ffc-81a1-92ad14541801\" (UID: \"685e86cf-afed-4ffc-81a1-92ad14541801\") "
May 25 11:39:44.807765 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807596    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "685e86cf-afed-4ffc-81a1-92ad14541801" (UID: "685e86cf-afed-4ffc-81a1-92ad14541801"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.807765 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807632    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "685e86cf-afed-4ffc-81a1-92ad14541801" (UID: "685e86cf-afed-4ffc-81a1-92ad14541801"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.807836 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807766    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:39:44.807836 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807784    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:39:44.807935 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.807851    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "685e86cf-afed-4ffc-81a1-92ad14541801" (UID: "685e86cf-afed-4ffc-81a1-92ad14541801"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.808188 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.808162    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "685e86cf-afed-4ffc-81a1-92ad14541801" (UID: "685e86cf-afed-4ffc-81a1-92ad14541801"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:39:44.809397 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.809376    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/685e86cf-afed-4ffc-81a1-92ad14541801-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "685e86cf-afed-4ffc-81a1-92ad14541801" (UID: "685e86cf-afed-4ffc-81a1-92ad14541801"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:39:44.809515 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.809493    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/685e86cf-afed-4ffc-81a1-92ad14541801-kube-api-access-xpcxz" (OuterVolumeSpecName: "kube-api-access-xpcxz") pod "685e86cf-afed-4ffc-81a1-92ad14541801" (UID: "685e86cf-afed-4ffc-81a1-92ad14541801"). InnerVolumeSpecName "kube-api-access-xpcxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:39:44.909149 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.909125    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/685e86cf-afed-4ffc-81a1-92ad14541801-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:39:44.909149 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.909147    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpcxz\" (UniqueName: \"kubernetes.io/projected/685e86cf-afed-4ffc-81a1-92ad14541801-kube-api-access-xpcxz\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:39:44.909286 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.909158    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:39:44.909286 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:44.909168    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/685e86cf-afed-4ffc-81a1-92ad14541801-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:39:45.278405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.278372    2557 generic.go:358] "Generic (PLEG): container finished" podID="685e86cf-afed-4ffc-81a1-92ad14541801" containerID="72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4" exitCode=0
May 25 11:39:45.278613 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.278454    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerDied","Data":"72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4"}
May 25 11:39:45.278613 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.278488    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"
May 25 11:39:45.278613 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.278502    2557 scope.go:117] "RemoveContainer" containerID="72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4"
May 25 11:39:45.278613 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.278491    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp" event={"ID":"685e86cf-afed-4ffc-81a1-92ad14541801","Type":"ContainerDied","Data":"7d670389ce1a26e48be199c3c1a5fd07961b38fe112bbe72bfd2df356806b854"}
May 25 11:39:45.290169 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.290153    2557 scope.go:117] "RemoveContainer" containerID="787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce"
May 25 11:39:45.297439 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.297420    2557 scope.go:117] "RemoveContainer" containerID="f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4"
May 25 11:39:45.304933 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.304914    2557 scope.go:117] "RemoveContainer" containerID="72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4"
May 25 11:39:45.305342 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:39:45.305319    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4\": container with ID starting with 72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4 not found: ID does not exist" containerID="72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4"
May 25 11:39:45.305417 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.305352    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4"} err="failed to get container status \"72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4\": rpc error: code = NotFound desc = could not find container \"72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4\": container with ID starting with 72d4300ee7cccd847b6d345a495ba988ff91de7537fea15ef8c867377b3fe1a4 not found: ID does not exist"
May 25 11:39:45.305417 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.305376    2557 scope.go:117] "RemoveContainer" containerID="787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce"
May 25 11:39:45.305609 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:39:45.305590    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce\": container with ID starting with 787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce not found: ID does not exist" containerID="787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce"
May 25 11:39:45.305653 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.305616    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce"} err="failed to get container status \"787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce\": rpc error: code = NotFound desc = could not find container \"787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce\": container with ID starting with 787f7a0ec4feff5e61caf08d9af620de7058cab82468c41fc14caa054a46e2ce not found: ID does not exist"
May 25 11:39:45.305653 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.305633    2557 scope.go:117] "RemoveContainer" containerID="f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4"
May 25 11:39:45.305852 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:39:45.305835    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4\": container with ID starting with f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4 not found: ID does not exist" containerID="f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4"
May 25 11:39:45.305927 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.305858    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4"} err="failed to get container status \"f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4\": rpc error: code = NotFound desc = could not find container \"f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4\": container with ID starting with f340781d43d12ef748cfd29584ee6176ac1262ebf985aaeb55caa8f4c31842d4 not found: ID does not exist"
May 25 11:39:45.306710 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.306692    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"]
May 25 11:39:45.313582 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:45.313558    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-54d8f6fshchp"]
May 25 11:39:46.779422 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:39:46.779388    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" path="/var/lib/kubelet/pods/685e86cf-afed-4ffc-81a1-92ad14541801/volumes"
May 25 11:40:55.923264 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:55.923227    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"]
May 25 11:40:55.923795 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:55.923616    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="main" containerID="cri-o://f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047" gracePeriod=30
May 25 11:40:55.923795 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:55.923712    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="tokenizer" containerID="cri-o://62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05" gracePeriod=30
May 25 11:40:55.959644 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:40:55.959618    2557 logging.go:55] [core] [Channel #233 SubChannel #234]grpc: addrConn.createTransport failed to connect to {Addr: "10.133.0.42:9003", ServerName: "10.133.0.42:9003", }. Err: connection error: desc = "transport: Error while dialing: dial tcp 10.133.0.42:9003: connect: connection refused"
May 25 11:40:56.526814 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:56.526782    2557 generic.go:358] "Generic (PLEG): container finished" podID="65825f57-1540-40b9-9752-2c089721ccbb" containerID="f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047" exitCode=0
May 25 11:40:56.527003 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:56.526820    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerDied","Data":"f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047"}
May 25 11:40:56.959743 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:56.959707    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="main" probeResult="failure" output="timeout: failed to connect service \"10.133.0.42:9003\" within 1s: context deadline exceeded"
May 25 11:40:57.077858 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.077836    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:40:57.156309 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156236    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-uds\") pod \"65825f57-1540-40b9-9752-2c089721ccbb\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") "
May 25 11:40:57.156309 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156278    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65825f57-1540-40b9-9752-2c089721ccbb-tls-certs\") pod \"65825f57-1540-40b9-9752-2c089721ccbb\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") "
May 25 11:40:57.156547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156324    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nw9gb\" (UniqueName: \"kubernetes.io/projected/65825f57-1540-40b9-9752-2c089721ccbb-kube-api-access-nw9gb\") pod \"65825f57-1540-40b9-9752-2c089721ccbb\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") "
May 25 11:40:57.156547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156356    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-kserve-provision-location\") pod \"65825f57-1540-40b9-9752-2c089721ccbb\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") "
May 25 11:40:57.156547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156418    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-cache\") pod \"65825f57-1540-40b9-9752-2c089721ccbb\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") "
May 25 11:40:57.156547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156509    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "65825f57-1540-40b9-9752-2c089721ccbb" (UID: "65825f57-1540-40b9-9752-2c089721ccbb"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:57.156547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156539    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-tmp\") pod \"65825f57-1540-40b9-9752-2c089721ccbb\" (UID: \"65825f57-1540-40b9-9752-2c089721ccbb\") "
May 25 11:40:57.156911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156887    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:40:57.156911 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156889    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "65825f57-1540-40b9-9752-2c089721ccbb" (UID: "65825f57-1540-40b9-9752-2c089721ccbb"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:57.157044 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.156997    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "65825f57-1540-40b9-9752-2c089721ccbb" (UID: "65825f57-1540-40b9-9752-2c089721ccbb"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:57.157248 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.157224    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "65825f57-1540-40b9-9752-2c089721ccbb" (UID: "65825f57-1540-40b9-9752-2c089721ccbb"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:40:57.158434 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.158402    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65825f57-1540-40b9-9752-2c089721ccbb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65825f57-1540-40b9-9752-2c089721ccbb" (UID: "65825f57-1540-40b9-9752-2c089721ccbb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:40:57.158621 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.158601    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65825f57-1540-40b9-9752-2c089721ccbb-kube-api-access-nw9gb" (OuterVolumeSpecName: "kube-api-access-nw9gb") pod "65825f57-1540-40b9-9752-2c089721ccbb" (UID: "65825f57-1540-40b9-9752-2c089721ccbb"). InnerVolumeSpecName "kube-api-access-nw9gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:40:57.258298 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.258256    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65825f57-1540-40b9-9752-2c089721ccbb-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:40:57.258298 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.258293    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nw9gb\" (UniqueName: \"kubernetes.io/projected/65825f57-1540-40b9-9752-2c089721ccbb-kube-api-access-nw9gb\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:40:57.258489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.258310    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:40:57.258489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.258324    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:40:57.258489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.258339    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/65825f57-1540-40b9-9752-2c089721ccbb-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:40:57.531403 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.531312    2557 generic.go:358] "Generic (PLEG): container finished" podID="65825f57-1540-40b9-9752-2c089721ccbb" containerID="62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05" exitCode=0
May 25 11:40:57.531403 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.531380    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerDied","Data":"62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05"}
May 25 11:40:57.531403 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.531395    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"
May 25 11:40:57.531657 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.531415    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679" event={"ID":"65825f57-1540-40b9-9752-2c089721ccbb","Type":"ContainerDied","Data":"b180746c21a37e616eb69d53af6e4b17e23b5c630205595bc64dcf732a6bf9b0"}
May 25 11:40:57.531657 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.531435    2557 scope.go:117] "RemoveContainer" containerID="62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05"
May 25 11:40:57.539977 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.539957    2557 scope.go:117] "RemoveContainer" containerID="f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047"
May 25 11:40:57.547407 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.547391    2557 scope.go:117] "RemoveContainer" containerID="775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941"
May 25 11:40:57.554094 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.554080    2557 scope.go:117] "RemoveContainer" containerID="62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05"
May 25 11:40:57.554377 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:40:57.554352    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05\": container with ID starting with 62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05 not found: ID does not exist" containerID="62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05"
May 25 11:40:57.554439 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.554387    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05"} err="failed to get container status \"62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05\": rpc error: code = NotFound desc = could not find container \"62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05\": container with ID starting with 62740830aa638fb3ac9e9d5514a79db8c9461abe22018b57a6a59c6b50615d05 not found: ID does not exist"
May 25 11:40:57.554439 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.554404    2557 scope.go:117] "RemoveContainer" containerID="f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047"
May 25 11:40:57.554688 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:40:57.554661    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047\": container with ID starting with f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047 not found: ID does not exist" containerID="f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047"
May 25 11:40:57.554731 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.554701    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047"} err="failed to get container status \"f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047\": rpc error: code = NotFound desc = could not find container \"f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047\": container with ID starting with f96ef428814e8bc304bf1bc9a245a09d798251dcdae0f128777b98455c31d047 not found: ID does not exist"
May 25 11:40:57.554731 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.554725    2557 scope.go:117] "RemoveContainer" containerID="775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941"
May 25 11:40:57.555025 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:40:57.555008    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941\": container with ID starting with 775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941 not found: ID does not exist" containerID="775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941"
May 25 11:40:57.555160 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.555029    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941"} err="failed to get container status \"775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941\": rpc error: code = NotFound desc = could not find container \"775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941\": container with ID starting with 775e58d2ae5d1949b4a70d6ffb23956e194b7aa02006add5087a5f5b85fac941 not found: ID does not exist"
May 25 11:40:57.559169 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.559150    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"]
May 25 11:40:57.576347 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:57.573573    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schezg679"]
May 25 11:40:58.779374 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:40:58.779341    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65825f57-1540-40b9-9752-2c089721ccbb" path="/var/lib/kubelet/pods/65825f57-1540-40b9-9752-2c089721ccbb/volumes"
May 25 11:41:29.912405 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912362    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"]
May 25 11:41:29.912936 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912912    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="main"
May 25 11:41:29.912936 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912932    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="main"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912949    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="storage-initializer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912958    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="storage-initializer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912968    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="main"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912976    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="main"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912991    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="tokenizer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.912999    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="tokenizer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913023    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="storage-initializer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913031    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="storage-initializer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913050    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="tokenizer"
May 25 11:41:29.913074 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913060    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="tokenizer"
May 25 11:41:29.913593 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913147    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="tokenizer"
May 25 11:41:29.913593 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913161    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="tokenizer"
May 25 11:41:29.913593 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913172    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="65825f57-1540-40b9-9752-2c089721ccbb" containerName="main"
May 25 11:41:29.913593 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.913184    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="685e86cf-afed-4ffc-81a1-92ad14541801" containerName="main"
May 25 11:41:29.917432 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.917411    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:29.942493 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.942465    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:41:29.943732 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.943714    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-test-kserve-self-signed-certs\""
May 25 11:41:29.943834 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.943805    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-test-epp-sa-dockercfg-tzkdp\""
May 25 11:41:29.975321 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:29.975292    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"]
May 25 11:41:30.033297 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.033259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.033489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.033337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-cache\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.033489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.033378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kserve-provision-location\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.033489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.033415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-uds\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.033673 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.033536    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-tmp\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.033673 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.033579    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cj5z\" (UniqueName: \"kubernetes.io/projected/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kube-api-access-2cj5z\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134352 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134314    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-tmp\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134554 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134358    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj5z\" (UniqueName: \"kubernetes.io/projected/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kube-api-access-2cj5z\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134554 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134414    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134554 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134433    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-cache\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134554 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134461    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kserve-provision-location\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134554 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134496    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-uds\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134854 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134835    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-tmp\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134897    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kserve-provision-location\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.134981 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.134938    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-cache\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.135023 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.135002    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-uds\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.136948 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.136928    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tls-certs\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.146373 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.146350    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cj5z\" (UniqueName: \"kubernetes.io/projected/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kube-api-access-2cj5z\") pod \"custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") " pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.227007 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.226916    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:30.387909 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.387878    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"]
May 25 11:41:30.388268 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:41:30.388246    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42bc8ce_4dba_4832_b754_682b4d3dbc7f.slice/crio-c177587454d1bf6a74549eaf869b6fab27cd42929b2322293f81a9ab23948474 WatchSource:0}: Error finding container c177587454d1bf6a74549eaf869b6fab27cd42929b2322293f81a9ab23948474: Status 404 returned error can't find the container with id c177587454d1bf6a74549eaf869b6fab27cd42929b2322293f81a9ab23948474
May 25 11:41:30.390219 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.390199    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:41:30.652910 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.652858    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerStarted","Data":"1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41"}
May 25 11:41:30.652910 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:30.652915    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerStarted","Data":"c177587454d1bf6a74549eaf869b6fab27cd42929b2322293f81a9ab23948474"}
May 25 11:41:31.658135 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:31.658096    2557 generic.go:358] "Generic (PLEG): container finished" podID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerID="1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41" exitCode=0
May 25 11:41:31.658611 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:31.658178    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerDied","Data":"1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41"}
May 25 11:41:32.664354 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:32.664316    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerStarted","Data":"4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1"}
May 25 11:41:32.664354 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:32.664351    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerStarted","Data":"7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc"}
May 25 11:41:32.664779 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:32.664426    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:40.227342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:40.227307    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:40.227342 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:40.227343    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:40.230075 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:40.230050    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:41:40.279478 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:40.279435    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" podStartSLOduration=11.279419841 podStartE2EDuration="11.279419841s" podCreationTimestamp="2026-05-25 11:41:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:41:32.716831573 +0000 UTC m=+1144.538755793" watchObservedRunningTime="2026-05-25 11:41:40.279419841 +0000 UTC m=+1152.101344108"
May 25 11:41:40.696394 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:41:40.696365    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:42:01.700779 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:42:01.700750    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:42:28.769300 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:42:28.769273    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:42:28.771000 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:42:28.770979    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:44:15.965217 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:15.965184    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"]
May 25 11:44:15.966259 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:15.966198    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="main" containerID="cri-o://7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc" gracePeriod=30
May 25 11:44:15.966488 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:15.966264    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="tokenizer" containerID="cri-o://4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1" gracePeriod=30
May 25 11:44:16.233216 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:16.233126    2557 generic.go:358] "Generic (PLEG): container finished" podID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerID="7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc" exitCode=0
May 25 11:44:16.233362 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:16.233203    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerDied","Data":"7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc"}
May 25 11:44:17.120222 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.120189    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:44:17.238633 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.238551    2557 generic.go:358] "Generic (PLEG): container finished" podID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerID="4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1" exitCode=0
May 25 11:44:17.238926 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.238635    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"
May 25 11:44:17.238926 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.238633    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerDied","Data":"4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1"}
May 25 11:44:17.238926 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.238675    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s" event={"ID":"f42bc8ce-4dba-4832-b754-682b4d3dbc7f","Type":"ContainerDied","Data":"c177587454d1bf6a74549eaf869b6fab27cd42929b2322293f81a9ab23948474"}
May 25 11:44:17.238926 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.238695    2557 scope.go:117] "RemoveContainer" containerID="4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1"
May 25 11:44:17.246704 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.246690    2557 scope.go:117] "RemoveContainer" containerID="7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc"
May 25 11:44:17.253988 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.253979    2557 scope.go:117] "RemoveContainer" containerID="1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41"
May 25 11:44:17.261532 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.261505    2557 scope.go:117] "RemoveContainer" containerID="4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1"
May 25 11:44:17.261785 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:44:17.261767    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1\": container with ID starting with 4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1 not found: ID does not exist" containerID="4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1"
May 25 11:44:17.261846 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.261793    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1"} err="failed to get container status \"4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1\": rpc error: code = NotFound desc = could not find container \"4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1\": container with ID starting with 4ffd38f11a0b8428fe439e1fae149f6f03caed7c42b4d153c60b82ec45ca51e1 not found: ID does not exist"
May 25 11:44:17.261846 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.261812    2557 scope.go:117] "RemoveContainer" containerID="7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc"
May 25 11:44:17.262030 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:44:17.262012    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc\": container with ID starting with 7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc not found: ID does not exist" containerID="7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc"
May 25 11:44:17.262075 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.262038    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc"} err="failed to get container status \"7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc\": rpc error: code = NotFound desc = could not find container \"7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc\": container with ID starting with 7916a763ce9791dded2af44c4b9646864eae365f980b01449461ceb6f246debc not found: ID does not exist"
May 25 11:44:17.262075 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.262055    2557 scope.go:117] "RemoveContainer" containerID="1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41"
May 25 11:44:17.262255 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:44:17.262233    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41\": container with ID starting with 1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41 not found: ID does not exist" containerID="1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41"
May 25 11:44:17.262302 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.262258    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41"} err="failed to get container status \"1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41\": rpc error: code = NotFound desc = could not find container \"1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41\": container with ID starting with 1e8f26d7cda2364dcfc101613ff92a9956a69594db029fcce3f7a3dcbe745d41 not found: ID does not exist"
May 25 11:44:17.271489 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271468    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-uds\") pod \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") "
May 25 11:44:17.271572 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271512    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-tmp\") pod \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") "
May 25 11:44:17.271572 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271531    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kserve-provision-location\") pod \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") "
May 25 11:44:17.271572 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271556    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-cache\") pod \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") "
May 25 11:44:17.271695 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271604    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cj5z\" (UniqueName: \"kubernetes.io/projected/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kube-api-access-2cj5z\") pod \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") "
May 25 11:44:17.271695 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271631    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tls-certs\") pod \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\" (UID: \"f42bc8ce-4dba-4832-b754-682b4d3dbc7f\") "
May 25 11:44:17.271797 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271718    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "f42bc8ce-4dba-4832-b754-682b4d3dbc7f" (UID: "f42bc8ce-4dba-4832-b754-682b4d3dbc7f"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:17.271855 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271829    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "f42bc8ce-4dba-4832-b754-682b4d3dbc7f" (UID: "f42bc8ce-4dba-4832-b754-682b4d3dbc7f"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:17.271937 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271888    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "f42bc8ce-4dba-4832-b754-682b4d3dbc7f" (UID: "f42bc8ce-4dba-4832-b754-682b4d3dbc7f"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:17.271994 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271967    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:44:17.271994 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.271987    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:44:17.272070 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.272005    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:44:17.272283 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.272259    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f42bc8ce-4dba-4832-b754-682b4d3dbc7f" (UID: "f42bc8ce-4dba-4832-b754-682b4d3dbc7f"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:44:17.273547 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.273523    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kube-api-access-2cj5z" (OuterVolumeSpecName: "kube-api-access-2cj5z") pod "f42bc8ce-4dba-4832-b754-682b4d3dbc7f" (UID: "f42bc8ce-4dba-4832-b754-682b4d3dbc7f"). InnerVolumeSpecName "kube-api-access-2cj5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:44:17.273672 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.273654    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f42bc8ce-4dba-4832-b754-682b4d3dbc7f" (UID: "f42bc8ce-4dba-4832-b754-682b4d3dbc7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:44:17.372943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.372904    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cj5z\" (UniqueName: \"kubernetes.io/projected/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kube-api-access-2cj5z\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:44:17.372943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.372939    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:44:17.372943 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.372949    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f42bc8ce-4dba-4832-b754-682b4d3dbc7f-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:44:17.564187 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.564160    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"]
May 25 11:44:17.571004 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:17.570983    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-74bc7c4dqtc5s"]
May 25 11:44:18.782731 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:18.782690    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" path="/var/lib/kubelet/pods/f42bc8ce-4dba-4832-b754-682b4d3dbc7f/volumes"
May 25 11:44:31.518387 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518352    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"]
May 25 11:44:31.518748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518692    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="tokenizer"
May 25 11:44:31.518748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518703    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="tokenizer"
May 25 11:44:31.518748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518730    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="storage-initializer"
May 25 11:44:31.518748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518736    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="storage-initializer"
May 25 11:44:31.518748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518743    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="main"
May 25 11:44:31.518748 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518748    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="main"
May 25 11:44:31.518962 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518799    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="tokenizer"
May 25 11:44:31.518962 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.518807    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="f42bc8ce-4dba-4832-b754-682b4d3dbc7f" containerName="main"
May 25 11:44:31.523135 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.523111    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.526222 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.526202    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-test-kserve-self-signed-certs\""
May 25 11:44:31.526357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.526253    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:44:31.526357 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.526253    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"router-with-refs-test-epp-sa-dockercfg-wwcft\""
May 25 11:44:31.531852 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.531831    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"]
May 25 11:44:31.697164 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.697128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-kserve-provision-location\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.697339 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.697173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-cache\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.697339 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.697208    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-uds\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.697339 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.697230    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-tmp\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.697339 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.697248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8448e79-b9b8-4483-962f-97763a413189-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.697480 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.697352    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2lmv\" (UniqueName: \"kubernetes.io/projected/a8448e79-b9b8-4483-962f-97763a413189-kube-api-access-g2lmv\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.797825 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.797741    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-kserve-provision-location\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.797825 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.797789    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-cache\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.797825 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.797822    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-uds\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.797842    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-tmp\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.797888    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8448e79-b9b8-4483-962f-97763a413189-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798124 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.798014    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2lmv\" (UniqueName: \"kubernetes.io/projected/a8448e79-b9b8-4483-962f-97763a413189-kube-api-access-g2lmv\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798301 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.798179    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-kserve-provision-location\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798301 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.798204    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-tmp\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798301 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.798281    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-cache\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.798443 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.798359    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-uds\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.800507 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.800485    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8448e79-b9b8-4483-962f-97763a413189-tls-certs\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.809157 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.809133    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2lmv\" (UniqueName: \"kubernetes.io/projected/a8448e79-b9b8-4483-962f-97763a413189-kube-api-access-g2lmv\") pod \"router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") " pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.832399 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.832376    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:31.973585 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:31.973552    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"]
May 25 11:44:31.976245 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:44:31.976211    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8448e79_b9b8_4483_962f_97763a413189.slice/crio-3437838f6753f101c349a048e9733d5ab099295a10fd53f7e5b68bade065abdb WatchSource:0}: Error finding container 3437838f6753f101c349a048e9733d5ab099295a10fd53f7e5b68bade065abdb: Status 404 returned error can't find the container with id 3437838f6753f101c349a048e9733d5ab099295a10fd53f7e5b68bade065abdb
May 25 11:44:32.288719 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:32.288685    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerStarted","Data":"3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4"}
May 25 11:44:32.288719 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:32.288721    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerStarted","Data":"3437838f6753f101c349a048e9733d5ab099295a10fd53f7e5b68bade065abdb"}
May 25 11:44:33.292908 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:33.292859    2557 generic.go:358] "Generic (PLEG): container finished" podID="a8448e79-b9b8-4483-962f-97763a413189" containerID="3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4" exitCode=0
May 25 11:44:33.292908 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:33.292895    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerDied","Data":"3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4"}
May 25 11:44:34.298465 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:34.298426    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerStarted","Data":"adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b"}
May 25 11:44:34.298465 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:34.298461    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerStarted","Data":"3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614"}
May 25 11:44:34.298975 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:34.298566    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:34.322204 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:34.322140    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" podStartSLOduration=3.32212151 podStartE2EDuration="3.32212151s" podCreationTimestamp="2026-05-25 11:44:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:44:34.319940008 +0000 UTC m=+1326.141864234" watchObservedRunningTime="2026-05-25 11:44:34.32212151 +0000 UTC m=+1326.144045724"
May 25 11:44:41.832923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:41.832850    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:41.832923 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:41.832931    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:41.835540 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:41.835518    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:44:42.327791 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:44:42.327710    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:45:03.332013 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:45:03.331984    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:46:25.467779 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.467685    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-9f484b96b-brlsg"]
May 25 11:46:25.468408 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.467963    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg" podUID="a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" containerName="manager" containerID="cri-o://9372141261a233c30865802cadf270467aeb64d6bebd8f4382685a428a4e158c" gracePeriod=30
May 25 11:46:25.697735 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.697703    2557 generic.go:358] "Generic (PLEG): container finished" podID="a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" containerID="9372141261a233c30865802cadf270467aeb64d6bebd8f4382685a428a4e158c" exitCode=0
May 25 11:46:25.697910 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.697753    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg" event={"ID":"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec","Type":"ContainerDied","Data":"9372141261a233c30865802cadf270467aeb64d6bebd8f4382685a428a4e158c"}
May 25 11:46:25.722959 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.722893    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:46:25.788101 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.788075    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert\") pod \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") "
May 25 11:46:25.788270 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.788169    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn9wj\" (UniqueName: \"kubernetes.io/projected/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-kube-api-access-gn9wj\") pod \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\" (UID: \"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec\") "
May 25 11:46:25.790365 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.790339    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert" (OuterVolumeSpecName: "cert") pod "a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" (UID: "a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:46:25.790488 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.790376    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-kube-api-access-gn9wj" (OuterVolumeSpecName: "kube-api-access-gn9wj") pod "a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" (UID: "a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec"). InnerVolumeSpecName "kube-api-access-gn9wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:46:25.889093 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.889064    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn9wj\" (UniqueName: \"kubernetes.io/projected/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-kube-api-access-gn9wj\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:46:25.889093 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:25.889090    2557 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec-cert\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:46:26.702275 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:26.702236    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg"
May 25 11:46:26.702275 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:26.702267    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-9f484b96b-brlsg" event={"ID":"a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec","Type":"ContainerDied","Data":"5cbadb15514cec30103e8bffb56e9ffd3ec414c19f342222bd987256a279ad88"}
May 25 11:46:26.702741 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:26.702315    2557 scope.go:117] "RemoveContainer" containerID="9372141261a233c30865802cadf270467aeb64d6bebd8f4382685a428a4e158c"
May 25 11:46:26.723474 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:26.723452    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve/llmisvc-controller-manager-9f484b96b-brlsg"]
May 25 11:46:26.727075 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:26.727054    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve/llmisvc-controller-manager-9f484b96b-brlsg"]
May 25 11:46:26.779485 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:46:26.779465    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" path="/var/lib/kubelet/pods/a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec/volumes"
May 25 11:47:28.794810 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:47:28.794782    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:47:28.797572 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:47:28.797549    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:52:28.819688 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:52:28.819657    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:52:28.826540 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:52:28.826520    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:57:28.846471 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:57:28.846440    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:57:28.852561 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:57:28.852539    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 11:59:20.027222 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:20.027176    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"]
May 25 11:59:20.027774 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:20.027614    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="main" containerID="cri-o://3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614" gracePeriod=30
May 25 11:59:20.027774 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:20.027651    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="tokenizer" containerID="cri-o://adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b" gracePeriod=30
May 25 11:59:20.374739 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:20.374699    2557 generic.go:358] "Generic (PLEG): container finished" podID="a8448e79-b9b8-4483-962f-97763a413189" containerID="3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614" exitCode=0
May 25 11:59:20.374941 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:20.374764    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerDied","Data":"3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614"}
May 25 11:59:21.186799 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.186780    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:59:21.262888 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.262806    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-kserve-provision-location\") pod \"a8448e79-b9b8-4483-962f-97763a413189\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") "
May 25 11:59:21.263016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.262912    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-uds\") pod \"a8448e79-b9b8-4483-962f-97763a413189\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") "
May 25 11:59:21.263016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.262934    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8448e79-b9b8-4483-962f-97763a413189-tls-certs\") pod \"a8448e79-b9b8-4483-962f-97763a413189\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") "
May 25 11:59:21.263016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.262967    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2lmv\" (UniqueName: \"kubernetes.io/projected/a8448e79-b9b8-4483-962f-97763a413189-kube-api-access-g2lmv\") pod \"a8448e79-b9b8-4483-962f-97763a413189\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") "
May 25 11:59:21.263016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.262997    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-cache\") pod \"a8448e79-b9b8-4483-962f-97763a413189\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") "
May 25 11:59:21.263016 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.263017    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-tmp\") pod \"a8448e79-b9b8-4483-962f-97763a413189\" (UID: \"a8448e79-b9b8-4483-962f-97763a413189\") "
May 25 11:59:21.263294 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.263194    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "a8448e79-b9b8-4483-962f-97763a413189" (UID: "a8448e79-b9b8-4483-962f-97763a413189"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:59:21.263355 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.263320    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:59:21.263433 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.263412    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "a8448e79-b9b8-4483-962f-97763a413189" (UID: "a8448e79-b9b8-4483-962f-97763a413189"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:59:21.263500 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.263457    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "a8448e79-b9b8-4483-962f-97763a413189" (UID: "a8448e79-b9b8-4483-962f-97763a413189"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:59:21.263717 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.263692    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "a8448e79-b9b8-4483-962f-97763a413189" (UID: "a8448e79-b9b8-4483-962f-97763a413189"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 11:59:21.265110 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.265090    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8448e79-b9b8-4483-962f-97763a413189-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8448e79-b9b8-4483-962f-97763a413189" (UID: "a8448e79-b9b8-4483-962f-97763a413189"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 11:59:21.265198 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.265157    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8448e79-b9b8-4483-962f-97763a413189-kube-api-access-g2lmv" (OuterVolumeSpecName: "kube-api-access-g2lmv") pod "a8448e79-b9b8-4483-962f-97763a413189" (UID: "a8448e79-b9b8-4483-962f-97763a413189"). InnerVolumeSpecName "kube-api-access-g2lmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 11:59:21.364579 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.364557    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:59:21.364579 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.364579    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:59:21.364705 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.364589    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a8448e79-b9b8-4483-962f-97763a413189-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:59:21.364705 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.364599    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8448e79-b9b8-4483-962f-97763a413189-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:59:21.364705 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.364608    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2lmv\" (UniqueName: \"kubernetes.io/projected/a8448e79-b9b8-4483-962f-97763a413189-kube-api-access-g2lmv\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 11:59:21.379843 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.379817    2557 generic.go:358] "Generic (PLEG): container finished" podID="a8448e79-b9b8-4483-962f-97763a413189" containerID="adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b" exitCode=0
May 25 11:59:21.379950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.379852    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerDied","Data":"adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b"}
May 25 11:59:21.379950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.379911    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk" event={"ID":"a8448e79-b9b8-4483-962f-97763a413189","Type":"ContainerDied","Data":"3437838f6753f101c349a048e9733d5ab099295a10fd53f7e5b68bade065abdb"}
May 25 11:59:21.379950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.379927    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"
May 25 11:59:21.379950 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.379933    2557 scope.go:117] "RemoveContainer" containerID="adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b"
May 25 11:59:21.390214 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.390195    2557 scope.go:117] "RemoveContainer" containerID="3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614"
May 25 11:59:21.397468 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.397455    2557 scope.go:117] "RemoveContainer" containerID="3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4"
May 25 11:59:21.404516 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.404495    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"]
May 25 11:59:21.405352 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.405337    2557 scope.go:117] "RemoveContainer" containerID="adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b"
May 25 11:59:21.405594 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:59:21.405578    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b\": container with ID starting with adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b not found: ID does not exist" containerID="adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b"
May 25 11:59:21.405642 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.405604    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b"} err="failed to get container status \"adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b\": rpc error: code = NotFound desc = could not find container \"adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b\": container with ID starting with adcbeea6dfad31f30186a355a7fef47b4f093eed1e1f4b2eb0b9b7da339d7f4b not found: ID does not exist"
May 25 11:59:21.405642 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.405622    2557 scope.go:117] "RemoveContainer" containerID="3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614"
May 25 11:59:21.405853 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:59:21.405834    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614\": container with ID starting with 3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614 not found: ID does not exist" containerID="3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614"
May 25 11:59:21.405942 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.405861    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614"} err="failed to get container status \"3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614\": rpc error: code = NotFound desc = could not find container \"3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614\": container with ID starting with 3e1c246a80658d02e792122bcc221587e01a04bc11168dfe5e5a1c9bac34b614 not found: ID does not exist"
May 25 11:59:21.405942 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.405897    2557 scope.go:117] "RemoveContainer" containerID="3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4"
May 25 11:59:21.406137 ip-10-0-134-184 kubenswrapper[2557]: E0525 11:59:21.406118    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4\": container with ID starting with 3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4 not found: ID does not exist" containerID="3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4"
May 25 11:59:21.406184 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.406142    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4"} err="failed to get container status \"3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4\": rpc error: code = NotFound desc = could not find container \"3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4\": container with ID starting with 3899d0be45d773e55f0754ae3e07b27a252f5d25cf0759487f0a917176c7d7d4 not found: ID does not exist"
May 25 11:59:21.412932 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:21.411532    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5dc6dddcc4-8hrpk"]
May 25 11:59:22.779563 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:22.779528    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8448e79-b9b8-4483-962f-97763a413189" path="/var/lib/kubelet/pods/a8448e79-b9b8-4483-962f-97763a413189/volumes"
May 25 11:59:27.824652 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.824622    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"]
May 25 11:59:27.825058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825000    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="main"
May 25 11:59:27.825058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825011    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="main"
May 25 11:59:27.825058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825020    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="tokenizer"
May 25 11:59:27.825058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825026    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="tokenizer"
May 25 11:59:27.825058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825037    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" containerName="manager"
May 25 11:59:27.825058 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825043    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" containerName="manager"
May 25 11:59:27.825250 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825064    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="storage-initializer"
May 25 11:59:27.825250 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825069    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="storage-initializer"
May 25 11:59:27.825250 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825130    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0c06c66-cfb8-4d4c-ba7e-31928bbf87ec" containerName="manager"
May 25 11:59:27.825250 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825145    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="main"
May 25 11:59:27.825250 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.825152    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8448e79-b9b8-4483-962f-97763a413189" containerName="tokenizer"
May 25 11:59:27.830149 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.830128    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:27.833225 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.833202    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs\""
May 25 11:59:27.834292 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.834276    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 11:59:27.834379 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.834280    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-05aa9bba-epp-sa-dockercfg-wgf8l\""
May 25 11:59:27.838565 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.838539    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"]
May 25 11:59:27.917529 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.917501    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z98m9\" (UniqueName: \"kubernetes.io/projected/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kube-api-access-z98m9\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:27.917664 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.917533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tls-certs\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:27.917664 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.917553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-uds\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:27.917787 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.917673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-cache\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:27.917787 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.917757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-tmp\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:27.917907 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:27.917799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kserve-provision-location\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019335 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019300    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z98m9\" (UniqueName: \"kubernetes.io/projected/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kube-api-access-z98m9\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019505 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019345    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tls-certs\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019505 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019372    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-uds\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019505 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019445    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-cache\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019505 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019498    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-tmp\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019703 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019534    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kserve-provision-location\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019839 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019818    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-uds\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019982 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-cache\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.019982 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019927    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-tmp\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.020076 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.019985    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kserve-provision-location\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.021828 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.021811    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tls-certs\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.028802 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.028777    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z98m9\" (UniqueName: \"kubernetes.io/projected/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kube-api-access-z98m9\") pod \"llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") " pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.142597 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.142565    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:28.278429 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.278400    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"]
May 25 11:59:28.282004 ip-10-0-134-184 kubenswrapper[2557]: W0525 11:59:28.281977    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3c25d9_3d4a_408e_87cd_7641b518f4b1.slice/crio-e92cba1e536edcdc0499282493a32edbe27a2fe85b4f2657b2d73e5ac15a2049 WatchSource:0}: Error finding container e92cba1e536edcdc0499282493a32edbe27a2fe85b4f2657b2d73e5ac15a2049: Status 404 returned error can't find the container with id e92cba1e536edcdc0499282493a32edbe27a2fe85b4f2657b2d73e5ac15a2049
May 25 11:59:28.284064 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.284044    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 11:59:28.417429 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.417308    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerStarted","Data":"af89a9f2c914179c69dbfbe0e96a80234159c328ed8b4961d760fe8329a8bbd2"}
May 25 11:59:28.417429 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:28.417357    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerStarted","Data":"e92cba1e536edcdc0499282493a32edbe27a2fe85b4f2657b2d73e5ac15a2049"}
May 25 11:59:29.421627 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:29.421580    2557 generic.go:358] "Generic (PLEG): container finished" podID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerID="af89a9f2c914179c69dbfbe0e96a80234159c328ed8b4961d760fe8329a8bbd2" exitCode=0
May 25 11:59:29.422071 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:29.421642    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerDied","Data":"af89a9f2c914179c69dbfbe0e96a80234159c328ed8b4961d760fe8329a8bbd2"}
May 25 11:59:30.427257 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:30.427224    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerStarted","Data":"fbd362f1fc963e4da7f9fee1a69df3f7a4df91f296de1beab27b5c081a5c4b63"}
May 25 11:59:30.427257 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:30.427259    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerStarted","Data":"c7608fcb690a3cda5efafd54a148da61e175a3dce5e097fcaf38996fb3081640"}
May 25 11:59:30.427669 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:30.427352    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:30.456929 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:30.456844    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" podStartSLOduration=3.456825483 podStartE2EDuration="3.456825483s" podCreationTimestamp="2026-05-25 11:59:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 11:59:30.455135368 +0000 UTC m=+2222.277059589" watchObservedRunningTime="2026-05-25 11:59:30.456825483 +0000 UTC m=+2222.278749704"
May 25 11:59:38.142838 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:38.142796    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:38.143313 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:38.142964    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:38.145537 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:38.145516    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 11:59:38.455264 ip-10-0-134-184 kubenswrapper[2557]: I0525 11:59:38.455185    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 12:00:00.462119 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:00:00.462088    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 12:02:28.876787 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:28.876656    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:02:28.884354 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:28.884335    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:02:31.018469 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:31.018433    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"]
May 25 12:02:31.018836 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:31.018752    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="main" containerID="cri-o://c7608fcb690a3cda5efafd54a148da61e175a3dce5e097fcaf38996fb3081640" gracePeriod=30
May 25 12:02:31.018940 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:31.018805    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="tokenizer" containerID="cri-o://fbd362f1fc963e4da7f9fee1a69df3f7a4df91f296de1beab27b5c081a5c4b63" gracePeriod=30
May 25 12:02:32.056022 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.055996    2557 generic.go:358] "Generic (PLEG): container finished" podID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerID="fbd362f1fc963e4da7f9fee1a69df3f7a4df91f296de1beab27b5c081a5c4b63" exitCode=0
May 25 12:02:32.056022 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.056018    2557 generic.go:358] "Generic (PLEG): container finished" podID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerID="c7608fcb690a3cda5efafd54a148da61e175a3dce5e097fcaf38996fb3081640" exitCode=0
May 25 12:02:32.056385 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.056039    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerDied","Data":"fbd362f1fc963e4da7f9fee1a69df3f7a4df91f296de1beab27b5c081a5c4b63"}
May 25 12:02:32.056385 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.056066    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerDied","Data":"c7608fcb690a3cda5efafd54a148da61e175a3dce5e097fcaf38996fb3081640"}
May 25 12:02:32.179255 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.179234    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 12:02:32.367032 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.366989    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-cache\") pod \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") "
May 25 12:02:32.367215 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367052    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-uds\") pod \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") "
May 25 12:02:32.367215 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367087    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-tmp\") pod \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") "
May 25 12:02:32.367215 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367141    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tls-certs\") pod \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") "
May 25 12:02:32.367392 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367216    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kserve-provision-location\") pod \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") "
May 25 12:02:32.367392 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367260    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z98m9\" (UniqueName: \"kubernetes.io/projected/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kube-api-access-z98m9\") pod \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\" (UID: \"0a3c25d9-3d4a-408e-87cd-7641b518f4b1\") "
May 25 12:02:32.367392 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367261    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "0a3c25d9-3d4a-408e-87cd-7641b518f4b1" (UID: "0a3c25d9-3d4a-408e-87cd-7641b518f4b1"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:32.367392 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367314    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "0a3c25d9-3d4a-408e-87cd-7641b518f4b1" (UID: "0a3c25d9-3d4a-408e-87cd-7641b518f4b1"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:32.367603 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367388    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "0a3c25d9-3d4a-408e-87cd-7641b518f4b1" (UID: "0a3c25d9-3d4a-408e-87cd-7641b518f4b1"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:32.367603 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367504    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:02:32.367603 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367518    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:02:32.367603 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367527    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:02:32.367955 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.367933    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "0a3c25d9-3d4a-408e-87cd-7641b518f4b1" (UID: "0a3c25d9-3d4a-408e-87cd-7641b518f4b1"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:02:32.369390 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.369368    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a3c25d9-3d4a-408e-87cd-7641b518f4b1" (UID: "0a3c25d9-3d4a-408e-87cd-7641b518f4b1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:02:32.369507 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.369414    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kube-api-access-z98m9" (OuterVolumeSpecName: "kube-api-access-z98m9") pod "0a3c25d9-3d4a-408e-87cd-7641b518f4b1" (UID: "0a3c25d9-3d4a-408e-87cd-7641b518f4b1"). InnerVolumeSpecName "kube-api-access-z98m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:02:32.468254 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.468203    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:02:32.468254 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.468248    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z98m9\" (UniqueName: \"kubernetes.io/projected/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-kube-api-access-z98m9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:02:32.468254 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:32.468260    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a3c25d9-3d4a-408e-87cd-7641b518f4b1-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:02:33.061070 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.060980    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz" event={"ID":"0a3c25d9-3d4a-408e-87cd-7641b518f4b1","Type":"ContainerDied","Data":"e92cba1e536edcdc0499282493a32edbe27a2fe85b4f2657b2d73e5ac15a2049"}
May 25 12:02:33.061070 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.061030    2557 scope.go:117] "RemoveContainer" containerID="fbd362f1fc963e4da7f9fee1a69df3f7a4df91f296de1beab27b5c081a5c4b63"
May 25 12:02:33.061541 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.061073    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"
May 25 12:02:33.070003 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.069974    2557 scope.go:117] "RemoveContainer" containerID="c7608fcb690a3cda5efafd54a148da61e175a3dce5e097fcaf38996fb3081640"
May 25 12:02:33.078766 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.078740    2557 scope.go:117] "RemoveContainer" containerID="af89a9f2c914179c69dbfbe0e96a80234159c328ed8b4961d760fe8329a8bbd2"
May 25 12:02:33.083979 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.083942    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"]
May 25 12:02:33.090232 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:33.090205    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche9ldjz"]
May 25 12:02:34.779328 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:34.779297    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" path="/var/lib/kubelet/pods/0a3c25d9-3d4a-408e-87cd-7641b518f4b1/volumes"
May 25 12:02:40.882432 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882396    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"]
May 25 12:02:40.882818 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882787    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="tokenizer"
May 25 12:02:40.882895 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882821    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="tokenizer"
May 25 12:02:40.882895 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882839    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="storage-initializer"
May 25 12:02:40.882895 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882846    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="storage-initializer"
May 25 12:02:40.882895 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882853    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="main"
May 25 12:02:40.882895 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882858    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="main"
May 25 12:02:40.883056 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882930    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="main"
May 25 12:02:40.883056 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.882940    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a3c25d9-3d4a-408e-87cd-7641b518f4b1" containerName="tokenizer"
May 25 12:02:40.887971 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.887947    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:40.891135 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.891115    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 12:02:40.892455 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.892433    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-epp-sa-dockercfg-ntcpj\""
May 25 12:02:40.892557 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.892509    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"custom-route-timeout-pd-test-kserve-self-signed-certs\""
May 25 12:02:40.898153 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.898129    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"]
May 25 12:02:40.940359 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.940335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-tmp\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:40.940459 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.940385    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:40.940459 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.940437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aaf1620-7a39-4113-b47c-98637cceac0e-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:40.940583 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.940472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:40.940645 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.940571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-cache\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:40.940645 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:40.940625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsftz\" (UniqueName: \"kubernetes.io/projected/6aaf1620-7a39-4113-b47c-98637cceac0e-kube-api-access-gsftz\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.041480 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041449    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-cache\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.041684 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041494    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gsftz\" (UniqueName: \"kubernetes.io/projected/6aaf1620-7a39-4113-b47c-98637cceac0e-kube-api-access-gsftz\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.041684 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041637    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-tmp\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.041835 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041724    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.041835 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041773    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aaf1620-7a39-4113-b47c-98637cceac0e-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.041835 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041806    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.042016 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.041956    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-cache\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.042140 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.042117    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-uds\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.042208 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.042188    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-tmp\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.042271 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.042247    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-kserve-provision-location\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.044362 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.044344    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aaf1620-7a39-4113-b47c-98637cceac0e-tls-certs\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.051229 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.051196    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsftz\" (UniqueName: \"kubernetes.io/projected/6aaf1620-7a39-4113-b47c-98637cceac0e-kube-api-access-gsftz\") pod \"custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") " pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.199704 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.199631    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:41.331387 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:41.331356    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"]
May 25 12:02:41.334742 ip-10-0-134-184 kubenswrapper[2557]: W0525 12:02:41.334715    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aaf1620_7a39_4113_b47c_98637cceac0e.slice/crio-800fda9de850b3aed44caffd8fb845be30d6d85827c8800b73f014955e5746bc WatchSource:0}: Error finding container 800fda9de850b3aed44caffd8fb845be30d6d85827c8800b73f014955e5746bc: Status 404 returned error can't find the container with id 800fda9de850b3aed44caffd8fb845be30d6d85827c8800b73f014955e5746bc
May 25 12:02:42.098590 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:42.098552    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerStarted","Data":"e1c627f6585e945a658b9e9679cf3d7047273dc3964e53cfed7989437bb47b3e"}
May 25 12:02:42.098991 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:42.098600    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerStarted","Data":"800fda9de850b3aed44caffd8fb845be30d6d85827c8800b73f014955e5746bc"}
May 25 12:02:43.102882 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:43.102833    2557 generic.go:358] "Generic (PLEG): container finished" podID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerID="e1c627f6585e945a658b9e9679cf3d7047273dc3964e53cfed7989437bb47b3e" exitCode=0
May 25 12:02:43.103363 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:43.102917    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerDied","Data":"e1c627f6585e945a658b9e9679cf3d7047273dc3964e53cfed7989437bb47b3e"}
May 25 12:02:44.108132 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:44.108091    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerStarted","Data":"ea441d14915c08dc74a6eb99f11f0f18e4126d3b8fea9f50bd7b89542e6302cc"}
May 25 12:02:44.108132 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:44.108137    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerStarted","Data":"eaab71ed8d56bff7913fe65a88b3a77e7466e4fe3e92d2e01aae817e3dc985da"}
May 25 12:02:44.108544 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:44.108202    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:44.132814 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:44.132772    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" podStartSLOduration=4.132759135 podStartE2EDuration="4.132759135s" podCreationTimestamp="2026-05-25 12:02:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:02:44.130429023 +0000 UTC m=+2415.952353257" watchObservedRunningTime="2026-05-25 12:02:44.132759135 +0000 UTC m=+2415.954683354"
May 25 12:02:51.200435 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:51.200351    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:51.200435 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:51.200399    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:51.202978 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:51.202953    2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:02:52.136766 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:02:52.136738    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:03:13.141520 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:03:13.141486    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:05:19.574655 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:19.574616    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"]
May 25 12:05:19.575171 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:19.574970    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="main" containerID="cri-o://eaab71ed8d56bff7913fe65a88b3a77e7466e4fe3e92d2e01aae817e3dc985da" gracePeriod=30
May 25 12:05:19.575171 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:19.575085    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="tokenizer" containerID="cri-o://ea441d14915c08dc74a6eb99f11f0f18e4126d3b8fea9f50bd7b89542e6302cc" gracePeriod=30
May 25 12:05:20.663479 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.663445    2557 generic.go:358] "Generic (PLEG): container finished" podID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerID="ea441d14915c08dc74a6eb99f11f0f18e4126d3b8fea9f50bd7b89542e6302cc" exitCode=0
May 25 12:05:20.663479 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.663478    2557 generic.go:358] "Generic (PLEG): container finished" podID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerID="eaab71ed8d56bff7913fe65a88b3a77e7466e4fe3e92d2e01aae817e3dc985da" exitCode=0
May 25 12:05:20.663822 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.663509    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerDied","Data":"ea441d14915c08dc74a6eb99f11f0f18e4126d3b8fea9f50bd7b89542e6302cc"}
May 25 12:05:20.663822 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.663540    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerDied","Data":"eaab71ed8d56bff7913fe65a88b3a77e7466e4fe3e92d2e01aae817e3dc985da"}
May 25 12:05:20.746462 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.746442    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:05:20.794407 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794386    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aaf1620-7a39-4113-b47c-98637cceac0e-tls-certs\") pod \"6aaf1620-7a39-4113-b47c-98637cceac0e\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") "
May 25 12:05:20.794543 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794438    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-tmp\") pod \"6aaf1620-7a39-4113-b47c-98637cceac0e\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") "
May 25 12:05:20.794543 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794458    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-uds\") pod \"6aaf1620-7a39-4113-b47c-98637cceac0e\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") "
May 25 12:05:20.794543 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794490    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-kserve-provision-location\") pod \"6aaf1620-7a39-4113-b47c-98637cceac0e\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") "
May 25 12:05:20.794706 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794543    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsftz\" (UniqueName: \"kubernetes.io/projected/6aaf1620-7a39-4113-b47c-98637cceac0e-kube-api-access-gsftz\") pod \"6aaf1620-7a39-4113-b47c-98637cceac0e\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") "
May 25 12:05:20.794706 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794575    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-cache\") pod \"6aaf1620-7a39-4113-b47c-98637cceac0e\" (UID: \"6aaf1620-7a39-4113-b47c-98637cceac0e\") "
May 25 12:05:20.794815 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794783    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-uds" (OuterVolumeSpecName: "tokenizer-uds") pod "6aaf1620-7a39-4113-b47c-98637cceac0e" (UID: "6aaf1620-7a39-4113-b47c-98637cceac0e"). InnerVolumeSpecName "tokenizer-uds". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:05:20.794815 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794796    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-tmp" (OuterVolumeSpecName: "tokenizer-tmp") pod "6aaf1620-7a39-4113-b47c-98637cceac0e" (UID: "6aaf1620-7a39-4113-b47c-98637cceac0e"). InnerVolumeSpecName "tokenizer-tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:05:20.794997 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.794935    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-tmp\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:05:20.795063 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.795000    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-cache" (OuterVolumeSpecName: "tokenizer-cache") pod "6aaf1620-7a39-4113-b47c-98637cceac0e" (UID: "6aaf1620-7a39-4113-b47c-98637cceac0e"). InnerVolumeSpecName "tokenizer-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:05:20.795063 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.795004    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-uds\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-uds\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:05:20.795467 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.795433    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "6aaf1620-7a39-4113-b47c-98637cceac0e" (UID: "6aaf1620-7a39-4113-b47c-98637cceac0e"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:05:20.796626 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.796601    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6aaf1620-7a39-4113-b47c-98637cceac0e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6aaf1620-7a39-4113-b47c-98637cceac0e" (UID: "6aaf1620-7a39-4113-b47c-98637cceac0e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:05:20.796735 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.796680    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aaf1620-7a39-4113-b47c-98637cceac0e-kube-api-access-gsftz" (OuterVolumeSpecName: "kube-api-access-gsftz") pod "6aaf1620-7a39-4113-b47c-98637cceac0e" (UID: "6aaf1620-7a39-4113-b47c-98637cceac0e"). InnerVolumeSpecName "kube-api-access-gsftz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:05:20.895910 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.895853    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsftz\" (UniqueName: \"kubernetes.io/projected/6aaf1620-7a39-4113-b47c-98637cceac0e-kube-api-access-gsftz\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:05:20.895910 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.895915    2557 reconciler_common.go:299] "Volume detached for volume \"tokenizer-cache\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-tokenizer-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:05:20.896113 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.895928    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6aaf1620-7a39-4113-b47c-98637cceac0e-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:05:20.896113 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:20.895937    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6aaf1620-7a39-4113-b47c-98637cceac0e-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:05:21.669257 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.669220    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j" event={"ID":"6aaf1620-7a39-4113-b47c-98637cceac0e","Type":"ContainerDied","Data":"800fda9de850b3aed44caffd8fb845be30d6d85827c8800b73f014955e5746bc"}
May 25 12:05:21.669257 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.669240    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"
May 25 12:05:21.669737 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.669271    2557 scope.go:117] "RemoveContainer" containerID="ea441d14915c08dc74a6eb99f11f0f18e4126d3b8fea9f50bd7b89542e6302cc"
May 25 12:05:21.680015 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.679919    2557 scope.go:117] "RemoveContainer" containerID="eaab71ed8d56bff7913fe65a88b3a77e7466e4fe3e92d2e01aae817e3dc985da"
May 25 12:05:21.687700 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.687681    2557 scope.go:117] "RemoveContainer" containerID="e1c627f6585e945a658b9e9679cf3d7047273dc3964e53cfed7989437bb47b3e"
May 25 12:05:21.696441 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.696423    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"]
May 25 12:05:21.699889 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:21.699856    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-5c6497th5j"]
May 25 12:05:22.780344 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:05:22.780314    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" path="/var/lib/kubelet/pods/6aaf1620-7a39-4113-b47c-98637cceac0e/volumes"
May 25 12:07:26.568319 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568283    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
May 25 12:07:26.568854 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568800    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="main"
May 25 12:07:26.568854 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568819    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="main"
May 25 12:07:26.568854 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568843    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="tokenizer"
May 25 12:07:26.568854 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568851    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="tokenizer"
May 25 12:07:26.569109 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568893    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="storage-initializer"
May 25 12:07:26.569109 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.568903    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="storage-initializer"
May 25 12:07:26.569109 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.569004    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="main"
May 25 12:07:26.569109 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.569018    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="6aaf1620-7a39-4113-b47c-98637cceac0e" containerName="tokenizer"
May 25 12:07:26.572146 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.572126    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.576181 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.576157    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-vcvlw\""
May 25 12:07:26.576294 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.576156    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisvc-model-fb-opt-125m-route-f312f5-cb7fb8cf-dockercfg-zzmgl\""
May 25 12:07:26.576294 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.576224    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs\""
May 25 12:07:26.583143 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.583115    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
May 25 12:07:26.642318 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e201f93c-b629-4fcf-9b1b-5adfb994f350-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.642469 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.642469 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-dshm\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.642469 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-home\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.642579 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642468    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.642579 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45wd9\" (UniqueName: \"kubernetes.io/projected/e201f93c-b629-4fcf-9b1b-5adfb994f350-kube-api-access-45wd9\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.642579 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.642542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.743951 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.743917    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e201f93c-b629-4fcf-9b1b-5adfb994f350-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744111 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.743975    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744111 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744000    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-dshm\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744111 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744041    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-home\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744111 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744079    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744111 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744109    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45wd9\" (UniqueName: \"kubernetes.io/projected/e201f93c-b629-4fcf-9b1b-5adfb994f350-kube-api-access-45wd9\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744328 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744139    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744432 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744405    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-model-cache\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744432 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744426    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-kserve-provision-location\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744577 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744555    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-home\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.744642 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.744619    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-tmp-dir\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.746228 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.746201    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-dshm\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.746414 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.746396    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e201f93c-b629-4fcf-9b1b-5adfb994f350-tls-certs\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.752487 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.752464    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45wd9\" (UniqueName: \"kubernetes.io/projected/e201f93c-b629-4fcf-9b1b-5adfb994f350-kube-api-access-45wd9\") pod \"llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") " pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:26.885996 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:26.885971    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:07:27.030957 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:27.030834    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
May 25 12:07:27.034038 ip-10-0-134-184 kubenswrapper[2557]: W0525 12:07:27.034005    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode201f93c_b629_4fcf_9b1b_5adfb994f350.slice/crio-3eaac2f73fc3b82ac4d51b05ee46ac94cde6f56e69e29c643aeeb8b698cc6e4a WatchSource:0}: Error finding container 3eaac2f73fc3b82ac4d51b05ee46ac94cde6f56e69e29c643aeeb8b698cc6e4a: Status 404 returned error can't find the container with id 3eaac2f73fc3b82ac4d51b05ee46ac94cde6f56e69e29c643aeeb8b698cc6e4a
May 25 12:07:27.036608 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:27.036587    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:07:27.095036 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:27.095004    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"e201f93c-b629-4fcf-9b1b-5adfb994f350","Type":"ContainerStarted","Data":"1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924"}
May 25 12:07:27.095134 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:27.095047    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"e201f93c-b629-4fcf-9b1b-5adfb994f350","Type":"ContainerStarted","Data":"3eaac2f73fc3b82ac4d51b05ee46ac94cde6f56e69e29c643aeeb8b698cc6e4a"}
May 25 12:07:28.903310 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:28.903191    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:07:28.918344 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:28.910802    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:07:32.114244 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:32.114210    2557 generic.go:358] "Generic (PLEG): container finished" podID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerID="1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924" exitCode=0
May 25 12:07:32.114616 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:07:32.114283    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"e201f93c-b629-4fcf-9b1b-5adfb994f350","Type":"ContainerDied","Data":"1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924"}
May 25 12:08:17.286479 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:08:17.286392    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"e201f93c-b629-4fcf-9b1b-5adfb994f350","Type":"ContainerStarted","Data":"71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f"}
May 25 12:08:17.314186 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:08:17.314126    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" podStartSLOduration=6.516191109 podStartE2EDuration="51.314111593s" podCreationTimestamp="2026-05-25 12:07:26 +0000 UTC" firstStartedPulling="2026-05-25 12:07:32.115467239 +0000 UTC m=+2703.937391437" lastFinishedPulling="2026-05-25 12:08:16.913387712 +0000 UTC m=+2748.735311921" observedRunningTime="2026-05-25 12:08:17.312133173 +0000 UTC m=+2749.134057418" watchObservedRunningTime="2026-05-25 12:08:17.314111593 +0000 UTC m=+2749.136035812"
May 25 12:12:28.928066 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:12:28.927962    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:12:28.937101 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:12:28.937082    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:13:16.420605 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:16.420560    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
May 25 12:13:16.421135 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:16.420840    2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerName="main" containerID="cri-o://71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f" gracePeriod=30
May 25 12:13:17.060163 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.060141    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:13:17.135941 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.135920    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-kserve-provision-location\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136075 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.135954    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-tmp-dir\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136075 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.135984    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e201f93c-b629-4fcf-9b1b-5adfb994f350-tls-certs\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136075 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.136013    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-home\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136258 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.136106    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-dshm\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136258 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.136138    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-model-cache\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136258 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.136169    2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45wd9\" (UniqueName: \"kubernetes.io/projected/e201f93c-b629-4fcf-9b1b-5adfb994f350-kube-api-access-45wd9\") pod \"e201f93c-b629-4fcf-9b1b-5adfb994f350\" (UID: \"e201f93c-b629-4fcf-9b1b-5adfb994f350\") "
May 25 12:13:17.136487 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.136421    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-model-cache" (OuterVolumeSpecName: "model-cache") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:17.136738 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.136702    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-home" (OuterVolumeSpecName: "home") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:17.138243 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.138214    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-dshm" (OuterVolumeSpecName: "dshm") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:17.138411 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.138389    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e201f93c-b629-4fcf-9b1b-5adfb994f350-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 12:13:17.138676 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.138658    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e201f93c-b629-4fcf-9b1b-5adfb994f350-kube-api-access-45wd9" (OuterVolumeSpecName: "kube-api-access-45wd9") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "kube-api-access-45wd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 12:13:17.148386 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.148363    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:17.193392 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.193368    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e201f93c-b629-4fcf-9b1b-5adfb994f350" (UID: "e201f93c-b629-4fcf-9b1b-5adfb994f350"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 12:13:17.237132 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237112    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-tmp-dir\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.237132 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237132    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e201f93c-b629-4fcf-9b1b-5adfb994f350-tls-certs\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.237251 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237142    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-home\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.237251 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237150    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-dshm\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.237251 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237158    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-model-cache\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.237251 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237166    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45wd9\" (UniqueName: \"kubernetes.io/projected/e201f93c-b629-4fcf-9b1b-5adfb994f350-kube-api-access-45wd9\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.237251 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.237175    2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e201f93c-b629-4fcf-9b1b-5adfb994f350-kserve-provision-location\") on node \"ip-10-0-134-184.ec2.internal\" DevicePath \"\""
May 25 12:13:17.384090 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.384062    2557 generic.go:358] "Generic (PLEG): container finished" podID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerID="71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f" exitCode=0
May 25 12:13:17.384191 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.384143    2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"
May 25 12:13:17.384191 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.384151    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"e201f93c-b629-4fcf-9b1b-5adfb994f350","Type":"ContainerDied","Data":"71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f"}
May 25 12:13:17.384285 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.384190    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1" event={"ID":"e201f93c-b629-4fcf-9b1b-5adfb994f350","Type":"ContainerDied","Data":"3eaac2f73fc3b82ac4d51b05ee46ac94cde6f56e69e29c643aeeb8b698cc6e4a"}
May 25 12:13:17.384285 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.384209    2557 scope.go:117] "RemoveContainer" containerID="71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f"
May 25 12:13:17.396151 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.396129    2557 scope.go:117] "RemoveContainer" containerID="1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924"
May 25 12:13:17.407532 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.407514    2557 scope.go:117] "RemoveContainer" containerID="71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f"
May 25 12:13:17.407735 ip-10-0-134-184 kubenswrapper[2557]: E0525 12:13:17.407717    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f\": container with ID starting with 71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f not found: ID does not exist" containerID="71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f"
May 25 12:13:17.407784 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.407742    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f"} err="failed to get container status \"71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f\": rpc error: code = NotFound desc = could not find container \"71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f\": container with ID starting with 71a59f69333de3fd983b23fb3c6b3c53bb9fbca2ffd3795250183a87d1ac159f not found: ID does not exist"
May 25 12:13:17.407784 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.407758    2557 scope.go:117] "RemoveContainer" containerID="1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924"
May 25 12:13:17.408044 ip-10-0-134-184 kubenswrapper[2557]: E0525 12:13:17.408025    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924\": container with ID starting with 1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924 not found: ID does not exist" containerID="1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924"
May 25 12:13:17.408112 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.408049    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924"} err="failed to get container status \"1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924\": rpc error: code = NotFound desc = could not find container \"1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924\": container with ID starting with 1b8e872a9ff02f63eb007364060a4069d771dbdd1aa08f4768a3bfc69f726924 not found: ID does not exist"
May 25 12:13:17.412772 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.412750    2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
May 25 12:13:17.415806 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:17.415779    2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1"]
May 25 12:13:18.779712 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:18.779619    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" path="/var/lib/kubelet/pods/e201f93c-b629-4fcf-9b1b-5adfb994f350/volumes"
May 25 12:13:31.643411 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:31.643384    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:32.601980 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:32.601952    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:33.563750 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:33.563725    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:34.490330 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:34.490302    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:35.441274 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:35.441243    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:36.353412 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:36.353383    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:37.278754 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:37.278722    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:38.191462 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:38.191435    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:39.121635 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:39.121604    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:40.047971 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:40.047945    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:40.958750 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:40.958718    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:41.922916 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:41.922889    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:42.911802 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:42.911769    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:43.926677 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:43.926648    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_router-gateway-1-openshift-default-7b9cf87876-zjvkg_1358dc19-024b-4193-98ec-f810f4234879/istio-proxy/0.log"
May 25 12:13:45.037444 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:45.037413    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dsbkj_56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6/discovery/0.log"
May 25 12:13:45.049009 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:45.048989    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b_f803fbfa-e0d0-41e3-9364-55e3dd0a752b/istio-proxy/0.log"
May 25 12:13:45.067738 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:45.067717    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d95d88cb-cq8d7_8496649f-9a5b-43fa-92cb-f139eea5b623/router/0.log"
May 25 12:13:45.861495 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:45.861469    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dsbkj_56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6/discovery/0.log"
May 25 12:13:45.873777 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:45.873743    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b_f803fbfa-e0d0-41e3-9364-55e3dd0a752b/istio-proxy/0.log"
May 25 12:13:45.891626 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:45.891603    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d95d88cb-cq8d7_8496649f-9a5b-43fa-92cb-f139eea5b623/router/0.log"
May 25 12:13:46.657851 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:46.657823    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7587b89b76-tkk4v_c5321d00-68da-4d16-b0bf-71f082bfbbc0/manager/0.log"
May 25 12:13:46.782690 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:46.782667    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-c7fb4c8d5-7lqpv_d2c37b57-4779-4029-9f1b-4f4e89ca72aa/manager/0.log"
May 25 12:13:49.133107 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.133069    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vp7/must-gather-clskb"]
May 25 12:13:49.133612 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.133478    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerName="main"
May 25 12:13:49.133612 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.133493    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerName="main"
May 25 12:13:49.133612 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.133519    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerName="storage-initializer"
May 25 12:13:49.133612 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.133524    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerName="storage-initializer"
May 25 12:13:49.133612 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.133594    2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="e201f93c-b629-4fcf-9b1b-5adfb994f350" containerName="main"
May 25 12:13:49.136675 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.136656    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.141411 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.141391    2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w6vp7\"/\"default-dockercfg-fw7vm\""
May 25 12:13:49.141411 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.141399    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vp7\"/\"kube-root-ca.crt\""
May 25 12:13:49.141572 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.141398    2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w6vp7\"/\"openshift-service-ca.crt\""
May 25 12:13:49.145067 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.145048    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vp7/must-gather-clskb"]
May 25 12:13:49.307733 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.307696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ll6\" (UniqueName: \"kubernetes.io/projected/ae310841-eff7-4dc9-915f-398a03ae73bc-kube-api-access-j9ll6\") pod \"must-gather-clskb\" (UID: \"ae310841-eff7-4dc9-915f-398a03ae73bc\") " pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.307945 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.307750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae310841-eff7-4dc9-915f-398a03ae73bc-must-gather-output\") pod \"must-gather-clskb\" (UID: \"ae310841-eff7-4dc9-915f-398a03ae73bc\") " pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.408767 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.408690    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ll6\" (UniqueName: \"kubernetes.io/projected/ae310841-eff7-4dc9-915f-398a03ae73bc-kube-api-access-j9ll6\") pod \"must-gather-clskb\" (UID: \"ae310841-eff7-4dc9-915f-398a03ae73bc\") " pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.408767 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.408741    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae310841-eff7-4dc9-915f-398a03ae73bc-must-gather-output\") pod \"must-gather-clskb\" (UID: \"ae310841-eff7-4dc9-915f-398a03ae73bc\") " pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.409108 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.409091    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae310841-eff7-4dc9-915f-398a03ae73bc-must-gather-output\") pod \"must-gather-clskb\" (UID: \"ae310841-eff7-4dc9-915f-398a03ae73bc\") " pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.417368 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.417340    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ll6\" (UniqueName: \"kubernetes.io/projected/ae310841-eff7-4dc9-915f-398a03ae73bc-kube-api-access-j9ll6\") pod \"must-gather-clskb\" (UID: \"ae310841-eff7-4dc9-915f-398a03ae73bc\") " pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.447044 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.447022    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vp7/must-gather-clskb"
May 25 12:13:49.577210 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.577184    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vp7/must-gather-clskb"]
May 25 12:13:49.579802 ip-10-0-134-184 kubenswrapper[2557]: W0525 12:13:49.579773    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae310841_eff7_4dc9_915f_398a03ae73bc.slice/crio-1f674ec4245d909e60ed785b21a884bbe2521b9126694b5cd9bec2a2d8687752 WatchSource:0}: Error finding container 1f674ec4245d909e60ed785b21a884bbe2521b9126694b5cd9bec2a2d8687752: Status 404 returned error can't find the container with id 1f674ec4245d909e60ed785b21a884bbe2521b9126694b5cd9bec2a2d8687752
May 25 12:13:49.581395 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:49.581377    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 12:13:50.515147 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:50.515042    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/must-gather-clskb" event={"ID":"ae310841-eff7-4dc9-915f-398a03ae73bc","Type":"ContainerStarted","Data":"9cec9d2f4dfd74811924aed259d1813ad6e2e0d454878dc396863f3e11742d0e"}
May 25 12:13:50.515147 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:50.515090    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/must-gather-clskb" event={"ID":"ae310841-eff7-4dc9-915f-398a03ae73bc","Type":"ContainerStarted","Data":"d282960a00af4a6588241b6fd79b126f82098abf8b44855f3d638385d3133e55"}
May 25 12:13:50.515147 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:50.515110    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/must-gather-clskb" event={"ID":"ae310841-eff7-4dc9-915f-398a03ae73bc","Type":"ContainerStarted","Data":"1f674ec4245d909e60ed785b21a884bbe2521b9126694b5cd9bec2a2d8687752"}
May 25 12:13:50.534312 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:50.534250    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w6vp7/must-gather-clskb" podStartSLOduration=0.916438675 podStartE2EDuration="1.534231017s" podCreationTimestamp="2026-05-25 12:13:49 +0000 UTC" firstStartedPulling="2026-05-25 12:13:49.581533732 +0000 UTC m=+3081.403457930" lastFinishedPulling="2026-05-25 12:13:50.19932607 +0000 UTC m=+3082.021250272" observedRunningTime="2026-05-25 12:13:50.532176586 +0000 UTC m=+3082.354100807" watchObservedRunningTime="2026-05-25 12:13:50.534231017 +0000 UTC m=+3082.356155239"
May 25 12:13:51.679606 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:51.679577    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fddpw_9d9ff3f0-2085-4fbf-a1b9-42ca8df41c69/global-pull-secret-syncer/0.log"
May 25 12:13:51.817809 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:51.817777    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pmf9s_f5a2a926-3620-4ce1-94c1-02706cc7b79b/konnectivity-agent/0.log"
May 25 12:13:51.881859 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:51.881832    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-184.ec2.internal_aced91851613fb93e68cce78a526b35c/haproxy/0.log"
May 25 12:13:55.748661 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:55.748550    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7587b89b76-tkk4v_c5321d00-68da-4d16-b0bf-71f082bfbbc0/manager/0.log"
May 25 12:13:55.951504 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:55.951454    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-c7fb4c8d5-7lqpv_d2c37b57-4779-4029-9f1b-4f4e89ca72aa/manager/0.log"
May 25 12:13:56.913724 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:56.913692    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/alertmanager/0.log"
May 25 12:13:56.936666 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:56.936624    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/config-reloader/0.log"
May 25 12:13:56.971037 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:56.971010    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/kube-rbac-proxy-web/0.log"
May 25 12:13:57.048230 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.048195    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/kube-rbac-proxy/0.log"
May 25 12:13:57.084769 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.084725    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/kube-rbac-proxy-metric/0.log"
May 25 12:13:57.110735 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.110708    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/prom-label-proxy/0.log"
May 25 12:13:57.139759 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.139735    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c6febc8e-51cf-4b27-8604-cd7d4404b57f/init-config-reloader/0.log"
May 25 12:13:57.404007 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.403970    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgxn4_0be1a341-2fe9-44eb-85d1-dc0774e042d4/node-exporter/0.log"
May 25 12:13:57.429597 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.429560    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgxn4_0be1a341-2fe9-44eb-85d1-dc0774e042d4/kube-rbac-proxy/0.log"
May 25 12:13:57.450550 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.450521    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fgxn4_0be1a341-2fe9-44eb-85d1-dc0774e042d4/init-textfile/0.log"
May 25 12:13:57.804375 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.804291    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-nh495_16837a20-c4f0-4824-911e-77a68cbeafe7/prometheus-operator/0.log"
May 25 12:13:57.835621 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.835590    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-nh495_16837a20-c4f0-4824-911e-77a68cbeafe7/kube-rbac-proxy/0.log"
May 25 12:13:57.868452 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.868421    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-d5nxv_24b6a278-b716-4838-ac56-817e4ecdb035/prometheus-operator-admission-webhook/0.log"
May 25 12:13:57.902329 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.902303    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-569dbb96b-8n9gm_f7f899f2-7137-4ad4-833e-0785f348e226/telemeter-client/0.log"
May 25 12:13:57.930049 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.930015    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-569dbb96b-8n9gm_f7f899f2-7137-4ad4-833e-0785f348e226/reload/0.log"
May 25 12:13:57.962288 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:57.962257    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-569dbb96b-8n9gm_f7f899f2-7137-4ad4-833e-0785f348e226/kube-rbac-proxy/0.log"
May 25 12:13:59.893295 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:59.893263    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/2.log"
May 25 12:13:59.898850 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:13:59.898826    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-8wkwr_abd307cd-ea8e-45ff-b4b3-6a2dd0c798fb/console-operator/3.log"
May 25 12:14:00.353966 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.353939    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dbc4ffb98-7krqt_339ccd60-a9d4-4f64-b795-e8efb077aeef/console/0.log"
May 25 12:14:00.401380 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.401347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-v2pgb_35556c2e-3ede-4cc1-a602-e359800dc671/download-server/0.log"
May 25 12:14:00.589402 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.589365    2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"]
May 25 12:14:00.596571 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.596525    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.622801 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.622767    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"]
May 25 12:14:00.726437 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.726400    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-sys\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.726624 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.726449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-lib-modules\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.726624 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.726491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-proc\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.726624 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.726550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhd4w\" (UniqueName: \"kubernetes.io/projected/6954c886-2378-4da8-8025-9f6fac6404e7-kube-api-access-jhd4w\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.726796 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.726660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-podres\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.827882 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.827832    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-podres\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.827899    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-sys\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.827918    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-lib-modules\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.827940    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-proc\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.827975    2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhd4w\" (UniqueName: \"kubernetes.io/projected/6954c886-2378-4da8-8025-9f6fac6404e7-kube-api-access-jhd4w\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.827998    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-podres\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.828023    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-sys\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828057 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.828050    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-proc\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.828305 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.828072    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6954c886-2378-4da8-8025-9f6fac6404e7-lib-modules\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.837860 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.837835    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhd4w\" (UniqueName: \"kubernetes.io/projected/6954c886-2378-4da8-8025-9f6fac6404e7-kube-api-access-jhd4w\") pod \"perf-node-gather-daemonset-qkq8f\" (UID: \"6954c886-2378-4da8-8025-9f6fac6404e7\") " pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:00.908433 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:00.908351    2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:01.068441 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.068415    2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"]
May 25 12:14:01.071240 ip-10-0-134-184 kubenswrapper[2557]: W0525 12:14:01.071202    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6954c886_2378_4da8_8025_9f6fac6404e7.slice/crio-5e22dbb6ede3ffc31a60003f15fe083b8357247e00f333a46f5c3ad4c9f295f4 WatchSource:0}: Error finding container 5e22dbb6ede3ffc31a60003f15fe083b8357247e00f333a46f5c3ad4c9f295f4: Status 404 returned error can't find the container with id 5e22dbb6ede3ffc31a60003f15fe083b8357247e00f333a46f5c3ad4c9f295f4
May 25 12:14:01.571076 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.570991    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f" event={"ID":"6954c886-2378-4da8-8025-9f6fac6404e7","Type":"ContainerStarted","Data":"5aacebabda6777de429928bd3519627af53bd3ea49e1e39804132a0bae8a9473"}
May 25 12:14:01.571076 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.571031    2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f" event={"ID":"6954c886-2378-4da8-8025-9f6fac6404e7","Type":"ContainerStarted","Data":"5e22dbb6ede3ffc31a60003f15fe083b8357247e00f333a46f5c3ad4c9f295f4"}
May 25 12:14:01.571076 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.571056    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:01.591115 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.591046    2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f" podStartSLOduration=1.5910249969999999 podStartE2EDuration="1.591024997s" podCreationTimestamp="2026-05-25 12:14:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 12:14:01.588759625 +0000 UTC m=+3093.410683868" watchObservedRunningTime="2026-05-25 12:14:01.591024997 +0000 UTC m=+3093.412949219"
May 25 12:14:01.685748 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.685705    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qxpvv_5e96b221-0e15-482c-9090-21eb29d5ae79/dns/0.log"
May 25 12:14:01.706077 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.706049    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qxpvv_5e96b221-0e15-482c-9090-21eb29d5ae79/kube-rbac-proxy/0.log"
May 25 12:14:01.805964 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:01.805934    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q2nlv_848a9419-e49d-4daa-8898-1874ba85ec8d/dns-node-resolver/0.log"
May 25 12:14:02.330019 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:02.329992    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9bdd9b9d6-7pkc8_7b665160-cf37-40a3-97c4-3c1777912805/registry/0.log"
May 25 12:14:02.374450 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:02.374413    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4mq75_931b2d21-9dcd-4749-82e8-2ab1c0ac9179/node-ca/0.log"
May 25 12:14:03.253922 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:03.253886    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-dsbkj_56dcb5d1-7da4-40a3-bd9e-8bcc8121eae6/discovery/0.log"
May 25 12:14:03.275639 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:03.275608    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-default-849cdfbf5f-xmb5b_f803fbfa-e0d0-41e3-9364-55e3dd0a752b/istio-proxy/0.log"
May 25 12:14:03.299238 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:03.299210    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65d95d88cb-cq8d7_8496649f-9a5b-43fa-92cb-f139eea5b623/router/0.log"
May 25 12:14:03.922320 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:03.922285    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lsz24_f5d855d2-7bec-4015-9d26-2057cf2e20b4/serve-healthcheck-canary/0.log"
May 25 12:14:04.415842 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:04.415819    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-76lff_e046b498-6231-4380-b208-f17220f44d10/kube-rbac-proxy/0.log"
May 25 12:14:04.433855 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:04.433835    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-76lff_e046b498-6231-4380-b208-f17220f44d10/exporter/0.log"
May 25 12:14:04.453655 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:04.453634    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-76lff_e046b498-6231-4380-b208-f17220f44d10/extractor/0.log"
May 25 12:14:07.211813 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:07.211777    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-vcdcn_59466856-eac4-4cf6-beda-68b7654a9e2e/openshift-lws-operator/0.log"
May 25 12:14:07.585930 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:07.585902    2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w6vp7/perf-node-gather-daemonset-qkq8f"
May 25 12:14:07.736308 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:07.736276    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-645dd747db-2d7zv_6798c56b-a57b-43d3-b4a5-d9606c853ebe/manager/0.log"
May 25 12:14:13.088645 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:13.088607    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-thxws_6da01c3c-835e-45a6-a78e-4c7181374b53/kube-storage-version-migrator-operator/1.log"
May 25 12:14:13.090081 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:13.090058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-thxws_6da01c3c-835e-45a6-a78e-4c7181374b53/kube-storage-version-migrator-operator/0.log"
May 25 12:14:14.020794 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.020767    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6kjrw_cb489b71-97f3-4f5f-85f6-e6622b92ed23/kube-multus/0.log"
May 25 12:14:14.042823 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.042801    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/kube-multus-additional-cni-plugins/0.log"
May 25 12:14:14.064885 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.064846    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/egress-router-binary-copy/0.log"
May 25 12:14:14.084116 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.084086    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/cni-plugins/0.log"
May 25 12:14:14.106436 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.106419    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/bond-cni-plugin/0.log"
May 25 12:14:14.131590 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.131574    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/routeoverride-cni/0.log"
May 25 12:14:14.150733 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.150717    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/whereabouts-cni-bincopy/0.log"
May 25 12:14:14.172941 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.172923    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4hvk5_5ae70663-4e21-4a19-9101-e418f652c867/whereabouts-cni/0.log"
May 25 12:14:14.554198 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.554157    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-64mv4_75775f92-a777-4a28-ac20-efe3d188bacc/network-metrics-daemon/0.log"
May 25 12:14:14.574336 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:14.574301    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-64mv4_75775f92-a777-4a28-ac20-efe3d188bacc/kube-rbac-proxy/0.log"
May 25 12:14:15.792748 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.792713    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/ovn-controller/0.log"
May 25 12:14:15.829002 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.828979    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/ovn-acl-logging/0.log"
May 25 12:14:15.848126 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.848106    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/kube-rbac-proxy-node/0.log"
May 25 12:14:15.867363 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.867341    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/kube-rbac-proxy-ovn-metrics/0.log"
May 25 12:14:15.885553 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.885530    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/northd/0.log"
May 25 12:14:15.905822 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.905792    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/nbdb/0.log"
May 25 12:14:15.926996 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:15.926979    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/sbdb/0.log"
May 25 12:14:16.042844 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:16.042784    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8s2l_e17079bf-1c65-4f8e-9aa7-378915e6f0b3/ovnkube-controller/0.log"
May 25 12:14:17.472524 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:17.472486    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-2f94r_3b8d7886-274d-4745-ba8b-c0440e84b79c/check-endpoints/0.log"
May 25 12:14:17.570796 ip-10-0-134-184 kubenswrapper[2557]: I0525 12:14:17.570711    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wv9l4_1a46f2e6-4f9c-4e7c-8f1b-cb9d7498bcdf/network-check-target-container/0.log"