Sep 08 13:14:27.398650 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 13:14:27.398662 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 13:14:27.398671 ip-10-0-141-177 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 13:14:27.398976 ip-10-0-141-177 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 13:14:37.484161 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 13:14:37.484182 ip-10-0-141-177 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot fbc0351cfdb741b1abe3ae4af7cf0a7b --
Sep 08 13:16:33.896833 ip-10-0-141-177 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 13:16:34.321039 ip-10-0-141-177 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:16:34.321039 ip-10-0-141-177 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 13:16:34.321039 ip-10-0-141-177 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:16:34.321039 ip-10-0-141-177 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 13:16:34.321039 ip-10-0-141-177 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 13:16:34.321982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.321899    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 13:16:34.324617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324602    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:16:34.324617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324616    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324619    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324622    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324626    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324629    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324632    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324634    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324637    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324640    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324643    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324645    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324650    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324653    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324657    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324660    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324662    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324665    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324668    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324671    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324673    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:16:34.324676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324676    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324679    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324682    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324685    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324688    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324691    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324694    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324697    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324699    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324702    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324705    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324707    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324710    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324712    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324715    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324717    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324720    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324722    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324725    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324727    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:16:34.325151 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324730    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324733    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324735    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324739    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324742    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324744    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324746    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324749    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324752    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324754    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324756    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324759    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324762    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324764    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324768    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324770    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324773    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324776    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324778    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324781    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:16:34.325659 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324783    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324786    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324788    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324791    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324793    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324796    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324798    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324801    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324805    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324808    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324815    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324818    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324820    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324823    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324825    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324828    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324830    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324833    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324835    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:16:34.326144 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324838    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324840    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324843    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324845    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324847    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324851    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324853    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324856    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324859    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324863    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324866    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324868    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324871    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324873    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324877    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324880    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324883    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324886    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.324889    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325587    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:16:34.326617 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325595    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325598    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325601    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325606    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325611    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325615    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325618    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325621    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325624    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325628    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325631    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325634    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325637    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325640    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325643    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325645    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325648    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325651    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325653    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325657    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:16:34.327092 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325660    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325663    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325666    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325668    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325671    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325674    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325677    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325680    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325684    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325687    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325689    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325692    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325694    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325697    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325700    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325703    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325705    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325708    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325711    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325714    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:16:34.327691 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325716    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325719    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325723    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325725    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325728    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325731    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325733    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325736    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325738    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325741    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325744    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325747    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325749    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325752    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325754    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325757    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325759    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325762    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325764    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325767    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:16:34.328185 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325770    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325772    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325775    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325779    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325782    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325785    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325789    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325792    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325797    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325800    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325803    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325805    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325808    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325811    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325813    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325816    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325818    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325821    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325824    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325827    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:16:34.328687 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325829    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325832    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325835    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325838    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325841    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325844    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325847    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325849    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325852    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325855    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325857    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325860    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325862    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325865    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325867    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325870    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325873    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.325875    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326277    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:16:34.329205 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326282    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326285    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326288    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326292    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326295    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326298    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326301    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326303    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326306    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326309    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326311    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326314    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326317    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326319    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326322    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326324    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326327    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326330    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326332    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326335    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:16:34.329677 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326338    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326341    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326343    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326346    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326348    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326351    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326353    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326356    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326358    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326361    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326364    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326366    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326369    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326372    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326374    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326379    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326383    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326386    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326389    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:16:34.330161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326391    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326394    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326397    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326399    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326402    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326404    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326406    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326409    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326412    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326415    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326418    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326420    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326423    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326425    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326428    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326430    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326432    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326435    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326438    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326440    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:16:34.330671 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326443    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326445    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326448    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326450    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326453    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326456    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326458    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326461    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326463    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326466    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326469    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326471    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326474    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326476    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326479    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326481    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326484    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326486    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326490    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:16:34.331155 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326494    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326497    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326501    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326504    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326507    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326510    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326513    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326515    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326534    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326537    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326540    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326544    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326548    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326551    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326553    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326556    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326558    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326564    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326566    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.326569    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:16:34.331676 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326648    2557 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326686    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326692    2557 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326697    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326702    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326705    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326711    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326715    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326718    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326721    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326724    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326727    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326731    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326734    2557 flags.go:64] FLAG: --cgroup-root=""
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326738    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326741    2557 flags.go:64] FLAG: --client-ca-file=""
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326744    2557 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326747    2557 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326751    2557 flags.go:64] FLAG: --cluster-domain=""
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326754    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326757    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326761    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326764    2557 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326768    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 13:16:34.332167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326771    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326774    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326777    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326780    2557 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326783    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326788    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326791    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326794    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326798    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326801    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326804    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326807    2557 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326810    2557 flags.go:64] FLAG: --enable-server="true"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326813    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326817    2557 flags.go:64] FLAG: --event-burst="100"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326820    2557 flags.go:64] FLAG: --event-qps="50"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326823    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326826    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326829    2557 flags.go:64] FLAG: --eviction-hard=""
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326833    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326836    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326839    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326842    2557 flags.go:64] FLAG: --eviction-soft=""
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326845    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326847    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 13:16:34.332752 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326850    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326853    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326856    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326859    2557 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326861    2557 flags.go:64] FLAG: --feature-gates=""
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326865    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326868    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326871    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326874    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326877    2557 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326880    2557 flags.go:64] FLAG: --help="false"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326883    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326887    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326890    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326893    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326896    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326900    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326902    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326905    2557 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326909    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326911    2557 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326915    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326918    2557 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326921    2557 flags.go:64] FLAG: --kube-reserved=""
Sep 08 13:16:34.333390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326926    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326928    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326931    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326934    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326937    2557 flags.go:64] FLAG: --lock-file=""
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326940    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326943    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326946    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326951    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326954    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326957    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326960    2557 flags.go:64] FLAG: --logging-format="text"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326963    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326966    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326969    2557 flags.go:64] FLAG: --manifest-url=""
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326972    2557 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326976    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326979    2557 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326983    2557 flags.go:64] FLAG: --max-pods="110"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326986    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326990    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326994    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326997    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.326999    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327002    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 13:16:34.334010 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327005    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327012    2557 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327015    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327018    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327021    2557 flags.go:64] FLAG: --pod-cidr=""
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327024    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327030    2557 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327032    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327037    2557 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327040    2557 flags.go:64] FLAG: --port="10250"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327043    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327046    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041f9909ae5b6b6f9"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327049    2557 flags.go:64] FLAG: --qos-reserved=""
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327052    2557 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327055    2557 flags.go:64] FLAG: --register-node="true"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327058    2557 flags.go:64] FLAG: --register-with-taints=""
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327061    2557 flags.go:64] FLAG: --registry-burst="10"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327064    2557 flags.go:64] FLAG: --registry-qps="5"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327067    2557 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327070    2557 flags.go:64] FLAG: --reserved-memory=""
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327073    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327076    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327080    2557 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327083    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327085    2557 flags.go:64] FLAG: --runonce="false"
Sep 08 13:16:34.334635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327088    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327091    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327095    2557 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327098    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327101    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327104    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327107    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327110    2557 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327113    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327116    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327118    2557 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327121    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327124    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327128    2557 flags.go:64] FLAG: --system-cgroups=""
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327131    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327137    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327140    2557 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327143    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327147    2557 flags.go:64] FLAG: --tls-min-version=""
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327150    2557 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327153    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327156    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327159    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327162    2557 flags.go:64] FLAG: --v="2"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327165    2557 flags.go:64] FLAG: --version="false"
Sep 08 13:16:34.335541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327169    2557 flags.go:64] FLAG: --vmodule=""
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327172    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.327175    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327283    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327287    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327290    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327293    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327296    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327299    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327303    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327305    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327308    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327311    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327313    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327316    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327318    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327321    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327323    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327325    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327328    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:16:34.336210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327331    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327334    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327337    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327340    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327342    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327345    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327348    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327350    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327353    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327356    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327358    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327361    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327363    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327366    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327368    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327371    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327373    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327376    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327379    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327381    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:16:34.336713 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327384    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327387    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327390    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327393    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327395    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327398    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327401    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327403    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327406    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327408    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327411    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327414    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327416    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327419    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327423    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327426    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327428    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327431    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327433    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327436    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:16:34.337211 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327438    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327441    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327443    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327446    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327449    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327451    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327454    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327456    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327459    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327461    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327464    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327467    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327469    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327473    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327476    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327480    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327483    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327486    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327489    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327491    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:16:34.337742 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327494    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327496    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327500    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327504    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327507    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327509    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327515    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327531    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327534    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327537    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327540    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327543    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327546    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327549    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327552    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327554    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327557    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327561    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327564    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:16:34.338222 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327567    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327570    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.327572    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.328217    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.336369    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.336385    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.336404    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.336414    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336469    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336473    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336477    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336481    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336484    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336487    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336490    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:16:34.338709 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336492    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336497    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336501    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336504    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336506    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336509    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336512    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336514    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336517    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336536    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336540    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336542    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336545    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336548    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336550    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336559    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336562    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336565    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336568    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336570    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:16:34.339109 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336573    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336576    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336579    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336582    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336585    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336587    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336590    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336592    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336595    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336598    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336600    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336603    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336606    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336609    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336611    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336614    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336616    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336619    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336621    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336624    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:16:34.339684 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336627    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336630    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336632    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336635    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336639    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336642    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336646    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336648    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336651    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336654    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336657    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336660    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336664    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336667    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336671    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336674    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336678    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336681    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336684    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:16:34.340179 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336686    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336689    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336692    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336695    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336697    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336700    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336702    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336705    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336707    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336710    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336713    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336715    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336718    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336721    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336724    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336727    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336730    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336732    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336735    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:16:34.340655 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336737    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336739    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336742    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336744    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336747    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336750    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336752    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336755    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336758    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336760    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336763    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336766    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336768    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336771    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.336775    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:16:34.341105 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336893    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336898    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336901    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336904    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336907    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336910    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336913    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336915    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336918    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336921    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336924    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336926    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336930    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336932    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336935    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336937    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336940    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336943    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336945    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336948    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 13:16:34.341477 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336950    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336953    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336955    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336958    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336961    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336964    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336967    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336969    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336972    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336979    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336982    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336984    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336987    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336989    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336992    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336995    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.336997    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337000    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337002    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337005    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 13:16:34.341968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337007    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337010    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337012    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337015    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337017    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337020    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337023    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337026    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337031    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337033    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337036    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337039    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337042    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337046    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337049    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337052    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337055    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337058    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337061    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 13:16:34.342447 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337064    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337066    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337068    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337071    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337073    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337076    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337078    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337081    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337083    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337086    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337088    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337091    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337093    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337096    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337098    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337101    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337104    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337106    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337108    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 13:16:34.342924 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337120    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337123    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337127    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337130    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337133    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337136    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337139    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337142    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337145    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337148    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337151    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337153    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337156    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337158    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337161    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337164    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337166    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337169    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337171    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 13:16:34.343383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337174    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:34.337176    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.337181    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.337286    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.340626    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.341707    2557 server.go:1019] "Starting client certificate rotation"
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.341801    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 13:16:34.343916 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.341838    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 13:16:34.344304 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.344291    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 13:16:34.345404 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.345388    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 13:16:34.354072 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.354055    2557 log.go:25] "Validated CRI v1 runtime API"
Sep 08 13:16:34.356672 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.356659    2557 log.go:25] "Validated CRI v1 image API"
Sep 08 13:16:34.357506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.357484    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 13:16:34.361695 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.361672    2557 fs.go:135] Filesystem UUIDs: map[63a2d856-6411-4171-965b-365ef27fc30a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d179a4c2-71fd-49c2-82dd-34c5a976b5f8:/dev/nvme0n1p4]
Sep 08 13:16:34.361766 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.361693    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 13:16:34.367648 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.367533    2557 manager.go:216] Machine: {Timestamp:2026-09-08 13:16:34.366188643 +0000 UTC m=+0.350389430 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103269 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2275731371ecc6e75b8f281480eda4 SystemUUID:ec227573-1371-ecc6-e75b-8f281480eda4 BootID:fbc0351c-fdb7-41b1-abe3-ae4af7cf0a7b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6f:90:b2:3c:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6f:90:b2:3c:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:77:0d:fc:9d:db Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 13:16:34.367648 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.367638    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 13:16:34.367778 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.367712    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 13:16:34.370430 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.370407    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 13:16:34.370580 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.370432    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 13:16:34.371245 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.371235    2557 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 13:16:34.371279 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.371246    2557 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 13:16:34.371279 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.371254    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 13:16:34.371674 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.371659    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 13:16:34.371863 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.371849    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 13:16:34.372946 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.372936    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 13:16:34.376354 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376342    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 13:16:34.376461 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376451    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 13:16:34.376510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376480    2557 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 13:16:34.376510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376490    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 13:16:34.376510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376507    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 13:16:34.376664 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376516    2557 kubelet.go:398] "Adding apiserver pod source"
Sep 08 13:16:34.376664 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376543    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 13:16:34.376914 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376897    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 13:16:34.376979 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.376932    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 13:16:34.381505 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.381488    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 13:16:34.383511 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383493    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 13:16:34.383608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383549    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 13:16:34.383771 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383757    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 13:16:34.383834 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383776    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 13:16:34.383834 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383785    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 13:16:34.383834 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383793    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 13:16:34.383834 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383806    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 13:16:34.383834 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.383814    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 13:16:34.384245 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.384235    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 13:16:34.384298 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.384247    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 13:16:34.384298 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.384258    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 13:16:34.384298 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.384266    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 13:16:34.384298 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.384279    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 13:16:34.384298 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.384291    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 13:16:34.385214 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.385201    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 13:16:34.385214 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.385215    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 13:16:34.387098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.387077    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 13:16:34.387180 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.387150    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 13:16:34.387242 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.387150    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 13:16:34.389088 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.389072    2557 server.go:1268] "Started kubelet"
Sep 08 13:16:34.389168 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.389138    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 13:16:34.389222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.389165    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 13:16:34.389264 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.389249    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 13:16:34.389964 ip-10-0-141-177 systemd[1]: Started Kubernetes Kubelet.
Sep 08 13:16:34.390222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.390205    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 13:16:34.391405 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.391392    2557 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 13:16:34.396805 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.396788    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8pr7c"
Sep 08 13:16:34.398213 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.398187    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 13:16:34.398310 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.398212    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 13:16:34.398538 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.398500    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.398796 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.398777    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 13:16:34.398863 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.398801    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 13:16:34.398961 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.398943    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 13:16:34.399110 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.399093    2557 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 13:16:34.399110 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.399107    2557 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 13:16:34.399329 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.399299    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 13:16:34.399847 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.399831    2557 factory.go:55] Registering systemd factory
Sep 08 13:16:34.399847 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.399847    2557 factory.go:223] Registration of the systemd container factory successfully
Sep 08 13:16:34.400105 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.400092    2557 factory.go:153] Registering CRI-O factory
Sep 08 13:16:34.400147 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.400110    2557 factory.go:223] Registration of the crio container factory successfully
Sep 08 13:16:34.400177 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.400156    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 13:16:34.400177 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.400172    2557 factory.go:103] Registering Raw factory
Sep 08 13:16:34.400232 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.400186    2557 manager.go:1196] Started watching for new ooms in manager
Sep 08 13:16:34.400562 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.400546    2557 manager.go:349] Starting recovery of all containers
Sep 08 13:16:34.404959 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.404917    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 13:16:34.405087 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.405064    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 13:16:34.405558 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.405514    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8pr7c"
Sep 08 13:16:34.406071 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.404891    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18d35adfd4b4d49a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-09-08 13:16:34.389046426 +0000 UTC m=+0.373247214,LastTimestamp:2026-09-08 13:16:34.389046426 +0000 UTC m=+0.373247214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}"
Sep 08 13:16:34.407106 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.407073    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 13:16:34.413319 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.413301    2557 manager.go:354] Recovery completed
Sep 08 13:16:34.417761 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.417749    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.419564 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.419548    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.419614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.419578    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.419614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.419592    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.420094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420077    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 13:16:34.420094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420089    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 13:16:34.420222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420102    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.420222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420106    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 13:16:34.420933 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420915    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.420997 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420946    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.420997 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.420961    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.422183 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.422169    2557 policy_none.go:49] "None policy: Start"
Sep 08 13:16:34.422238 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.422188    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 13:16:34.422238 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.422200    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 13:16:34.422474 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.421476    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18d35adfd6867ec8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-177.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-09-08 13:16:34.419564232 +0000 UTC m=+0.403765020,LastTimestamp:2026-09-08 13:16:34.419564232 +0000 UTC m=+0.403765020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}"
Sep 08 13:16:34.424441 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.424344    2557 policy_none.go:47] "Start"
Sep 08 13:16:34.451097 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451082    2557 manager.go:337] "Starting Device Plugin manager"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.451115    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451128    2557 server.go:87] "Starting device plugin registration server"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451400    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451413    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451514    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451612    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.451622    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.452493    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 13:16:34.476670 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.452557    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.490232 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.490206    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 13:16:34.490335 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.490264    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 13:16:34.490335 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.490289    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 13:16:34.490439 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.490375    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 13:16:34.492925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.492900    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:16:34.552168 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.552132    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.553103 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.553085    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.553216 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.553126    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.553216 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.553142    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.553216 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.553171    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.565908 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.565890    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.566002 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.565911    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-177.ec2.internal\": node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.590743 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.590679    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"]
Sep 08 13:16:34.590743 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.590740    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.591565 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.591550    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.591637 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.591578    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.591637 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.591593    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.593829 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.593817    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.593953 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.593937    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.593993 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.593967    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.594479 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.594458    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.594595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.594489    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.594595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.594502    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.594595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.594460    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.594595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.594563    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.594595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.594575    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.596742 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.596727    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.596830 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.596755    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 13:16:34.598198 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.598185    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 13:16:34.598289 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.598210    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 13:16:34.598289 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.598224    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID"
Sep 08 13:16:34.600701 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.600682    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.600701 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.600679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96d81d290f44eaca1c0dbdec93010d30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"96d81d290f44eaca1c0dbdec93010d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.600812 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.600722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96d81d290f44eaca1c0dbdec93010d30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"96d81d290f44eaca1c0dbdec93010d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.600812 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.600739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdf29c3cd2e403aedd9a5d1cadaf161a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"fdf29c3cd2e403aedd9a5d1cadaf161a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.623190 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.623167    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.627534 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.627502    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.700969 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.700946    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.701073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.700978    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96d81d290f44eaca1c0dbdec93010d30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"96d81d290f44eaca1c0dbdec93010d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.701073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.701002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96d81d290f44eaca1c0dbdec93010d30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"96d81d290f44eaca1c0dbdec93010d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.701073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.701018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdf29c3cd2e403aedd9a5d1cadaf161a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"fdf29c3cd2e403aedd9a5d1cadaf161a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.701073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.701045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fdf29c3cd2e403aedd9a5d1cadaf161a-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"fdf29c3cd2e403aedd9a5d1cadaf161a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.701073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.701055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96d81d290f44eaca1c0dbdec93010d30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"96d81d290f44eaca1c0dbdec93010d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.701073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.701057    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/96d81d290f44eaca1c0dbdec93010d30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"96d81d290f44eaca1c0dbdec93010d30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.801260 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.801233    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.901856 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:34.901788    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:34.925981 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.925956    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:34.930708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:34.930611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:35.002403 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.002371    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.102784 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.102764    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.203193 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.203134    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.303547 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.303507    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.342007 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.341977    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 13:16:35.342431 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.342124    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 13:16:35.403758 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.403727    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.409841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.409793    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 13:11:35 +0000 UTC" deadline="2028-05-03 19:45:21.058690273 +0000 UTC"
Sep 08 13:16:35.409841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.409828    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14478h28m45.648865603s"
Sep 08 13:16:35.491014 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:35.490969    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf29c3cd2e403aedd9a5d1cadaf161a.slice/crio-806efeee68373e4de4a75ca69a1cda39e1fcb5283f56de3037c2bf1daa3e0896 WatchSource:0}: Error finding container 806efeee68373e4de4a75ca69a1cda39e1fcb5283f56de3037c2bf1daa3e0896: Status 404 returned error can't find the container with id 806efeee68373e4de4a75ca69a1cda39e1fcb5283f56de3037c2bf1daa3e0896
Sep 08 13:16:35.491888 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.491854    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:16:35.499512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.499491    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 13:16:35.504223 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.504203    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.604760 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:35.604715    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found"
Sep 08 13:16:35.652917 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.652892    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:16:35.702152 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.702122    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:35.716349 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.716326    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 13:16:35.718243 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.718229    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal"
Sep 08 13:16:35.733346 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.733294    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 13:16:35.920508 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:35.920470    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:16:36.379706 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.379661    2557 apiserver.go:52] "Watching apiserver"
Sep 08 13:16:36.385377 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.385352    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 13:16:36.385744 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.385721    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-bpd77","kube-system/konnectivity-agent-fqvbq","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","openshift-multus/multus-additional-cni-plugins-bhcr9","openshift-multus/network-metrics-daemon-2p4wh","openshift-network-diagnostics/network-check-target-xdhvc","openshift-ovn-kubernetes/ovnkube-node-bfnz6","kube-system/global-pull-secret-syncer-g4579","openshift-cluster-node-tuning-operator/tuned-cz5m9","openshift-dns/node-resolver-xb2bf","openshift-image-registry/node-ca-kj8dv","openshift-multus/multus-9s457"]
Sep 08 13:16:36.389553 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.389523    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:36.389647 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.389603    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:36.391697 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.391678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.393776 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.393752    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.393776 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.393816    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4b7wf\""
Sep 08 13:16:36.394050 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.393902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.394050 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.393963    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.395932 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.395915    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 13:16:36.396329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.396302    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4wkmk\""
Sep 08 13:16:36.396329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.396316    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.396329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.396308    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.396584 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.396408    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 13:16:36.396703 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.396681    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.398108 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.398092    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 13:16:36.398702 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.398491    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.398702 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.398501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:36.398702 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.398530    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.398702 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.398579    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:36.398908 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.398747    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4j6gb\""
Sep 08 13:16:36.399237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.399222    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 13:16:36.400880 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.400865    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.402560 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.402545    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 13:16:36.403027 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.403010    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hnkm7\""
Sep 08 13:16:36.403088 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.403053    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 13:16:36.403417 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.403401    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.405708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.405688    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9vlj5\""
Sep 08 13:16:36.405803 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.405715    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 13:16:36.405869 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.405818    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 13:16:36.405869 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.405841    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 13:16:36.405975 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.405908    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 13:16:36.406069 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.406053    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.406127 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.406057    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.406182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.406098    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.408973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.408950    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 13:16:36.409099 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.409068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysctl-conf\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.409214 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.409112    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-lib-modules\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.409214 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.409124    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.409649 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.409619    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.410056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1cfdd73-63db-4819-8e50-804e372344ae-etc-tuned\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.410162 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-cni-multus\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.410162 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410126    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-registration-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.410271 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410160    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfgvt\" (UniqueName: \"kubernetes.io/projected/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-kube-api-access-jfgvt\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.410271 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410201    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tljj7\" (UniqueName: \"kubernetes.io/projected/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-kube-api-access-tljj7\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:36.410379 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410273    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.410436 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-systemd\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.410436 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-socket-dir-parent\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.410543 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410453    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-multus-certs\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.410543 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410488    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-etc-selinux\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.410543 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-modprobe-d\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-sys\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-etc-kubernetes\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410692    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410719    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrsfk\""
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysctl-d\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.410786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410759    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npskk\" (UniqueName: \"kubernetes.io/projected/e1cfdd73-63db-4819-8e50-804e372344ae-kube-api-access-npskk\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-cni-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-socket-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-system-cni-dir\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.410908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411097    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysconfig\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-var-lib-kubelet\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.411201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411184    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-host\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.411694 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-cnibin\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.411694 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-cni-bin\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.411694 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1cfdd73-63db-4819-8e50-804e372344ae-tmp\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.411694 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411527    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 13:16:36.411909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411871    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 13:16:36.412016 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.411975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-system-cni-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412029    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tc4xg\""
Sep 08 13:16:36.412085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-netns\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412194 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-hostroot\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412194 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412116    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-conf-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412307 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lqgh\" (UniqueName: \"kubernetes.io/projected/45035c96-a99f-4191-87a0-442e1c60231f-kube-api-access-2lqgh\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.412360 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28e79eb-f639-4083-9e0c-2cf3d4168d51-cni-binary-copy\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412416 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412369    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-k8s-cni-cncf-io\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412416 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-kubelet\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412621 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-daemon-config\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.412698 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.412698 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-device-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.412812 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.412701    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-sys-fs\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.413114 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.413094    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-kubernetes\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.413188 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.413140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-run\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.413188 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.413172    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxqnz\" (UniqueName: \"kubernetes.io/projected/a28e79eb-f639-4083-9e0c-2cf3d4168d51-kube-api-access-qxqnz\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.413295 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.413203    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cnibin\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.413967 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.413770    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.414123 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.413931    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:36.414526 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.414501    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 13:16:36.416775 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.416754    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.419080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.419060    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-blhbl\""
Sep 08 13:16:36.419191 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.419075    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.419191 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.419135    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.419367 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.419195    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.419367 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.419248    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 13:16:36.422983 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.422967    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 13:16:36.422983 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.422977    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-295rk\""
Sep 08 13:16:36.423250 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.423234    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 13:16:36.453848 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.453833    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k47bz"
Sep 08 13:16:36.473265 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.473240    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k47bz"
Sep 08 13:16:36.495766 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.495727    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"fdf29c3cd2e403aedd9a5d1cadaf161a","Type":"ContainerStarted","Data":"806efeee68373e4de4a75ca69a1cda39e1fcb5283f56de3037c2bf1daa3e0896"}
Sep 08 13:16:36.499625 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.499609    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 13:16:36.513730 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513700    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.513730 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/009f7ad2-9b62-474a-a02a-a0e8db9014b6-dbus\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.513890 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-cnibin\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.513890 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-cni-bin\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.513890 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovn-node-metrics-cert\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.514009 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-host-slash\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.514009 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6lmx\" (UniqueName: \"kubernetes.io/projected/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-kube-api-access-g6lmx\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.514009 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-cnibin\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514009 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.513938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1cfdd73-63db-4819-8e50-804e372344ae-tmp\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.514130 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-system-cni-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514130 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514104    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-hostroot\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514129    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lqgh\" (UniqueName: \"kubernetes.io/projected/45035c96-a99f-4191-87a0-442e1c60231f-kube-api-access-2lqgh\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.514225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514153    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-k8s-cni-cncf-io\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-kubelet\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-hostroot\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514205    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-daemon-config\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514238    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-k8s-cni-cncf-io\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514242    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-system-cni-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-kubelet\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-device-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-systemd\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-var-lib-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514374    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514402    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-device-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-run\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxqnz\" (UniqueName: \"kubernetes.io/projected/a28e79eb-f639-4083-9e0c-2cf3d4168d51-kube-api-access-qxqnz\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.514506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-run\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cnibin\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514582    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-slash\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysctl-conf\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cnibin\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-lib-modules\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-daemon-config\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514812    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysctl-conf\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1cfdd73-63db-4819-8e50-804e372344ae-etc-tuned\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-lib-modules\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-registration-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514965    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-registration-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.514964    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2k8v\" (UniqueName: \"kubernetes.io/projected/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-kube-api-access-w2k8v\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.515037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515016    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tljj7\" (UniqueName: \"kubernetes.io/projected/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-kube-api-access-tljj7\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-socket-dir-parent\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515075    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-multus-certs\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515099    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-socket-dir-parent\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515103    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-etc-selinux\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovnkube-config\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-multus-certs\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-systemd-units\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-etc-selinux\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a90054cb-b7dc-4b4c-b0e1-9e64203f2b03-konnectivity-ca\") pod \"konnectivity-agent-fqvbq\" (UID: \"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03\") " pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-cni-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515295    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515311    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-run-netns\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515381    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-cni-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a90054cb-b7dc-4b4c-b0e1-9e64203f2b03-agent-certs\") pod \"konnectivity-agent-fqvbq\" (UID: \"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03\") " pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515455    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:36.515643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysconfig\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-var-lib-kubelet\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-host\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-cni-bin\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.515600    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsbjz\" (UniqueName: \"kubernetes.io/projected/76910f97-dbe6-443e-9667-ecf5cd273c6c-kube-api-access-fsbjz\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.515662    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:16:37.015644175 +0000 UTC m=+2.999844951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515692    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-var-lib-kubelet\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515732    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-host\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515765    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-cni-bin\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515796    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-etc-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysconfig\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515849    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-log-socket\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515962    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-netns\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.515991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-conf-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76910f97-dbe6-443e-9667-ecf5cd273c6c-hosts-file\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.516399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-run-netns\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28e79eb-f639-4083-9e0c-2cf3d4168d51-cni-binary-copy\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516068    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-multus-conf-dir\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-sys-fs\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516131    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-kubelet\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-sys-fs\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516177    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-kubernetes\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-serviceca\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-kubernetes\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516255    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-cni-netd\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovnkube-script-lib\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-cni-multus\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-host-var-lib-cni-multus\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516918    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfgvt\" (UniqueName: \"kubernetes.io/projected/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-kube-api-access-jfgvt\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516970    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a28e79eb-f639-4083-9e0c-2cf3d4168d51-cni-binary-copy\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.517237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.516975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-ovn\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-env-overrides\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517114    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-systemd\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517181    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-node-log\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517248    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-systemd\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/009f7ad2-9b62-474a-a02a-a0e8db9014b6-kubelet-config\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-modprobe-d\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-sys\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-etc-kubernetes\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517679    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517721    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-host\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs268\" (UniqueName: \"kubernetes.io/projected/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-kube-api-access-cs268\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517785    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-iptables-alerter-script\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-sys\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517847    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysctl-d\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.518171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npskk\" (UniqueName: \"kubernetes.io/projected/e1cfdd73-63db-4819-8e50-804e372344ae-kube-api-access-npskk\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517969    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-modprobe-d\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.517963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a28e79eb-f639-4083-9e0c-2cf3d4168d51-etc-kubernetes\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518023    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-socket-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-system-cni-dir\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518170    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76910f97-dbe6-443e-9667-ecf5cd273c6c-tmp-dir\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518254    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518525    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1cfdd73-63db-4819-8e50-804e372344ae-etc-tuned\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1cfdd73-63db-4819-8e50-804e372344ae-etc-sysctl-d\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518585    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-system-cni-dir\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.519078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.518663    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1cfdd73-63db-4819-8e50-804e372344ae-tmp\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.519646 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.519080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.519891 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.519841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45035c96-a99f-4191-87a0-442e1c60231f-socket-dir\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.523093 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.522946    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:16:36.523093 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.522975    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:16:36.523093 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.522989    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:36.523093 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.523075    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:37.023056672 +0000 UTC m=+3.007257470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:36.523399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.523382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tljj7\" (UniqueName: \"kubernetes.io/projected/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-kube-api-access-tljj7\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:36.523480 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.523452    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxqnz\" (UniqueName: \"kubernetes.io/projected/a28e79eb-f639-4083-9e0c-2cf3d4168d51-kube-api-access-qxqnz\") pod \"multus-9s457\" (UID: \"a28e79eb-f639-4083-9e0c-2cf3d4168d51\") " pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.524046 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.524023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lqgh\" (UniqueName: \"kubernetes.io/projected/45035c96-a99f-4191-87a0-442e1c60231f-kube-api-access-2lqgh\") pod \"aws-ebs-csi-driver-node-tmxgc\" (UID: \"45035c96-a99f-4191-87a0-442e1c60231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.524880 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.524860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfgvt\" (UniqueName: \"kubernetes.io/projected/f23da5e0-9c0e-4fb1-835b-de796e9e53c4-kube-api-access-jfgvt\") pod \"multus-additional-cni-plugins-bhcr9\" (UID: \"f23da5e0-9c0e-4fb1-835b-de796e9e53c4\") " pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.525348 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.525330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npskk\" (UniqueName: \"kubernetes.io/projected/e1cfdd73-63db-4819-8e50-804e372344ae-kube-api-access-npskk\") pod \"tuned-cz5m9\" (UID: \"e1cfdd73-63db-4819-8e50-804e372344ae\") " pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.618737 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618706    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-var-lib-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618737 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-slash\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2k8v\" (UniqueName: \"kubernetes.io/projected/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-kube-api-access-w2k8v\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovnkube-config\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-systemd-units\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618807    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a90054cb-b7dc-4b4c-b0e1-9e64203f2b03-konnectivity-ca\") pod \"konnectivity-agent-fqvbq\" (UID: \"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03\") " pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-run-netns\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a90054cb-b7dc-4b4c-b0e1-9e64203f2b03-agent-certs\") pod \"konnectivity-agent-fqvbq\" (UID: \"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03\") " pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618849    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-var-lib-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-slash\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsbjz\" (UniqueName: \"kubernetes.io/projected/76910f97-dbe6-443e-9667-ecf5cd273c6c-kube-api-access-fsbjz\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618903    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-run-netns\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.618973 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.618938    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-systemd-units\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619014    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-etc-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-log-socket\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619076    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76910f97-dbe6-443e-9667-ecf5cd273c6c-hosts-file\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619102    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619126    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-etc-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-kubelet\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619137    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-log-socket\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-serviceca\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619191    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/76910f97-dbe6-443e-9667-ecf5cd273c6c-hosts-file\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-cni-netd\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619239    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovnkube-script-lib\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-kubelet\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-ovn\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-env-overrides\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.619332    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619345    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-cni-netd\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.619614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-node-log\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/009f7ad2-9b62-474a-a02a-a0e8db9014b6-kubelet-config\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-openvswitch\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:36.619403    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:37.119383574 +0000 UTC m=+3.103584352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619440    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/009f7ad2-9b62-474a-a02a-a0e8db9014b6-kubelet-config\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-host\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs268\" (UniqueName: \"kubernetes.io/projected/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-kube-api-access-cs268\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovnkube-config\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619447    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-ovn\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-host\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-iptables-alerter-script\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76910f97-dbe6-443e-9667-ecf5cd273c6c-tmp-dir\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619673    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-node-log\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-run-ovn-kubernetes\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619735    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/009f7ad2-9b62-474a-a02a-a0e8db9014b6-dbus\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.620532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-cni-bin\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-serviceca\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619845    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/009f7ad2-9b62-474a-a02a-a0e8db9014b6-dbus\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619887    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-cni-bin\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-env-overrides\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovn-node-metrics-cert\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-host-slash\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6lmx\" (UniqueName: \"kubernetes.io/projected/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-kube-api-access-g6lmx\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.619959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-systemd\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/76910f97-dbe6-443e-9667-ecf5cd273c6c-tmp-dir\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-run-systemd\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620058    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovnkube-script-lib\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620097    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-host-slash\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a90054cb-b7dc-4b4c-b0e1-9e64203f2b03-konnectivity-ca\") pod \"konnectivity-agent-fqvbq\" (UID: \"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03\") " pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.621455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.620373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-iptables-alerter-script\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.622256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.621717    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a90054cb-b7dc-4b4c-b0e1-9e64203f2b03-agent-certs\") pod \"konnectivity-agent-fqvbq\" (UID: \"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03\") " pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.622438 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.622419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-ovn-node-metrics-cert\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.632968 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.632913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs268\" (UniqueName: \"kubernetes.io/projected/aa082cbb-38d0-4bfa-94ef-2e621f2cd695-kube-api-access-cs268\") pod \"node-ca-kj8dv\" (UID: \"aa082cbb-38d0-4bfa-94ef-2e621f2cd695\") " pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.633057 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.632975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsbjz\" (UniqueName: \"kubernetes.io/projected/76910f97-dbe6-443e-9667-ecf5cd273c6c-kube-api-access-fsbjz\") pod \"node-resolver-xb2bf\" (UID: \"76910f97-dbe6-443e-9667-ecf5cd273c6c\") " pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.633218 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.633201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2k8v\" (UniqueName: \"kubernetes.io/projected/30f663d5-adcb-4a5c-81ec-3a2bae5eea2d-kube-api-access-w2k8v\") pod \"ovnkube-node-bfnz6\" (UID: \"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d\") " pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.633489 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.633461    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6lmx\" (UniqueName: \"kubernetes.io/projected/455da77c-c5bb-40c9-a5c7-e3c7d3ed062d-kube-api-access-g6lmx\") pod \"iptables-alerter-bpd77\" (UID: \"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d\") " pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.703875 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.703843    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cz5m9"
Sep 08 13:16:36.708099 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.708075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9s457"
Sep 08 13:16:36.715050 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.715022    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cfdd73_63db_4819_8e50_804e372344ae.slice/crio-9cec03b66992ec8291da3ed575fef9f7ef56934e9ec37ed220bb533fce102a64 WatchSource:0}: Error finding container 9cec03b66992ec8291da3ed575fef9f7ef56934e9ec37ed220bb533fce102a64: Status 404 returned error can't find the container with id 9cec03b66992ec8291da3ed575fef9f7ef56934e9ec37ed220bb533fce102a64
Sep 08 13:16:36.717855 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.717835    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda28e79eb_f639_4083_9e0c_2cf3d4168d51.slice/crio-09da59757c43dc085579302602f65f7046c3a1b0035400154ea7aba63117f546 WatchSource:0}: Error finding container 09da59757c43dc085579302602f65f7046c3a1b0035400154ea7aba63117f546: Status 404 returned error can't find the container with id 09da59757c43dc085579302602f65f7046c3a1b0035400154ea7aba63117f546
Sep 08 13:16:36.718520 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.718501    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc"
Sep 08 13:16:36.722087 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.722070    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhcr9"
Sep 08 13:16:36.727893 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.727872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:16:36.729991 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.729969    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45035c96_a99f_4191_87a0_442e1c60231f.slice/crio-0d62bce8607a1d85614dad497090ccf7adfecd7fda8500ac822321f3e0d84a24 WatchSource:0}: Error finding container 0d62bce8607a1d85614dad497090ccf7adfecd7fda8500ac822321f3e0d84a24: Status 404 returned error can't find the container with id 0d62bce8607a1d85614dad497090ccf7adfecd7fda8500ac822321f3e0d84a24
Sep 08 13:16:36.731541 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.731515    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23da5e0_9c0e_4fb1_835b_de796e9e53c4.slice/crio-a1af8dc67b0acb1c5cd0cf9d006f579e88f2f6ce54c12ca5ccc5aa7751c56d56 WatchSource:0}: Error finding container a1af8dc67b0acb1c5cd0cf9d006f579e88f2f6ce54c12ca5ccc5aa7751c56d56: Status 404 returned error can't find the container with id a1af8dc67b0acb1c5cd0cf9d006f579e88f2f6ce54c12ca5ccc5aa7751c56d56
Sep 08 13:16:36.734132 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.733965    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kj8dv"
Sep 08 13:16:36.737915 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.737771    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f663d5_adcb_4a5c_81ec_3a2bae5eea2d.slice/crio-7aa9aad9e4764ad344287da964fa9023642b1e068ed083e8715aad16013d73e5 WatchSource:0}: Error finding container 7aa9aad9e4764ad344287da964fa9023642b1e068ed083e8715aad16013d73e5: Status 404 returned error can't find the container with id 7aa9aad9e4764ad344287da964fa9023642b1e068ed083e8715aad16013d73e5
Sep 08 13:16:36.739115 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.739085    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:36.744025 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.744003    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa082cbb_38d0_4bfa_94ef_2e621f2cd695.slice/crio-4f6a8e789dba1c82a7791361686ecacf584d9666980185abfc1bdd6129090b82 WatchSource:0}: Error finding container 4f6a8e789dba1c82a7791361686ecacf584d9666980185abfc1bdd6129090b82: Status 404 returned error can't find the container with id 4f6a8e789dba1c82a7791361686ecacf584d9666980185abfc1bdd6129090b82
Sep 08 13:16:36.745610 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.745586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bpd77"
Sep 08 13:16:36.747717 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.747696    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90054cb_b7dc_4b4c_b0e1_9e64203f2b03.slice/crio-0433e6872fb71d4712ed50722921f7b4ca9b474935ec35a5d75e419c01cdc0a0 WatchSource:0}: Error finding container 0433e6872fb71d4712ed50722921f7b4ca9b474935ec35a5d75e419c01cdc0a0: Status 404 returned error can't find the container with id 0433e6872fb71d4712ed50722921f7b4ca9b474935ec35a5d75e419c01cdc0a0
Sep 08 13:16:36.751001 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.750977    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xb2bf"
Sep 08 13:16:36.755383 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:16:36.755361    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod455da77c_c5bb_40c9_a5c7_e3c7d3ed062d.slice/crio-9b6a13c24b2fce6c16508dc2f9a497cc451ef897ca034a3d50ffba9c38a69841 WatchSource:0}: Error finding container 9b6a13c24b2fce6c16508dc2f9a497cc451ef897ca034a3d50ffba9c38a69841: Status 404 returned error can't find the container with id 9b6a13c24b2fce6c16508dc2f9a497cc451ef897ca034a3d50ffba9c38a69841
Sep 08 13:16:36.858313 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:36.858281    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 13:16:37.023720 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.023624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:37.023720 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.023684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:37.023893 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.023787    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:37.023893 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.023850    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:16:38.023834757 +0000 UTC m=+4.008035553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:37.023893 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.023798    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:16:37.023893 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.023891    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:16:37.024033 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.023905    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:37.024033 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.023957    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:38.023943669 +0000 UTC m=+4.008144451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:37.124640 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.124599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:37.124854 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.124821    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:37.124946 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.124921    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:38.124898028 +0000 UTC m=+4.109098825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:37.476965 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.476851    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:11:37 +0000 UTC" deadline="2028-02-03 14:04:01.895328516 +0000 UTC"
Sep 08 13:16:37.476965 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.476916    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12312h47m24.41841656s"
Sep 08 13:16:37.491380 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.491352    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:37.491532 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:37.491479    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:37.500620 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.500593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9s457" event={"ID":"a28e79eb-f639-4083-9e0c-2cf3d4168d51","Type":"ContainerStarted","Data":"09da59757c43dc085579302602f65f7046c3a1b0035400154ea7aba63117f546"}
Sep 08 13:16:37.502498 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.502469    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cz5m9" event={"ID":"e1cfdd73-63db-4819-8e50-804e372344ae","Type":"ContainerStarted","Data":"9cec03b66992ec8291da3ed575fef9f7ef56934e9ec37ed220bb533fce102a64"}
Sep 08 13:16:37.504231 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.504190    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xb2bf" event={"ID":"76910f97-dbe6-443e-9667-ecf5cd273c6c","Type":"ContainerStarted","Data":"cab79474de883237689f3df50181b66e02825ebe4b22b62910bd389fb4643a4b"}
Sep 08 13:16:37.506002 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.505976    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fqvbq" event={"ID":"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03","Type":"ContainerStarted","Data":"0433e6872fb71d4712ed50722921f7b4ca9b474935ec35a5d75e419c01cdc0a0"}
Sep 08 13:16:37.508090 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.508064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerStarted","Data":"a1af8dc67b0acb1c5cd0cf9d006f579e88f2f6ce54c12ca5ccc5aa7751c56d56"}
Sep 08 13:16:37.510872 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.510847    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc" event={"ID":"45035c96-a99f-4191-87a0-442e1c60231f","Type":"ContainerStarted","Data":"0d62bce8607a1d85614dad497090ccf7adfecd7fda8500ac822321f3e0d84a24"}
Sep 08 13:16:37.512868 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.512844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpd77" event={"ID":"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d","Type":"ContainerStarted","Data":"9b6a13c24b2fce6c16508dc2f9a497cc451ef897ca034a3d50ffba9c38a69841"}
Sep 08 13:16:37.514796 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.514772    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kj8dv" event={"ID":"aa082cbb-38d0-4bfa-94ef-2e621f2cd695","Type":"ContainerStarted","Data":"4f6a8e789dba1c82a7791361686ecacf584d9666980185abfc1bdd6129090b82"}
Sep 08 13:16:37.516553 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:37.516529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"7aa9aad9e4764ad344287da964fa9023642b1e068ed083e8715aad16013d73e5"}
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.033685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.034030    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.034279    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.034301    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.034314    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.034406    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:40.034361081 +0000 UTC m=+6.018561946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.034935    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:38.035057 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.035020    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:16:40.035002361 +0000 UTC m=+6.019203146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:38.135066 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.135000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:38.135275 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.135158    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:38.135275 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.135239    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:40.135216889 +0000 UTC m=+6.119417690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:38.477853 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.477757    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 13:11:37 +0000 UTC" deadline="2028-04-23 05:36:59.437844029 +0000 UTC"
Sep 08 13:16:38.477853 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.477799    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14224h20m20.960050895s"
Sep 08 13:16:38.493329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.492517    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:38.493329 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.492704    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:38.493329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:38.493177    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:38.493329 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:38.493287    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:39.490906 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:39.490872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:39.491283 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:39.491011    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:40.052813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:40.052898    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.053004    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.053022    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.053034    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.053049    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.053087    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:16:44.053067814 +0000 UTC m=+10.037268598 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:40.053134 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.053107    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:44.053097272 +0000 UTC m=+10.037298054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:40.154245 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:40.154202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:40.154420 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.154336    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:40.154420 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.154409    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:44.154389603 +0000 UTC m=+10.138590404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:40.490873 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:40.490770    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:40.491052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.490937    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:40.491469 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:40.491358    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:40.491526 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:40.491492    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:41.491457 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:41.491408    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:41.491973 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:41.491570    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:42.491241 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:42.491203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:42.491241 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:42.491240    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:42.491500 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:42.491389    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:42.491925 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:42.491495    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:43.490972 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:43.490883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:43.491193 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:43.491036    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:44.091470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:44.091324    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:44.091470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:44.091425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:44.092052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.091552    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:16:44.092052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.091584    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:16:44.092052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.091597    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:44.092052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.091690    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:16:52.091669156 +0000 UTC m=+18.075869948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:44.092052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.091603    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:44.092052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.091762    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:52.091742501 +0000 UTC m=+18.075943295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:44.192059 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:44.192017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:44.192252 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.192206    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:44.192322 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.192284    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:16:52.192263252 +0000 UTC m=+18.176464035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:44.492154 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:44.491662    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:44.492154 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.491783    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:44.492154 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:44.491809    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:44.492154 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:44.491933    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:45.490861 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:45.490830    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:45.491236 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:45.490938    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:46.490979 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:46.490942    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:46.491421 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:46.491069    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:46.491421 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:46.490948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:46.491421 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:46.491192    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:47.490565 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:47.490536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:47.490746 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:47.490646    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:48.491490 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:48.491453    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:48.491964 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:48.491453    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:48.491964 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:48.491622    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:48.491964 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:48.491764    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:49.490690 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:49.490657    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:49.490860 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:49.490778    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:50.490926 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:50.490889    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:50.491412 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:50.491030    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:50.491412 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:50.491077    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:50.491412 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:50.491180    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:51.490511 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:51.490433    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:51.490711 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:51.490577    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:52.151889 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:52.151854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:52.151913    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.152029    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.152104    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:17:08.152082347 +0000 UTC m=+34.136283141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.152040    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.152141    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.152156    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:52.152318 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.152210    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:08.152196203 +0000 UTC m=+34.136396980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:16:52.253197 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:52.253161    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:52.253376 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.253298    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:52.253376 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.253362    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:08.253345751 +0000 UTC m=+34.237546539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:16:52.491028 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:52.490927    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:52.491028 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:52.490987    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:52.491244 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.491079    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:52.491244 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:52.491212    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:53.491276 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:53.491236    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:53.491691 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:53.491345    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:54.492156 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:54.492123    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:54.492589 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:54.492229    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:54.492589 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:54.492322    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:54.492589 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:54.492437    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:55.491932 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.491513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:55.491932 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:55.491866    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:55.563656 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.563512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xb2bf" event={"ID":"76910f97-dbe6-443e-9667-ecf5cd273c6c","Type":"ContainerStarted","Data":"5c3183950fdd19327a9d32ac224768ae5ede6b5eacb83a2cc783e56152fdae98"}
Sep 08 13:16:55.566561 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.566487    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fqvbq" event={"ID":"a90054cb-b7dc-4b4c-b0e1-9e64203f2b03","Type":"ContainerStarted","Data":"95c0724e337ec0ed973f2cd36ffe677a2643d96b2dec3e3d35b1a2ac135752c1"}
Sep 08 13:16:55.569012 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.568988    2557 generic.go:356] "Generic (PLEG): container finished" podID="f23da5e0-9c0e-4fb1-835b-de796e9e53c4" containerID="7ed167c29601fdda1d3aa94b892d9b60dfd7c468c3fefbb5f5b34907e2cf9e7d" exitCode=0
Sep 08 13:16:55.569117 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.569071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerDied","Data":"7ed167c29601fdda1d3aa94b892d9b60dfd7c468c3fefbb5f5b34907e2cf9e7d"}
Sep 08 13:16:55.572627 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.572599    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc" event={"ID":"45035c96-a99f-4191-87a0-442e1c60231f","Type":"ContainerStarted","Data":"0a9dfd314ef35e77df5220e200e8b664b18936c2814f611bebe60434af5f046a"}
Sep 08 13:16:55.574269 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.574245    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kj8dv" event={"ID":"aa082cbb-38d0-4bfa-94ef-2e621f2cd695","Type":"ContainerStarted","Data":"0d64d33fbb8c01f4ba38f5fd48c23a303d3085b62289a9203de363dd649ae0bc"}
Sep 08 13:16:55.577102 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.577081    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"14c82ae0f088cb841200bb6f605cd3c81aa35e5461326fa2d3c52e358f259aa1"}
Sep 08 13:16:55.577196 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.577143    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"75a810768a6508d3a405254aef7d0faa7f60c247e94b425e79c74224f8d7612b"}
Sep 08 13:16:55.579412 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.579384    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9s457" event={"ID":"a28e79eb-f639-4083-9e0c-2cf3d4168d51","Type":"ContainerStarted","Data":"258bee5f27ef69bcbbfe8ce92fa1a53b5ad29bcd49c9a1705a64c080cf575146"}
Sep 08 13:16:55.579881 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.579838    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xb2bf" podStartSLOduration=6.32055061 podStartE2EDuration="20.57981965s" totalImagesPullingTime="14.25926904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.579128016 +0000 UTC m=+21.563328831" watchObservedRunningTime="2026-09-08 13:16:55.57981965 +0000 UTC m=+21.564020448"
Sep 08 13:16:55.581156 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.581132    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cz5m9" event={"ID":"e1cfdd73-63db-4819-8e50-804e372344ae","Type":"ContainerStarted","Data":"a2fcb94c35bd9e644e853beea3c32a3ffbcb016f30785870601b2f5098fde14a"}
Sep 08 13:16:55.583178 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.583154    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"96d81d290f44eaca1c0dbdec93010d30","Type":"ContainerStarted","Data":"b7492c603fe9bd7dc16005fbf69078b66780bceb16365dec0332e350f1a2d414"}
Sep 08 13:16:55.585635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.585587    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"fdf29c3cd2e403aedd9a5d1cadaf161a","Type":"ContainerStarted","Data":"3f6061c565b8fd660da29c0d739655ee50d90851ed7c1a4d675063fc7f6a2a74"}
Sep 08 13:16:55.612807 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.612755    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fqvbq" podStartSLOduration=11.829788129 podStartE2EDuration="20.612735976s" totalImagesPullingTime="8.782947847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.612047463 +0000 UTC m=+21.596248273" watchObservedRunningTime="2026-09-08 13:16:55.612735976 +0000 UTC m=+21.596936774"
Sep 08 13:16:55.626814 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.626762    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kj8dv" podStartSLOduration=6.347782753 podStartE2EDuration="20.62674349s" totalImagesPullingTime="14.278960737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.626127256 +0000 UTC m=+21.610328054" watchObservedRunningTime="2026-09-08 13:16:55.62674349 +0000 UTC m=+21.610944323"
Sep 08 13:16:55.642707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.642662    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9s457" podStartSLOduration=2.810017061 podStartE2EDuration="20.642648423s" totalImagesPullingTime="17.832631362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.642008493 +0000 UTC m=+21.626209295" watchObservedRunningTime="2026-09-08 13:16:55.642648423 +0000 UTC m=+21.626849210"
Sep 08 13:16:55.661487 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.661440    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" podStartSLOduration=19.661422729999998 podStartE2EDuration="19.66142273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.660696048 +0000 UTC m=+21.644896845" watchObservedRunningTime="2026-09-08 13:16:55.66142273 +0000 UTC m=+21.645623527"
Sep 08 13:16:55.682064 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.682013    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cz5m9" podStartSLOduration=2.867490895 podStartE2EDuration="20.681997523s" totalImagesPullingTime="17.814506628s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:55.681346539 +0000 UTC m=+21.665547350" watchObservedRunningTime="2026-09-08 13:16:55.681997523 +0000 UTC m=+21.666198320"
Sep 08 13:16:55.983095 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:55.983066    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:56.234989 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.234946    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 13:16:56.465167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.465027    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T13:16:56.23498487Z","UUID":"83fe2ab0-9bf0-4e9e-8d53-c95737426a59","Handler":null,"Name":"","Endpoint":""}
Sep 08 13:16:56.466697 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.466672    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 13:16:56.466697 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.466699    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 13:16:56.491054 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.491030    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:56.491169 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.491030    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:56.491169 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:56.491153    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:56.491243 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:56.491192    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:56.589269 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.589237    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc" event={"ID":"45035c96-a99f-4191-87a0-442e1c60231f","Type":"ContainerStarted","Data":"83236f3f545307ba1dcb7973fbee54c0e1cb47ab45afab8a40a88000de7aa443"}
Sep 08 13:16:56.590774 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.590746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bpd77" event={"ID":"455da77c-c5bb-40c9-a5c7-e3c7d3ed062d","Type":"ContainerStarted","Data":"653d8bcdca88b8c89c3ea2430356ae3e031944aab1c6209f8dddad4ba1b15dd2"}
Sep 08 13:16:56.593571 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.593540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"1bdf69b69e17623e54fdcd3a46417ab67506761d4da3eaf3621008db6416ccd3"}
Sep 08 13:16:56.593680 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.593604    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"dd2facb2d2e660d4c3c682332b7cbd9867e3f563f6d6f9480896a97c9c0cfee6"}
Sep 08 13:16:56.593680 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.593635    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"cff345f71787eba86de8917e6111056193dc7e8e6f43925b334743a4c900c8aa"}
Sep 08 13:16:56.593680 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.593666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"6f7eef421eaaec19c67a7466d5e09acaf81e00eb843faf6c7b8131d3bbdb9fe2"}
Sep 08 13:16:56.594936 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.594914    2557 generic.go:356] "Generic (PLEG): container finished" podID="96d81d290f44eaca1c0dbdec93010d30" containerID="a891c8d4157e9d89c189f83cf6beaf14c8049976f43e25c494187e98dc4a4c81" exitCode=0
Sep 08 13:16:56.595049 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.594985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"96d81d290f44eaca1c0dbdec93010d30","Type":"ContainerDied","Data":"a891c8d4157e9d89c189f83cf6beaf14c8049976f43e25c494187e98dc4a4c81"}
Sep 08 13:16:56.607062 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:56.607019    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bpd77" podStartSLOduration=8.74633801 podStartE2EDuration="21.607000294s" totalImagesPullingTime="12.860662284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:56.606815818 +0000 UTC m=+22.591016628" watchObservedRunningTime="2026-09-08 13:16:56.607000294 +0000 UTC m=+22.591201093"
Sep 08 13:16:57.491545 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:57.491491    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:57.491709 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:57.491675    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:16:57.504983 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:57.504954    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:57.505498 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:57.505484    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:57.599593 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:57.599548    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"96d81d290f44eaca1c0dbdec93010d30","Type":"ContainerStarted","Data":"3924d46c48944b9ed0dcef2831c323409c44511d972c2298ea326173adaad1ae"}
Sep 08 13:16:57.600355 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:57.600322    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fqvbq"
Sep 08 13:16:57.639425 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:57.639374    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" podStartSLOduration=21.639358793 podStartE2EDuration="21.639358793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:57.621804453 +0000 UTC m=+23.606005253" watchObservedRunningTime="2026-09-08 13:16:57.639358793 +0000 UTC m=+23.623559590"
Sep 08 13:16:58.491216 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:58.491004    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:16:58.491333 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:58.491314    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:16:58.491409 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:58.491004    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:16:58.491462 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:58.491421    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:16:58.604080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:58.604045    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc" event={"ID":"45035c96-a99f-4191-87a0-442e1c60231f","Type":"ContainerStarted","Data":"0383fd1766f50156472478c411edf2e6c6b75d233eee84458158ad2ca171fedc"}
Sep 08 13:16:58.608061 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:58.608035    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"c6b27e1e6c70fd1cc1fa14972b3b75527270a6d706e4b16fc94fd0502bd42372"}
Sep 08 13:16:58.625843 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:58.625799    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tmxgc" podStartSLOduration=2.7052753750000003 podStartE2EDuration="23.625785293s" totalImagesPullingTime="20.920509918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:16:58.625677991 +0000 UTC m=+24.609878792" watchObservedRunningTime="2026-09-08 13:16:58.625785293 +0000 UTC m=+24.609986090"
Sep 08 13:16:59.490642 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:16:59.490614    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:16:59.490818 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:16:59.490722    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:17:00.490503 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:00.490474    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:00.490950 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:00.490581    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:17:00.490950 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:00.490693    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:00.490950 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:00.490825    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:17:01.491607 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.491409    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:01.492074 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:01.491678    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:17:01.615490 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.615456    2557 generic.go:356] "Generic (PLEG): container finished" podID="f23da5e0-9c0e-4fb1-835b-de796e9e53c4" containerID="52a8570bebfd7805f33a9d1a8005316e14c81bd76044e7405d51508bd90eeb14" exitCode=0
Sep 08 13:17:01.615648 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.615556    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerDied","Data":"52a8570bebfd7805f33a9d1a8005316e14c81bd76044e7405d51508bd90eeb14"}
Sep 08 13:17:01.619458 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.619438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" event={"ID":"30f663d5-adcb-4a5c-81ec-3a2bae5eea2d","Type":"ContainerStarted","Data":"54351da87f610b886675d94e761738d761a89234cee8a1c17bfd4e5d237bdb9c"}
Sep 08 13:17:01.619701 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.619686    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:17:01.619748 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.619740    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:17:01.634636 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:01.634617    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:17:02.491176 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.491139    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:02.491176 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.491173    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:02.491354 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:02.491283    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:17:02.491406 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:02.491386    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:17:02.571012 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.570899    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6" podStartSLOduration=8.357812056 podStartE2EDuration="27.570876476s" totalImagesPullingTime="19.21306442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:01.700621424 +0000 UTC m=+27.684822224" watchObservedRunningTime="2026-09-08 13:17:02.570876476 +0000 UTC m=+28.555077275"
Sep 08 13:17:02.571770 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.571750    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4579"]
Sep 08 13:17:02.575064 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.575040    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2p4wh"]
Sep 08 13:17:02.575639 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.575615    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdhvc"]
Sep 08 13:17:02.575749 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.575734    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:02.575881 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:02.575862    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:17:02.623278 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.623200    2557 generic.go:356] "Generic (PLEG): container finished" podID="f23da5e0-9c0e-4fb1-835b-de796e9e53c4" containerID="2a70bde2f47c84a02bb73401ef64df7c6a5d35f62c9112ccb053495646f19c30" exitCode=0
Sep 08 13:17:02.623437 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.623281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerDied","Data":"2a70bde2f47c84a02bb73401ef64df7c6a5d35f62c9112ccb053495646f19c30"}
Sep 08 13:17:02.623437 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.623320    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:02.623437 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:02.623413    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:17:02.623820 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.623797    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:17:02.623930 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.623837    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:02.624240 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:02.623953    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:17:02.639182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:02.639160    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:17:03.630965 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:03.630915    2557 generic.go:356] "Generic (PLEG): container finished" podID="f23da5e0-9c0e-4fb1-835b-de796e9e53c4" containerID="b52e88d162825ee45705552c5d417e69549722dcaf4d403edb33c67257e832ef" exitCode=0
Sep 08 13:17:03.631393 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:03.630994    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerDied","Data":"b52e88d162825ee45705552c5d417e69549722dcaf4d403edb33c67257e832ef"}
Sep 08 13:17:04.491873 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:04.491839    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:04.492035 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:04.491945    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:04.492035 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:04.491991    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:04.492035 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:04.491998    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:17:04.492155 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:04.492069    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:17:04.492197 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:04.492147    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:17:06.491441 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:06.491400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:06.491939 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:06.491418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:06.491939 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:06.491538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:06.491939 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:06.491537    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhvc" podUID="63fe69db-afac-4d88-86bb-06b560fba0b6"
Sep 08 13:17:06.491939 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:06.491648    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:17:06.491939 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:06.491740    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g4579" podUID="009f7ad2-9b62-474a-a02a-a0e8db9014b6"
Sep 08 13:17:08.165355 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.165307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.165382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.165480    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.165517    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.165549    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.165563    2557 projected.go:196] Error preparing data for projected volume kube-api-access-wggpx for pod openshift-network-diagnostics/network-check-target-xdhvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.165580    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:17:40.165559293 +0000 UTC m=+66.149760090 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 13:17:08.165912 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.165612    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx podName:63fe69db-afac-4d88-86bb-06b560fba0b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:40.165596647 +0000 UTC m=+66.149797443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wggpx" (UniqueName: "kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx") pod "network-check-target-xdhvc" (UID: "63fe69db-afac-4d88-86bb-06b560fba0b6") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 13:17:08.265976 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.265937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:08.266185 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.266074    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 13:17:08.266185 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.266155    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret podName:009f7ad2-9b62-474a-a02a-a0e8db9014b6 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:40.266136104 +0000 UTC m=+66.250336899 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret") pod "global-pull-secret-syncer-g4579" (UID: "009f7ad2-9b62-474a-a02a-a0e8db9014b6") : object "kube-system"/"original-pull-secret" not registered
Sep 08 13:17:08.307276 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.307242    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeReady"
Sep 08 13:17:08.307458 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.307404    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 13:17:08.386611 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.386532    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nqf7p"]
Sep 08 13:17:08.411305 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.411266    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fdc92"]
Sep 08 13:17:08.411474 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.411402    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.414221 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.414016    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 13:17:08.414221 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.414023    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 13:17:08.414478 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.414461    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6zj7\""
Sep 08 13:17:08.427347 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.427321    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fdc92"]
Sep 08 13:17:08.427467 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.427357    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqf7p"]
Sep 08 13:17:08.427467 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.427445    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.430791 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.430769    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 13:17:08.430919 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.430897    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-89flp\""
Sep 08 13:17:08.431059 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.431043    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 13:17:08.431153 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.431109    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 13:17:08.491180 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.491139    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:08.491380 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.491151    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:08.491380 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.491273    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:08.494910 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.494836    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 13:17:08.494910 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.494854    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 13:17:08.495091 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.494915    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 13:17:08.495357 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.495336    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tdz6\""
Sep 08 13:17:08.495466 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.495421    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lvcfq\""
Sep 08 13:17:08.495714 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.495687    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 13:17:08.569070 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.569031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee5b509f-dd85-422e-b31b-b9b1bd569184-cert\") pod \"ingress-canary-fdc92\" (UID: \"ee5b509f-dd85-422e-b31b-b9b1bd569184\") " pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.569246 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.569075    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df4e94-a39c-4bc8-a71d-6c16ada47713-tmp-dir\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.569246 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.569139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.569246 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.569232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4df4e94-a39c-4bc8-a71d-6c16ada47713-config-volume\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.569374 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.569273    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b64p8\" (UniqueName: \"kubernetes.io/projected/b4df4e94-a39c-4bc8-a71d-6c16ada47713-kube-api-access-b64p8\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.569374 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.569318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq9km\" (UniqueName: \"kubernetes.io/projected/ee5b509f-dd85-422e-b31b-b9b1bd569184-kube-api-access-pq9km\") pod \"ingress-canary-fdc92\" (UID: \"ee5b509f-dd85-422e-b31b-b9b1bd569184\") " pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.670709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.670635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee5b509f-dd85-422e-b31b-b9b1bd569184-cert\") pod \"ingress-canary-fdc92\" (UID: \"ee5b509f-dd85-422e-b31b-b9b1bd569184\") " pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.670709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.670671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df4e94-a39c-4bc8-a71d-6c16ada47713-tmp-dir\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.670709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.670695    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.670981 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.670740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4df4e94-a39c-4bc8-a71d-6c16ada47713-config-volume\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.670981 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.670769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64p8\" (UniqueName: \"kubernetes.io/projected/b4df4e94-a39c-4bc8-a71d-6c16ada47713-kube-api-access-b64p8\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.670981 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.670870    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:08.670981 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:08.670947    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:09.170926814 +0000 UTC m=+35.155127596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:08.671178 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.670991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq9km\" (UniqueName: \"kubernetes.io/projected/ee5b509f-dd85-422e-b31b-b9b1bd569184-kube-api-access-pq9km\") pod \"ingress-canary-fdc92\" (UID: \"ee5b509f-dd85-422e-b31b-b9b1bd569184\") " pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.671178 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.671056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4df4e94-a39c-4bc8-a71d-6c16ada47713-tmp-dir\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.671347 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.671318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4df4e94-a39c-4bc8-a71d-6c16ada47713-config-volume\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.674938 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.674916    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee5b509f-dd85-422e-b31b-b9b1bd569184-cert\") pod \"ingress-canary-fdc92\" (UID: \"ee5b509f-dd85-422e-b31b-b9b1bd569184\") " pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.680797 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.680774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b64p8\" (UniqueName: \"kubernetes.io/projected/b4df4e94-a39c-4bc8-a71d-6c16ada47713-kube-api-access-b64p8\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:08.681074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.681047    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq9km\" (UniqueName: \"kubernetes.io/projected/ee5b509f-dd85-422e-b31b-b9b1bd569184-kube-api-access-pq9km\") pod \"ingress-canary-fdc92\" (UID: \"ee5b509f-dd85-422e-b31b-b9b1bd569184\") " pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:08.737019 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:08.736981    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fdc92"
Sep 08 13:17:09.174711 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:09.174678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:09.175135 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:09.174782    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:09.175135 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:09.174833    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:10.174820427 +0000 UTC m=+36.159021202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:09.218690 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:09.218664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fdc92"]
Sep 08 13:17:09.222210 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:17:09.222184    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5b509f_dd85_422e_b31b_b9b1bd569184.slice/crio-03f9f1a0a2f93bd62cd5046f561175b81582dbd90fcd07c92545ed2fea62d896 WatchSource:0}: Error finding container 03f9f1a0a2f93bd62cd5046f561175b81582dbd90fcd07c92545ed2fea62d896: Status 404 returned error can't find the container with id 03f9f1a0a2f93bd62cd5046f561175b81582dbd90fcd07c92545ed2fea62d896
Sep 08 13:17:09.648659 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:09.648361    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fdc92" event={"ID":"ee5b509f-dd85-422e-b31b-b9b1bd569184","Type":"ContainerStarted","Data":"03f9f1a0a2f93bd62cd5046f561175b81582dbd90fcd07c92545ed2fea62d896"}
Sep 08 13:17:09.651827 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:09.651793    2557 generic.go:356] "Generic (PLEG): container finished" podID="f23da5e0-9c0e-4fb1-835b-de796e9e53c4" containerID="4ffb14850a725e68cf98a652a15e95907a0fe28ca0f29c18aaa820456055e232" exitCode=0
Sep 08 13:17:09.651950 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:09.651866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerDied","Data":"4ffb14850a725e68cf98a652a15e95907a0fe28ca0f29c18aaa820456055e232"}
Sep 08 13:17:10.180943 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:10.180907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:10.181448 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:10.181076    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:10.181448 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:10.181153    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:12.18113064 +0000 UTC m=+38.165331433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:10.658898 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:10.658818    2557 generic.go:356] "Generic (PLEG): container finished" podID="f23da5e0-9c0e-4fb1-835b-de796e9e53c4" containerID="f2eb799517fade891f0db32ae4ed6174dc8d3ee87008387c0ff450824a5d6842" exitCode=0
Sep 08 13:17:10.659165 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:10.658893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerDied","Data":"f2eb799517fade891f0db32ae4ed6174dc8d3ee87008387c0ff450824a5d6842"}
Sep 08 13:17:11.663037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:11.662950    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fdc92" event={"ID":"ee5b509f-dd85-422e-b31b-b9b1bd569184","Type":"ContainerStarted","Data":"e31db2af89ca5c1d41ecd052940edfa787257be2ef15a7b4ce09482246b9601b"}
Sep 08 13:17:11.666616 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:11.666591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" event={"ID":"f23da5e0-9c0e-4fb1-835b-de796e9e53c4","Type":"ContainerStarted","Data":"e5c72db5b3208345267046c23daa2a718c39eb4318ceee1cd5d4b1800573fbdc"}
Sep 08 13:17:11.679484 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:11.679422    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fdc92" podStartSLOduration=1.488501823 podStartE2EDuration="3.679398648s" totalImagesPullingTime="2.190896825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:11.679244576 +0000 UTC m=+37.663445375" watchObservedRunningTime="2026-09-08 13:17:11.679398648 +0000 UTC m=+37.663599446"
Sep 08 13:17:11.703219 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:11.703170    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bhcr9" podStartSLOduration=15.745788278 podStartE2EDuration="36.703152638s" totalImagesPullingTime="20.95736436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:11.702384762 +0000 UTC m=+37.686585559" watchObservedRunningTime="2026-09-08 13:17:11.703152638 +0000 UTC m=+37.687353434"
Sep 08 13:17:12.197344 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:12.197307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:12.197477 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:12.197457    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:12.197561 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:12.197540    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:16.197510091 +0000 UTC m=+42.181710871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:16.226032 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:16.225990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:16.226478 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:16.226152    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:16.226478 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:16.226221    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:24.226205957 +0000 UTC m=+50.210406732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:24.280378 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:24.280341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:24.280787 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:24.280494    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:24.280787 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:24.280571    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:17:40.280555228 +0000 UTC m=+66.264756008 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:34.643325 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:34.643297    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bfnz6"
Sep 08 13:17:40.191537 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.191476    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:40.191931 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.191576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:17:40.193834 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.193814    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 13:17:40.193875 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.193814    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 13:17:40.202507 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:40.202483    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 13:17:40.202575 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:40.202566    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:18:44.202551525 +0000 UTC m=+130.186752314 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : secret "metrics-daemon-secret" not found
Sep 08 13:17:40.204334 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.204319    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 13:17:40.216597 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.216569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wggpx\" (UniqueName: \"kubernetes.io/projected/63fe69db-afac-4d88-86bb-06b560fba0b6-kube-api-access-wggpx\") pod \"network-check-target-xdhvc\" (UID: \"63fe69db-afac-4d88-86bb-06b560fba0b6\") " pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:40.292870 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.292828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:40.292870 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.292874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:17:40.293052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:40.292970    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:17:40.293052 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:17:40.293027    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:18:12.293013375 +0000 UTC m=+98.277214169 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:17:40.295210 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.295194    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 13:17:40.305482 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.305458    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tdz6\""
Sep 08 13:17:40.305664 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.305644    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/009f7ad2-9b62-474a-a02a-a0e8db9014b6-original-pull-secret\") pod \"global-pull-secret-syncer-g4579\" (UID: \"009f7ad2-9b62-474a-a02a-a0e8db9014b6\") " pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:40.314512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.314495    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g4579"
Sep 08 13:17:40.314512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.314494    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:40.586640 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.586463    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdhvc"]
Sep 08 13:17:40.589133 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:17:40.589101    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fe69db_afac_4d88_86bb_06b560fba0b6.slice/crio-ef38a67d89d476a72352d36bed98adec43979ef2f2ffab715e828b66d3fc1354 WatchSource:0}: Error finding container ef38a67d89d476a72352d36bed98adec43979ef2f2ffab715e828b66d3fc1354: Status 404 returned error can't find the container with id ef38a67d89d476a72352d36bed98adec43979ef2f2ffab715e828b66d3fc1354
Sep 08 13:17:40.590146 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.589984    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g4579"]
Sep 08 13:17:40.593837 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:17:40.593812    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009f7ad2_9b62_474a_a02a_a0e8db9014b6.slice/crio-dc85f84af4fd43e6390f27b3e4a0f918485d4274d78ed5437f95d53031c66509 WatchSource:0}: Error finding container dc85f84af4fd43e6390f27b3e4a0f918485d4274d78ed5437f95d53031c66509: Status 404 returned error can't find the container with id dc85f84af4fd43e6390f27b3e4a0f918485d4274d78ed5437f95d53031c66509
Sep 08 13:17:40.734197 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.734163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4579" event={"ID":"009f7ad2-9b62-474a-a02a-a0e8db9014b6","Type":"ContainerStarted","Data":"dc85f84af4fd43e6390f27b3e4a0f918485d4274d78ed5437f95d53031c66509"}
Sep 08 13:17:40.735191 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:40.735172    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdhvc" event={"ID":"63fe69db-afac-4d88-86bb-06b560fba0b6","Type":"ContainerStarted","Data":"ef38a67d89d476a72352d36bed98adec43979ef2f2ffab715e828b66d3fc1354"}
Sep 08 13:17:45.751029 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:45.750981    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g4579" event={"ID":"009f7ad2-9b62-474a-a02a-a0e8db9014b6","Type":"ContainerStarted","Data":"d0bb826c405fb2e5b88d907a434d1c8fc7a3375f623be7936cf9fee1f8f99529"}
Sep 08 13:17:45.752457 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:45.752432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdhvc" event={"ID":"63fe69db-afac-4d88-86bb-06b560fba0b6","Type":"ContainerStarted","Data":"3c72f2bb1e85520d3b5c86300443359165280e30cdccb2ba33e2da58c3824bb8"}
Sep 08 13:17:45.752577 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:45.752560    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:17:45.768777 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:45.768728    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g4579" podStartSLOduration=66.307527236 podStartE2EDuration="1m10.768712285s" totalImagesPullingTime="4.461185049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:45.768076702 +0000 UTC m=+71.752277511" watchObservedRunningTime="2026-09-08 13:17:45.768712285 +0000 UTC m=+71.752913078"
Sep 08 13:17:45.783982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:17:45.783942    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xdhvc" podStartSLOduration=66.322563339 podStartE2EDuration="1m10.783929822s" totalImagesPullingTime="4.461366483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:17:45.783358664 +0000 UTC m=+71.767559462" watchObservedRunningTime="2026-09-08 13:17:45.783929822 +0000 UTC m=+71.768130619"
Sep 08 13:18:12.307237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:18:12.307184    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:18:12.307671 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:18:12.307336    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 13:18:12.307671 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:18:12.307414    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls podName:b4df4e94-a39c-4bc8-a71d-6c16ada47713 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:16.307399 +0000 UTC m=+162.291599776 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls") pod "dns-default-nqf7p" (UID: "b4df4e94-a39c-4bc8-a71d-6c16ada47713") : secret "dns-default-metrics-tls" not found
Sep 08 13:18:16.757294 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:18:16.757262    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xdhvc"
Sep 08 13:18:44.209537 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:18:44.209466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:18:44.210025 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:18:44.209638    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 13:18:44.210025 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:18:44.209716    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs podName:661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb nodeName:}" failed. No retries permitted until 2026-09-08 13:20:46.209700072 +0000 UTC m=+252.193900850 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs") pod "network-metrics-daemon-2p4wh" (UID: "661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb") : secret "metrics-daemon-secret" not found
Sep 08 13:19:01.670451 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.670416    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kjmxs"]
Sep 08 13:19:01.672148 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.672132    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-d59lb"]
Sep 08 13:19:01.672266 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.672247    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.673788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.673768    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:01.675339 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.675320    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-md2vv\""
Sep 08 13:19:01.675428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.675343    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 13:19:01.675624 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.675607    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 08 13:19:01.675686 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.675669    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 13:19:01.676146 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.676127    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 08 13:19:01.676204 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.676158    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vs6p6\""
Sep 08 13:19:01.676663 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.676647    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 13:19:01.678739 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.678724    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 13:19:01.682549 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.682513    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 13:19:01.686277 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.686261    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-d59lb"]
Sep 08 13:19:01.689729 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.689709    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kjmxs"]
Sep 08 13:19:01.726063 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:01.726227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e898303-3e30-4691-b769-e4b45a70d80d-nginx-conf\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:01.726227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fda41fa2-ec43-44bd-b99c-26839106c353-tmp\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.726227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdhj\" (UniqueName: \"kubernetes.io/projected/fda41fa2-ec43-44bd-b99c-26839106c353-kube-api-access-fsdhj\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.726227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fda41fa2-ec43-44bd-b99c-26839106c353-snapshots\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.726227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fda41fa2-ec43-44bd-b99c-26839106c353-serving-cert\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.726384 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726268    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda41fa2-ec43-44bd-b99c-26839106c353-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.726384 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.726302    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda41fa2-ec43-44bd-b99c-26839106c353-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.761189 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.761156    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"]
Sep 08 13:19:01.762889 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.762873    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"
Sep 08 13:19:01.765548 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.765511    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6qqv5\""
Sep 08 13:19:01.765695 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.765677    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:19:01.765754 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.765698    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 13:19:01.766756 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.766738    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-7nvg8"]
Sep 08 13:19:01.768646 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.768627    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-745d49b47b-s9nxb"]
Sep 08 13:19:01.768747 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.768692    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.770508 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.770492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.771098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.771082    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 08 13:19:01.771341 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.771327    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 08 13:19:01.773182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.773164    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 08 13:19:01.775606 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.775565    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 08 13:19:01.775704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.775569    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 13:19:01.775704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.775592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 13:19:01.776259 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.776239    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zd7nb\""
Sep 08 13:19:01.776399 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.776378    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x85h2\""
Sep 08 13:19:01.777371 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.777242    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 13:19:01.777875 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.777856    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 13:19:01.780213 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.777982    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 13:19:01.780618 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.780600    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 13:19:01.784454 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.784437    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 08 13:19:01.803946 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.803906    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-745d49b47b-s9nxb"]
Sep 08 13:19:01.804628 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.804606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-7nvg8"]
Sep 08 13:19:01.813606 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.813582    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"]
Sep 08 13:19:01.826737 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c51ea82-954f-4b15-8f62-726cfa40806b-config\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.826839 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c51ea82-954f-4b15-8f62-726cfa40806b-trusted-ca\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.826839 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda41fa2-ec43-44bd-b99c-26839106c353-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.826839 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826783    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-default-certificate\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.826956 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda41fa2-ec43-44bd-b99c-26839106c353-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.826956 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826914    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.826956 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-stats-auth\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.827080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.826968    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c51ea82-954f-4b15-8f62-726cfa40806b-serving-cert\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.827080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k47xt\" (UniqueName: \"kubernetes.io/projected/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-kube-api-access-k47xt\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.827080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:01.827080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e898303-3e30-4691-b769-e4b45a70d80d-nginx-conf\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:01.827267 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:01.827154    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:19:01.827267 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fda41fa2-ec43-44bd-b99c-26839106c353-tmp\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827267 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:01.827227    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert podName:6e898303-3e30-4691-b769-e4b45a70d80d nodeName:}" failed. No retries permitted until 2026-09-08 13:19:02.327206734 +0000 UTC m=+148.311407525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d59lb" (UID: "6e898303-3e30-4691-b769-e4b45a70d80d") : secret "networking-console-plugin-cert" not found
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwsx\" (UniqueName: \"kubernetes.io/projected/2c51ea82-954f-4b15-8f62-726cfa40806b-kube-api-access-cnwsx\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827309    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdhj\" (UniqueName: \"kubernetes.io/projected/fda41fa2-ec43-44bd-b99c-26839106c353-kube-api-access-fsdhj\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fda41fa2-ec43-44bd-b99c-26839106c353-snapshots\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda41fa2-ec43-44bd-b99c-26839106c353-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fda41fa2-ec43-44bd-b99c-26839106c353-serving-cert\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827428 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827417    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x72pf\" (UniqueName: \"kubernetes.io/projected/2aac9f15-b5c1-45cc-a64f-1569cd662464-kube-api-access-x72pf\") pod \"volume-data-source-validator-695c895bd6-r4cwb\" (UID: \"2aac9f15-b5c1-45cc-a64f-1569cd662464\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"
Sep 08 13:19:01.827705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fda41fa2-ec43-44bd-b99c-26839106c353-tmp\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fda41fa2-ec43-44bd-b99c-26839106c353-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.827767 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6e898303-3e30-4691-b769-e4b45a70d80d-nginx-conf\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:01.827898 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.827880    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fda41fa2-ec43-44bd-b99c-26839106c353-snapshots\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.829710 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.829689    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fda41fa2-ec43-44bd-b99c-26839106c353-serving-cert\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.838649 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.838623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdhj\" (UniqueName: \"kubernetes.io/projected/fda41fa2-ec43-44bd-b99c-26839106c353-kube-api-access-fsdhj\") pod \"insights-operator-76bcd6ccf5-kjmxs\" (UID: \"fda41fa2-ec43-44bd-b99c-26839106c353\") " pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:01.928175 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c51ea82-954f-4b15-8f62-726cfa40806b-serving-cert\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.928175 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928123    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k47xt\" (UniqueName: \"kubernetes.io/projected/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-kube-api-access-k47xt\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.928397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwsx\" (UniqueName: \"kubernetes.io/projected/2c51ea82-954f-4b15-8f62-726cfa40806b-kube-api-access-cnwsx\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.928397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.928397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928326    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x72pf\" (UniqueName: \"kubernetes.io/projected/2aac9f15-b5c1-45cc-a64f-1569cd662464-kube-api-access-x72pf\") pod \"volume-data-source-validator-695c895bd6-r4cwb\" (UID: \"2aac9f15-b5c1-45cc-a64f-1569cd662464\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"
Sep 08 13:19:01.928397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c51ea82-954f-4b15-8f62-726cfa40806b-config\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.928397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c51ea82-954f-4b15-8f62-726cfa40806b-trusted-ca\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.928678 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-default-certificate\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.928678 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:01.928476    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:02.428452138 +0000 UTC m=+148.412652984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : configmap references non-existent config key: service-ca.crt
Sep 08 13:19:01.928678 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.928678 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.928579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-stats-auth\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.928678 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:01.928657    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:19:01.928878 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:01.928728    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:02.428709936 +0000 UTC m=+148.412910714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : secret "router-metrics-certs-default" not found
Sep 08 13:19:01.929267 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.929235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c51ea82-954f-4b15-8f62-726cfa40806b-config\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.929375 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.929302    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2c51ea82-954f-4b15-8f62-726cfa40806b-trusted-ca\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.930643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.930618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c51ea82-954f-4b15-8f62-726cfa40806b-serving-cert\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.930854 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.930837    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-default-certificate\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.930898 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.930865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-stats-auth\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.937024 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.937005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwsx\" (UniqueName: \"kubernetes.io/projected/2c51ea82-954f-4b15-8f62-726cfa40806b-kube-api-access-cnwsx\") pod \"console-operator-85b454874b-7nvg8\" (UID: \"2c51ea82-954f-4b15-8f62-726cfa40806b\") " pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:01.937100 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.937083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k47xt\" (UniqueName: \"kubernetes.io/projected/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-kube-api-access-k47xt\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:01.937418 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.937396    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x72pf\" (UniqueName: \"kubernetes.io/projected/2aac9f15-b5c1-45cc-a64f-1569cd662464-kube-api-access-x72pf\") pod \"volume-data-source-validator-695c895bd6-r4cwb\" (UID: \"2aac9f15-b5c1-45cc-a64f-1569cd662464\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"
Sep 08 13:19:01.983692 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:01.983656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs"
Sep 08 13:19:02.072882 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.072844    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"
Sep 08 13:19:02.080101 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.080075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:02.251274 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.251239    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-kjmxs"]
Sep 08 13:19:02.254601 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:02.254575    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda41fa2_ec43_44bd_b99c_26839106c353.slice/crio-813daf2521c8f1ca4fc62993a5a17cd600176c0489f60ed1a9ff41b6f269e95b WatchSource:0}: Error finding container 813daf2521c8f1ca4fc62993a5a17cd600176c0489f60ed1a9ff41b6f269e95b: Status 404 returned error can't find the container with id 813daf2521c8f1ca4fc62993a5a17cd600176c0489f60ed1a9ff41b6f269e95b
Sep 08 13:19:02.331831 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.331800    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:02.331980 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:02.331955    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:19:02.332029 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:02.332017    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert podName:6e898303-3e30-4691-b769-e4b45a70d80d nodeName:}" failed. No retries permitted until 2026-09-08 13:19:03.331999887 +0000 UTC m=+149.316200679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d59lb" (UID: "6e898303-3e30-4691-b769-e4b45a70d80d") : secret "networking-console-plugin-cert" not found
Sep 08 13:19:02.344058 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.344033    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb"]
Sep 08 13:19:02.346780 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.346753    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-7nvg8"]
Sep 08 13:19:02.347088 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:02.347068    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aac9f15_b5c1_45cc_a64f_1569cd662464.slice/crio-7ce48825c67a040bb0772c12a0e977664b0ed83eecc30fc25f57a8f4fbb3de76 WatchSource:0}: Error finding container 7ce48825c67a040bb0772c12a0e977664b0ed83eecc30fc25f57a8f4fbb3de76: Status 404 returned error can't find the container with id 7ce48825c67a040bb0772c12a0e977664b0ed83eecc30fc25f57a8f4fbb3de76
Sep 08 13:19:02.349585 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:02.349565    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c51ea82_954f_4b15_8f62_726cfa40806b.slice/crio-72a8cbb1ef15e21031b3220821ec9fd0fe653c1ef2285978ba732b5b73e8ab27 WatchSource:0}: Error finding container 72a8cbb1ef15e21031b3220821ec9fd0fe653c1ef2285978ba732b5b73e8ab27: Status 404 returned error can't find the container with id 72a8cbb1ef15e21031b3220821ec9fd0fe653c1ef2285978ba732b5b73e8ab27
Sep 08 13:19:02.433071 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.433024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:02.433237 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.433113    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:02.433237 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:02.433178    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:19:02.433237 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:02.433230    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:03.433217722 +0000 UTC m=+149.417418497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : configmap references non-existent config key: service-ca.crt
Sep 08 13:19:02.433343 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:02.433247    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:03.433239936 +0000 UTC m=+149.417440712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : secret "router-metrics-certs-default" not found
Sep 08 13:19:02.940009 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.939976    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" event={"ID":"2c51ea82-954f-4b15-8f62-726cfa40806b","Type":"ContainerStarted","Data":"72a8cbb1ef15e21031b3220821ec9fd0fe653c1ef2285978ba732b5b73e8ab27"}
Sep 08 13:19:02.941061 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.941037    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs" event={"ID":"fda41fa2-ec43-44bd-b99c-26839106c353","Type":"ContainerStarted","Data":"813daf2521c8f1ca4fc62993a5a17cd600176c0489f60ed1a9ff41b6f269e95b"}
Sep 08 13:19:02.942068 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:02.942047    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb" event={"ID":"2aac9f15-b5c1-45cc-a64f-1569cd662464","Type":"ContainerStarted","Data":"7ce48825c67a040bb0772c12a0e977664b0ed83eecc30fc25f57a8f4fbb3de76"}
Sep 08 13:19:03.340904 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:03.340862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:03.341094 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:03.341021    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:19:03.341143 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:03.341096    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert podName:6e898303-3e30-4691-b769-e4b45a70d80d nodeName:}" failed. No retries permitted until 2026-09-08 13:19:05.341077197 +0000 UTC m=+151.325277987 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d59lb" (UID: "6e898303-3e30-4691-b769-e4b45a70d80d") : secret "networking-console-plugin-cert" not found
Sep 08 13:19:03.442037 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:03.441999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:03.442224 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:03.442117    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:03.442295 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:03.442254    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:05.442235478 +0000 UTC m=+151.426436259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : configmap references non-existent config key: service-ca.crt
Sep 08 13:19:03.442393 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:03.442363    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:19:03.442513 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:03.442440    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:05.442420841 +0000 UTC m=+151.426621632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : secret "router-metrics-certs-default" not found
Sep 08 13:19:05.357478 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.357389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:05.357944 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:05.357500    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:19:05.357944 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:05.357580    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert podName:6e898303-3e30-4691-b769-e4b45a70d80d nodeName:}" failed. No retries permitted until 2026-09-08 13:19:09.357564135 +0000 UTC m=+155.341764931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d59lb" (UID: "6e898303-3e30-4691-b769-e4b45a70d80d") : secret "networking-console-plugin-cert" not found
Sep 08 13:19:05.458411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.458365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:05.458595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.458474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:05.458595 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:05.458542    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:09.45850926 +0000 UTC m=+155.442710054 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : configmap references non-existent config key: service-ca.crt
Sep 08 13:19:05.458673 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:05.458596    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:19:05.458673 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:05.458641    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:09.458628146 +0000 UTC m=+155.442828921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : secret "router-metrics-certs-default" not found
Sep 08 13:19:05.954204 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.954163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb" event={"ID":"2aac9f15-b5c1-45cc-a64f-1569cd662464","Type":"ContainerStarted","Data":"ee7a2d65b90ffed73aa6ffa1d919e8307c619b4fe0fed15cb4107eb60ff34a03"}
Sep 08 13:19:05.955711 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.955689    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/0.log"
Sep 08 13:19:05.955827 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.955725    2557 generic.go:356] "Generic (PLEG): container finished" podID="2c51ea82-954f-4b15-8f62-726cfa40806b" containerID="0c074a5d9742d22353021e32ab8b4c927c6b8b812e21c013781f840be2c384c8" exitCode=255
Sep 08 13:19:05.955874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.955820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" event={"ID":"2c51ea82-954f-4b15-8f62-726cfa40806b","Type":"ContainerDied","Data":"0c074a5d9742d22353021e32ab8b4c927c6b8b812e21c013781f840be2c384c8"}
Sep 08 13:19:05.955970 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.955957    2557 scope.go:117] "RemoveContainer" containerID="0c074a5d9742d22353021e32ab8b4c927c6b8b812e21c013781f840be2c384c8"
Sep 08 13:19:05.957305 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.957281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs" event={"ID":"fda41fa2-ec43-44bd-b99c-26839106c353","Type":"ContainerStarted","Data":"1ee3c03c3729dbdc5a316368ee0fd853c2e3fb07f54dae66ed9e757b0ab7de63"}
Sep 08 13:19:05.970649 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.970601    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-r4cwb" podStartSLOduration=2.265593506 podStartE2EDuration="4.970587444s" totalImagesPullingTime="2.704993938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:05.969724342 +0000 UTC m=+151.953925138" watchObservedRunningTime="2026-09-08 13:19:05.970587444 +0000 UTC m=+151.954788240"
Sep 08 13:19:05.991194 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:05.991150    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs" podStartSLOduration=2.195966204 podStartE2EDuration="4.991136232s" totalImagesPullingTime="2.795170028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:05.990352783 +0000 UTC m=+151.974553581" watchObservedRunningTime="2026-09-08 13:19:05.991136232 +0000 UTC m=+151.975337033"
Sep 08 13:19:06.197818 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.197782    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nrnws"]
Sep 08 13:19:06.201028 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.201003    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.203580 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.203559    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 13:19:06.203717 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.203692    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-brrfw\""
Sep 08 13:19:06.203717 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.203709    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 13:19:06.213301 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.213281    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nrnws"]
Sep 08 13:19:06.265741 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.265712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.265874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.265748    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.265874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.265823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bl2d\" (UniqueName: \"kubernetes.io/projected/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-api-access-7bl2d\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.265874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.265869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-crio-socket\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.265985 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.265948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-data-volume\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.366442 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-data-volume\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.366642    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.366688    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.366722    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:06.866699015 +0000 UTC m=+152.850899807 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366755    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-data-volume\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.366792    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:06.86677534 +0000 UTC m=+152.850976129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : configmap "kube-rbac-proxy" not found
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366828    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bl2d\" (UniqueName: \"kubernetes.io/projected/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-api-access-7bl2d\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.366895 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-crio-socket\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.367210 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.366937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-crio-socket\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.377758 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.377732    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bl2d\" (UniqueName: \"kubernetes.io/projected/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-api-access-7bl2d\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.871661 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.871623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.871661 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.871663    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:06.871863 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.871755    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:19:06.871863 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.871781    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:06.871863 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.871806    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:07.871792743 +0000 UTC m=+153.855993518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : configmap "kube-rbac-proxy" not found
Sep 08 13:19:06.871863 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.871835    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:07.871822609 +0000 UTC m=+153.856023399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:06.962795 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.962763    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/1.log"
Sep 08 13:19:06.963228 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.963212    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/0.log"
Sep 08 13:19:06.963302 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.963247    2557 generic.go:356] "Generic (PLEG): container finished" podID="2c51ea82-954f-4b15-8f62-726cfa40806b" containerID="9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b" exitCode=255
Sep 08 13:19:06.963302 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.963287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" event={"ID":"2c51ea82-954f-4b15-8f62-726cfa40806b","Type":"ContainerDied","Data":"9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b"}
Sep 08 13:19:06.963385 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.963362    2557 scope.go:117] "RemoveContainer" containerID="0c074a5d9742d22353021e32ab8b4c927c6b8b812e21c013781f840be2c384c8"
Sep 08 13:19:06.963613 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:06.963592    2557 scope.go:117] "RemoveContainer" containerID="9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b"
Sep 08 13:19:06.963803 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:06.963783    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-7nvg8_openshift-console-operator(2c51ea82-954f-4b15-8f62-726cfa40806b)\"" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podUID="2c51ea82-954f-4b15-8f62-726cfa40806b"
Sep 08 13:19:07.879805 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:07.879755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:07.879805 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:07.879809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:07.880244 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:07.879914    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:19:07.880244 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:07.879918    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:07.880244 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:07.879969    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:09.87995565 +0000 UTC m=+155.864156425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : configmap "kube-rbac-proxy" not found
Sep 08 13:19:07.880244 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:07.879982    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:09.879976418 +0000 UTC m=+155.864177192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:07.967314 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:07.967285    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/1.log"
Sep 08 13:19:07.967645 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:07.967629    2557 scope.go:117] "RemoveContainer" containerID="9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b"
Sep 08 13:19:07.967798 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:07.967778    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-7nvg8_openshift-console-operator(2c51ea82-954f-4b15-8f62-726cfa40806b)\"" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podUID="2c51ea82-954f-4b15-8f62-726cfa40806b"
Sep 08 13:19:08.333165 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:08.333131    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb2bf_76910f97-dbe6-443e-9667-ecf5cd273c6c/dns-node-resolver/0.log"
Sep 08 13:19:09.133222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.133191    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kj8dv_aa082cbb-38d0-4bfa-94ef-2e621f2cd695/node-ca/0.log"
Sep 08 13:19:09.390832 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.390749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:09.390982 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.390857    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:19:09.390982 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.390909    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert podName:6e898303-3e30-4691-b769-e4b45a70d80d nodeName:}" failed. No retries permitted until 2026-09-08 13:19:17.390895906 +0000 UTC m=+163.375096681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d59lb" (UID: "6e898303-3e30-4691-b769-e4b45a70d80d") : secret "networking-console-plugin-cert" not found
Sep 08 13:19:09.491910 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.491874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:09.492066 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.491955    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:09.492066 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.492028    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 13:19:09.492139 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.492084    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:17.492067605 +0000 UTC m=+163.476268397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : secret "router-metrics-certs-default" not found
Sep 08 13:19:09.492139 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.492097    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:17.492091278 +0000 UTC m=+163.476292058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : configmap references non-existent config key: service-ca.crt
Sep 08 13:19:09.733851 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.733816    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fdc92_ee5b509f-dd85-422e-b31b-b9b1bd569184/serve-healthcheck-canary/0.log"
Sep 08 13:19:09.895422 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.895391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:09.895585 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:09.895427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:09.895585 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.895503    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:19:09.895585 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.895551    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:09.895585 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.895565    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:13.895552643 +0000 UTC m=+159.879753417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : configmap "kube-rbac-proxy" not found
Sep 08 13:19:09.895738 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:09.895603    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:13.895591199 +0000 UTC m=+159.879791973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:11.426620 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:11.426575    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nqf7p" podUID="b4df4e94-a39c-4bc8-a71d-6c16ada47713"
Sep 08 13:19:11.509631 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:11.509593    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2p4wh" podUID="661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb"
Sep 08 13:19:11.978202 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:11.978170    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:19:12.081042 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:12.080999    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:12.081233 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:12.081100    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:12.081489 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:12.081473    2557 scope.go:117] "RemoveContainer" containerID="9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b"
Sep 08 13:19:12.081708 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:12.081685    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-7nvg8_openshift-console-operator(2c51ea82-954f-4b15-8f62-726cfa40806b)\"" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podUID="2c51ea82-954f-4b15-8f62-726cfa40806b"
Sep 08 13:19:13.933805 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:13.933770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:13.933805 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:13.933809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:13.934230 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:13.933922    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:13.934230 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:13.933953    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 13:19:13.934230 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:13.933996    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:21.933980735 +0000 UTC m=+167.918181514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:13.934230 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:13.934010    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:21.934003423 +0000 UTC m=+167.918204201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : configmap "kube-rbac-proxy" not found
Sep 08 13:19:16.354011 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:16.353973    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:19:16.356248 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:16.356223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4df4e94-a39c-4bc8-a71d-6c16ada47713-metrics-tls\") pod \"dns-default-nqf7p\" (UID: \"b4df4e94-a39c-4bc8-a71d-6c16ada47713\") " pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:19:16.481757 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:16.481724    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6zj7\""
Sep 08 13:19:16.489738 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:16.489719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:19:16.758231 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:16.758202    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nqf7p"]
Sep 08 13:19:16.761454 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:16.761432    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4df4e94_a39c_4bc8_a71d_6c16ada47713.slice/crio-263ab8e6a39b501d312f66ee1f646d97eca2e867631528822d287c35043fb8b4 WatchSource:0}: Error finding container 263ab8e6a39b501d312f66ee1f646d97eca2e867631528822d287c35043fb8b4: Status 404 returned error can't find the container with id 263ab8e6a39b501d312f66ee1f646d97eca2e867631528822d287c35043fb8b4
Sep 08 13:19:16.994312 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:16.994279    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqf7p" event={"ID":"b4df4e94-a39c-4bc8-a71d-6c16ada47713","Type":"ContainerStarted","Data":"263ab8e6a39b501d312f66ee1f646d97eca2e867631528822d287c35043fb8b4"}
Sep 08 13:19:17.463585 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:17.463544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:17.464009 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:17.463699    2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 13:19:17.464009 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:17.463763    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert podName:6e898303-3e30-4691-b769-e4b45a70d80d nodeName:}" failed. No retries permitted until 2026-09-08 13:19:33.463746714 +0000 UTC m=+179.447947506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-d59lb" (UID: "6e898303-3e30-4691-b769-e4b45a70d80d") : secret "networking-console-plugin-cert" not found
Sep 08 13:19:17.564565 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:17.564515    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:17.564733 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:17.564642    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:17.564733 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:17.564706    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle podName:d8fbe9fd-5644-4ea9-86d1-9bbdc106d983 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:33.564684628 +0000 UTC m=+179.548885420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle") pod "router-default-745d49b47b-s9nxb" (UID: "d8fbe9fd-5644-4ea9-86d1-9bbdc106d983") : configmap references non-existent config key: service-ca.crt
Sep 08 13:19:17.567163 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:17.567138    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-metrics-certs\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:19.003287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:19.003255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqf7p" event={"ID":"b4df4e94-a39c-4bc8-a71d-6c16ada47713","Type":"ContainerStarted","Data":"ba1b9f4c0c7430f0c9f415885a4e98b149228f75b48119cd3b4c1b17f2e63ab2"}
Sep 08 13:19:19.003759 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:19.003310    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nqf7p" event={"ID":"b4df4e94-a39c-4bc8-a71d-6c16ada47713","Type":"ContainerStarted","Data":"08ec227eadd15b1f398486ec0fec4043ff4d9f0eb588676d764eed101b571d4e"}
Sep 08 13:19:19.003759 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:19.003340    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:19:19.022304 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:19.022261    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nqf7p" podStartSLOduration=129.367985902 podStartE2EDuration="2m11.022247625s" totalImagesPullingTime="1.654261723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:19.021471705 +0000 UTC m=+165.005672496" watchObservedRunningTime="2026-09-08 13:19:19.022247625 +0000 UTC m=+165.006448422"
Sep 08 13:19:21.999940 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:21.999894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:21.999940 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:21.999944    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:22.000483 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:22.000052    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:22.000483 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:22.000117    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls podName:daaf83ce-6d45-48fb-9365-b4fa89b32bf9 nodeName:}" failed. No retries permitted until 2026-09-08 13:19:38.000101316 +0000 UTC m=+183.984302112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nrnws" (UID: "daaf83ce-6d45-48fb-9365-b4fa89b32bf9") : secret "insights-runtime-extractor-tls" not found
Sep 08 13:19:22.000638 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:22.000585    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:22.491362 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:22.491322    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:19:25.491693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:25.491660    2557 scope.go:117] "RemoveContainer" containerID="9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b"
Sep 08 13:19:26.027372 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:26.027345    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:19:26.027707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:26.027692    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/1.log"
Sep 08 13:19:26.027772 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:26.027725    2557 generic.go:356] "Generic (PLEG): container finished" podID="2c51ea82-954f-4b15-8f62-726cfa40806b" containerID="392cfa8dbf65a29466fc29df4fef40a20a29a8e920e190405f078b819cb09469" exitCode=255
Sep 08 13:19:26.027810 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:26.027783    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" event={"ID":"2c51ea82-954f-4b15-8f62-726cfa40806b","Type":"ContainerDied","Data":"392cfa8dbf65a29466fc29df4fef40a20a29a8e920e190405f078b819cb09469"}
Sep 08 13:19:26.027844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:26.027824    2557 scope.go:117] "RemoveContainer" containerID="9be2b95a893cd7998702a7c771ba8f8f89411e527ebe1544b97c97885df3ea8b"
Sep 08 13:19:26.028146 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:26.028125    2557 scope.go:117] "RemoveContainer" containerID="392cfa8dbf65a29466fc29df4fef40a20a29a8e920e190405f078b819cb09469"
Sep 08 13:19:26.028329 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:26.028306    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-7nvg8_openshift-console-operator(2c51ea82-954f-4b15-8f62-726cfa40806b)\"" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podUID="2c51ea82-954f-4b15-8f62-726cfa40806b"
Sep 08 13:19:27.031657 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:27.031576    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:19:29.008628 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:29.008595    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nqf7p"
Sep 08 13:19:32.081115 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:32.081071    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:32.081585 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:32.081141    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:32.081585 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:32.081485    2557 scope.go:117] "RemoveContainer" containerID="392cfa8dbf65a29466fc29df4fef40a20a29a8e920e190405f078b819cb09469"
Sep 08 13:19:32.081733 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:32.081693    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-7nvg8_openshift-console-operator(2c51ea82-954f-4b15-8f62-726cfa40806b)\"" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podUID="2c51ea82-954f-4b15-8f62-726cfa40806b"
Sep 08 13:19:33.395560 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.395517    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c4849dc75-lgtxg"]
Sep 08 13:19:33.399404 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.399389    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.401716 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.401694    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 13:19:33.401931 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.401908    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s2n2x\""
Sep 08 13:19:33.402018 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.401935    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 13:19:33.402076 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.402016    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 13:19:33.407304 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.407281    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 13:19:33.420049 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.420019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c4849dc75-lgtxg"]
Sep 08 13:19:33.485778 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.485747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcd75\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-kube-api-access-rcd75\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.485944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.485784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-registry-tls\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.485944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.485815    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c88ed404-a453-4bd2-a33f-28bdff99f398-image-registry-private-configuration\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.485944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.485888    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:33.485944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.485928    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c88ed404-a453-4bd2-a33f-28bdff99f398-ca-trust-extracted\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.486127 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.485958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c88ed404-a453-4bd2-a33f-28bdff99f398-trusted-ca\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.486127 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.486010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c88ed404-a453-4bd2-a33f-28bdff99f398-registry-certificates\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.486127 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.486067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c88ed404-a453-4bd2-a33f-28bdff99f398-installation-pull-secrets\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.486127 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.486104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-bound-sa-token\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.488120 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.488100    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e898303-3e30-4691-b769-e4b45a70d80d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-d59lb\" (UID: \"6e898303-3e30-4691-b769-e4b45a70d80d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:33.586653 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-registry-tls\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.586823 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c88ed404-a453-4bd2-a33f-28bdff99f398-image-registry-private-configuration\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.586823 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586695    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c88ed404-a453-4bd2-a33f-28bdff99f398-ca-trust-extracted\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.586938 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c88ed404-a453-4bd2-a33f-28bdff99f398-trusted-ca\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.586938 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:33.587042 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586945    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c88ed404-a453-4bd2-a33f-28bdff99f398-registry-certificates\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.587042 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c88ed404-a453-4bd2-a33f-28bdff99f398-installation-pull-secrets\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.587042 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.586994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c88ed404-a453-4bd2-a33f-28bdff99f398-ca-trust-extracted\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.587042 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.587001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-bound-sa-token\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.587249 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.587051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcd75\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-kube-api-access-rcd75\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.587666 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.587640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8fbe9fd-5644-4ea9-86d1-9bbdc106d983-service-ca-bundle\") pod \"router-default-745d49b47b-s9nxb\" (UID: \"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983\") " pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:33.587870 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.587851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c88ed404-a453-4bd2-a33f-28bdff99f398-registry-certificates\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.587952 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.587894    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c88ed404-a453-4bd2-a33f-28bdff99f398-trusted-ca\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.589377 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.589350    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c88ed404-a453-4bd2-a33f-28bdff99f398-installation-pull-secrets\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.589377 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.589371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c88ed404-a453-4bd2-a33f-28bdff99f398-image-registry-private-configuration\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.589513 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.589422    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-registry-tls\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.598795 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.598777    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-bound-sa-token\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.598972 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.598956    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcd75\" (UniqueName: \"kubernetes.io/projected/c88ed404-a453-4bd2-a33f-28bdff99f398-kube-api-access-rcd75\") pod \"image-registry-7c4849dc75-lgtxg\" (UID: \"c88ed404-a453-4bd2-a33f-28bdff99f398\") " pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.708841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.708812    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:33.787944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.787910    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb"
Sep 08 13:19:33.885918 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.885890    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:33.980643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:33.980622    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c4849dc75-lgtxg"]
Sep 08 13:19:33.984166 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:33.984144    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88ed404_a453_4bd2_a33f_28bdff99f398.slice/crio-5a5f39255a1c62b4306a1120e00c4b102a7de2b6d275239cdf602209c1f1ed04 WatchSource:0}: Error finding container 5a5f39255a1c62b4306a1120e00c4b102a7de2b6d275239cdf602209c1f1ed04: Status 404 returned error can't find the container with id 5a5f39255a1c62b4306a1120e00c4b102a7de2b6d275239cdf602209c1f1ed04
Sep 08 13:19:34.052876 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:34.052852    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-d59lb"]
Sep 08 13:19:34.053574 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:34.053551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg" event={"ID":"c88ed404-a453-4bd2-a33f-28bdff99f398","Type":"ContainerStarted","Data":"5a5f39255a1c62b4306a1120e00c4b102a7de2b6d275239cdf602209c1f1ed04"}
Sep 08 13:19:34.058430 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:34.058408    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e898303_3e30_4691_b769_e4b45a70d80d.slice/crio-8a435cce5a439858ec5f86662cc1ad6dadac437fb040211bd9549f745b7b346f WatchSource:0}: Error finding container 8a435cce5a439858ec5f86662cc1ad6dadac437fb040211bd9549f745b7b346f: Status 404 returned error can't find the container with id 8a435cce5a439858ec5f86662cc1ad6dadac437fb040211bd9549f745b7b346f
Sep 08 13:19:34.175923 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:34.175893    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-745d49b47b-s9nxb"]
Sep 08 13:19:34.179547 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:34.179495    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fbe9fd_5644_4ea9_86d1_9bbdc106d983.slice/crio-333f18e90c82ec41aa9f56108d078a81e261f68057012ae0178cdba9f07c012e WatchSource:0}: Error finding container 333f18e90c82ec41aa9f56108d078a81e261f68057012ae0178cdba9f07c012e: Status 404 returned error can't find the container with id 333f18e90c82ec41aa9f56108d078a81e261f68057012ae0178cdba9f07c012e
Sep 08 13:19:35.057514 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.057476    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-745d49b47b-s9nxb" event={"ID":"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983","Type":"ContainerStarted","Data":"4566a8f56918dea1f7f2176fcdce0e5344c750b09999e5361b690008c95360fe"}
Sep 08 13:19:35.057949 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.057544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-745d49b47b-s9nxb" event={"ID":"d8fbe9fd-5644-4ea9-86d1-9bbdc106d983","Type":"ContainerStarted","Data":"333f18e90c82ec41aa9f56108d078a81e261f68057012ae0178cdba9f07c012e"}
Sep 08 13:19:35.058938 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.058913    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg" event={"ID":"c88ed404-a453-4bd2-a33f-28bdff99f398","Type":"ContainerStarted","Data":"04218a724672240043885b0336fe585625daf99d5b829300dea42e004239bcbe"}
Sep 08 13:19:35.059027 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.058956    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:35.060051 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.060032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb" event={"ID":"6e898303-3e30-4691-b769-e4b45a70d80d","Type":"ContainerStarted","Data":"8a435cce5a439858ec5f86662cc1ad6dadac437fb040211bd9549f745b7b346f"}
Sep 08 13:19:35.081927 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.081876    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-745d49b47b-s9nxb" podStartSLOduration=34.081861989 podStartE2EDuration="34.081861989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:35.080248496 +0000 UTC m=+181.064449294" watchObservedRunningTime="2026-09-08 13:19:35.081861989 +0000 UTC m=+181.066062786"
Sep 08 13:19:35.104442 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.104400    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg" podStartSLOduration=2.104387161 podStartE2EDuration="2.104387161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:35.103281983 +0000 UTC m=+181.087482781" watchObservedRunningTime="2026-09-08 13:19:35.104387161 +0000 UTC m=+181.088587957"
Sep 08 13:19:35.887019 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.886977    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:35.889319 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:35.889296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:36.063411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:36.063382    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:36.064627 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:36.064605    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-745d49b47b-s9nxb"
Sep 08 13:19:38.021103 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.021065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:38.023386 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.023361    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daaf83ce-6d45-48fb-9365-b4fa89b32bf9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nrnws\" (UID: \"daaf83ce-6d45-48fb-9365-b4fa89b32bf9\") " pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:38.071351 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.071312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb" event={"ID":"6e898303-3e30-4691-b769-e4b45a70d80d","Type":"ContainerStarted","Data":"6a3b6da0e0203fc1ca53c75e59f75e469b14f9efaeefe91c29813f3fe51285e9"}
Sep 08 13:19:38.089891 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.089839    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-d59lb" podStartSLOduration=33.814843591 podStartE2EDuration="37.089826179s" totalImagesPullingTime="3.274982588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:38.088832926 +0000 UTC m=+184.073033722" watchObservedRunningTime="2026-09-08 13:19:38.089826179 +0000 UTC m=+184.074027037"
Sep 08 13:19:38.312309 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.312218    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-brrfw\""
Sep 08 13:19:38.320154 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.320123    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nrnws"
Sep 08 13:19:38.595159 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:38.595089    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nrnws"]
Sep 08 13:19:38.598333 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:38.598306    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaaf83ce_6d45_48fb_9365_b4fa89b32bf9.slice/crio-361915a0d472c330bf8e2ebfcd278f533e1c11dcac20b93ef48f8b9f3cf451d5 WatchSource:0}: Error finding container 361915a0d472c330bf8e2ebfcd278f533e1c11dcac20b93ef48f8b9f3cf451d5: Status 404 returned error can't find the container with id 361915a0d472c330bf8e2ebfcd278f533e1c11dcac20b93ef48f8b9f3cf451d5
Sep 08 13:19:39.076138 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:39.076103    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrnws" event={"ID":"daaf83ce-6d45-48fb-9365-b4fa89b32bf9","Type":"ContainerStarted","Data":"cc715208152c33a344d1ecf04b5850607bd904cfd5cb68cb1cae962599d1ae7b"}
Sep 08 13:19:39.076480 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:39.076163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrnws" event={"ID":"daaf83ce-6d45-48fb-9365-b4fa89b32bf9","Type":"ContainerStarted","Data":"361915a0d472c330bf8e2ebfcd278f533e1c11dcac20b93ef48f8b9f3cf451d5"}
Sep 08 13:19:41.085042 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.084990    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrnws" event={"ID":"daaf83ce-6d45-48fb-9365-b4fa89b32bf9","Type":"ContainerStarted","Data":"37c1e85cae9e20ff348a935714d74722ba6bc74978f193cdf50ee25c45986616"}
Sep 08 13:19:41.876460 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.876433    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"]
Sep 08 13:19:41.879346 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.879328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:41.882223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.882082    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-72b47\""
Sep 08 13:19:41.882223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.882094    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 13:19:41.882223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.882130    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 13:19:41.882223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.882162    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 13:19:41.882223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.882095    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 13:19:41.882223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.882206    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 13:19:41.889198 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.889178    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"]
Sep 08 13:19:41.950347 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.950323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57605426-96ca-48ba-921b-a3e6ed3bc248-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:41.950463 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.950362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57605426-96ca-48ba-921b-a3e6ed3bc248-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:41.950463 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.950418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57605426-96ca-48ba-921b-a3e6ed3bc248-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:41.950558 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:41.950475    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh9lm\" (UniqueName: \"kubernetes.io/projected/57605426-96ca-48ba-921b-a3e6ed3bc248-kube-api-access-qh9lm\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.051796 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.051750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57605426-96ca-48ba-921b-a3e6ed3bc248-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.051960 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.051826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh9lm\" (UniqueName: \"kubernetes.io/projected/57605426-96ca-48ba-921b-a3e6ed3bc248-kube-api-access-qh9lm\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.051960 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.051860    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57605426-96ca-48ba-921b-a3e6ed3bc248-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.051960 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.051895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57605426-96ca-48ba-921b-a3e6ed3bc248-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.052603 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.052583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57605426-96ca-48ba-921b-a3e6ed3bc248-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.054143 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.054119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57605426-96ca-48ba-921b-a3e6ed3bc248-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.054221 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.054121    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/57605426-96ca-48ba-921b-a3e6ed3bc248-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.060694 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.060674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh9lm\" (UniqueName: \"kubernetes.io/projected/57605426-96ca-48ba-921b-a3e6ed3bc248-kube-api-access-qh9lm\") pod \"prometheus-operator-6f4946db56-kbw7r\" (UID: \"57605426-96ca-48ba-921b-a3e6ed3bc248\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.090001 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.089934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nrnws" event={"ID":"daaf83ce-6d45-48fb-9365-b4fa89b32bf9","Type":"ContainerStarted","Data":"c645e09291ed4b8b1bb6bf681b9f446214fc0d27df844bb832015f1d960930b4"}
Sep 08 13:19:42.108799 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.108760    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nrnws" podStartSLOduration=32.994444429 podStartE2EDuration="36.108746207s" totalImagesPullingTime="3.114301778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 13:19:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:42.107916641 +0000 UTC m=+188.092117435" watchObservedRunningTime="2026-09-08 13:19:42.108746207 +0000 UTC m=+188.092947012"
Sep 08 13:19:42.190097 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.190063    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"
Sep 08 13:19:42.457672 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:42.457637    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-kbw7r"]
Sep 08 13:19:42.460223 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:42.460193    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57605426_96ca_48ba_921b_a3e6ed3bc248.slice/crio-087dd84aec3b9420490d856ddec6c2fe20974dc96e3b09e23abbf86a95f1c550 WatchSource:0}: Error finding container 087dd84aec3b9420490d856ddec6c2fe20974dc96e3b09e23abbf86a95f1c550: Status 404 returned error can't find the container with id 087dd84aec3b9420490d856ddec6c2fe20974dc96e3b09e23abbf86a95f1c550
Sep 08 13:19:43.094163 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:43.094127    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r" event={"ID":"57605426-96ca-48ba-921b-a3e6ed3bc248","Type":"ContainerStarted","Data":"087dd84aec3b9420490d856ddec6c2fe20974dc96e3b09e23abbf86a95f1c550"}
Sep 08 13:19:43.490922 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:43.490895    2557 scope.go:117] "RemoveContainer" containerID="392cfa8dbf65a29466fc29df4fef40a20a29a8e920e190405f078b819cb09469"
Sep 08 13:19:43.491143 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:19:43.491114    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-7nvg8_openshift-console-operator(2c51ea82-954f-4b15-8f62-726cfa40806b)\"" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podUID="2c51ea82-954f-4b15-8f62-726cfa40806b"
Sep 08 13:19:45.102111 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:45.102072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r" event={"ID":"57605426-96ca-48ba-921b-a3e6ed3bc248","Type":"ContainerStarted","Data":"1779e0cb8c7d2bfa73c52b94085336f34d09459257fc998ba6dbb58e928cc5ee"}
Sep 08 13:19:45.102560 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:45.102158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r" event={"ID":"57605426-96ca-48ba-921b-a3e6ed3bc248","Type":"ContainerStarted","Data":"5c642a8537cc792a6e4048d82ffc2d9975fe21cec6c446d98a37e73b8948a401"}
Sep 08 13:19:45.118841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:45.118798    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-kbw7r" podStartSLOduration=2.448998736 podStartE2EDuration="4.118785035s" totalImagesPullingTime="1.669786299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:45.118731074 +0000 UTC m=+191.102931870" watchObservedRunningTime="2026-09-08 13:19:45.118785035 +0000 UTC m=+191.102985832"
Sep 08 13:19:47.310183 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.310154    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vltmx"]
Sep 08 13:19:47.313603 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.313586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.316008 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.315984    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 13:19:47.316242 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.316226    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 13:19:47.316317 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.316252    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 13:19:47.316317 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.316252    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jflq8\""
Sep 08 13:19:47.395621 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-root\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395780 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/439c09d3-0ed4-4d4d-90d5-93514edb16e5-metrics-client-ca\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395780 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-tls\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395780 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-sys\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395780 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-textfile\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395797    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf9mw\" (UniqueName: \"kubernetes.io/projected/439c09d3-0ed4-4d4d-90d5-93514edb16e5-kube-api-access-jf9mw\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395824    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-wtmp\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.395982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.395895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496734 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/439c09d3-0ed4-4d4d-90d5-93514edb16e5-metrics-client-ca\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496748    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-tls\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496768    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-sys\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-textfile\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf9mw\" (UniqueName: \"kubernetes.io/projected/439c09d3-0ed4-4d4d-90d5-93514edb16e5-kube-api-access-jf9mw\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-wtmp\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-sys\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.496925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.497339 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.496991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-root\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.497339 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.497006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-wtmp\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.497339 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.497139    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/439c09d3-0ed4-4d4d-90d5-93514edb16e5-root\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.497339 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.497183    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-textfile\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.497510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.497385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.497510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.497404    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/439c09d3-0ed4-4d4d-90d5-93514edb16e5-metrics-client-ca\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.499115 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.499096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.499177 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.499160    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/439c09d3-0ed4-4d4d-90d5-93514edb16e5-node-exporter-tls\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.506795 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.506777    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf9mw\" (UniqueName: \"kubernetes.io/projected/439c09d3-0ed4-4d4d-90d5-93514edb16e5-kube-api-access-jf9mw\") pod \"node-exporter-vltmx\" (UID: \"439c09d3-0ed4-4d4d-90d5-93514edb16e5\") " pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.622362 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:47.622285    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vltmx"
Sep 08 13:19:47.633910 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:47.633883    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439c09d3_0ed4_4d4d_90d5_93514edb16e5.slice/crio-ed0a0800e05047f559c044030bfb613ed020696dd0a1b17be56ccc90f5d53208 WatchSource:0}: Error finding container ed0a0800e05047f559c044030bfb613ed020696dd0a1b17be56ccc90f5d53208: Status 404 returned error can't find the container with id ed0a0800e05047f559c044030bfb613ed020696dd0a1b17be56ccc90f5d53208
Sep 08 13:19:48.114451 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.114413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vltmx" event={"ID":"439c09d3-0ed4-4d4d-90d5-93514edb16e5","Type":"ContainerStarted","Data":"ed0a0800e05047f559c044030bfb613ed020696dd0a1b17be56ccc90f5d53208"}
Sep 08 13:19:48.446288 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.446204    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:19:48.451217 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.451194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.454953 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.454931    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 13:19:48.455086 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455069    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 13:19:48.455145 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455099    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 13:19:48.455314 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455295    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 13:19:48.455404 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455372    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 13:19:48.455530 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455500    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 13:19:48.455608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455507    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 13:19:48.455665 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455619    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rtctq\""
Sep 08 13:19:48.455818 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455800    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 13:19:48.455958 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.455947    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 13:19:48.468535 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.468441    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:19:48.503691 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503666    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.503844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.503844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-out\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.503844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.503844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503816    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.503844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503840    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-web-config\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxm2\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-kube-api-access-ddxm2\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.503977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.504033    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.504072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.504294 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.504099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604570 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604570 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604573    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-out\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604618    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604634    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-web-config\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604650    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxm2\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-kube-api-access-ddxm2\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604738    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.604840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604827    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.605283 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.605283 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.604885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.605790 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.605761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.605984 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.605874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.606412 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.606389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.607673 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.607627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.608344 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.608301    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-web-config\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.608449 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.608379    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.608577 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.608553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.608657 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.608629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-out\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.608902 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.608882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.609109 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.609085    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.609169 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.609104    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.609248 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.609232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-volume\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.615861 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.615839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxm2\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-kube-api-access-ddxm2\") pod \"alertmanager-main-0\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:48.760629 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:48.760595    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:19:49.041104 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.040942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:19:49.043765 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:49.043738    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b3097e_0c56_4f3a_90a6_088de85a5db2.slice/crio-cc65c8942754fd16a9d207e051414b7e175a3f94dd6ddccdc31af333314c0f5a WatchSource:0}: Error finding container cc65c8942754fd16a9d207e051414b7e175a3f94dd6ddccdc31af333314c0f5a: Status 404 returned error can't find the container with id cc65c8942754fd16a9d207e051414b7e175a3f94dd6ddccdc31af333314c0f5a
Sep 08 13:19:49.119743 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.119708    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"cc65c8942754fd16a9d207e051414b7e175a3f94dd6ddccdc31af333314c0f5a"}
Sep 08 13:19:49.288626 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.288592    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"]
Sep 08 13:19:49.292568 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.292498    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.296912 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.294931    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 13:19:49.297415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.297212    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c4knosmspl2ho\""
Sep 08 13:19:49.297415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.297287    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 13:19:49.297415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.297281    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 13:19:49.297415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.297312    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 13:19:49.297415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.297344    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zrgm9\""
Sep 08 13:19:49.297415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.297212    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 13:19:49.305555 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.305534    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"]
Sep 08 13:19:49.413920 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.413890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-grpc-tls\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.413974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.414004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tc4x\" (UniqueName: \"kubernetes.io/projected/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-kube-api-access-7tc4x\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.414057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.414083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.414105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-tls\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.414125    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.414192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.414164    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-metrics-client-ca\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515295 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-tls\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515384    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-metrics-client-ca\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-grpc-tls\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.515788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.515670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tc4x\" (UniqueName: \"kubernetes.io/projected/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-kube-api-access-7tc4x\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.516907 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.516877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-metrics-client-ca\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.518932 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.518906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.519232 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.519205    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-tls\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.519333 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.519318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-grpc-tls\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.519712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.519667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.519712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.519691    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.519820 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.519791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.525047 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.525025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tc4x\" (UniqueName: \"kubernetes.io/projected/73b2fc73-81a1-4f31-b3f9-afb476de2b1f-kube-api-access-7tc4x\") pod \"thanos-querier-6b8d7b58d4-b9b5f\" (UID: \"73b2fc73-81a1-4f31-b3f9-afb476de2b1f\") " pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.606601 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.606577    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:49.935512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:49.935486    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"]
Sep 08 13:19:50.125771 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:50.125735    2557 generic.go:356] "Generic (PLEG): container finished" podID="439c09d3-0ed4-4d4d-90d5-93514edb16e5" containerID="3bfe7704129e299776f0dcbdd0b70b050705693d0d259e279344183aef7bee61" exitCode=0
Sep 08 13:19:50.125926 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:50.125810    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vltmx" event={"ID":"439c09d3-0ed4-4d4d-90d5-93514edb16e5","Type":"ContainerDied","Data":"3bfe7704129e299776f0dcbdd0b70b050705693d0d259e279344183aef7bee61"}
Sep 08 13:19:50.133988 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:50.133964    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73b2fc73_81a1_4f31_b3f9_afb476de2b1f.slice/crio-7817f63ce099fa011bce685405466f0915339e2714e4dc62c5f617b788f3e86c WatchSource:0}: Error finding container 7817f63ce099fa011bce685405466f0915339e2714e4dc62c5f617b788f3e86c: Status 404 returned error can't find the container with id 7817f63ce099fa011bce685405466f0915339e2714e4dc62c5f617b788f3e86c
Sep 08 13:19:51.134843 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:51.134806    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d" exitCode=0
Sep 08 13:19:51.135277 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:51.134892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"}
Sep 08 13:19:51.137129 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:51.137066    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vltmx" event={"ID":"439c09d3-0ed4-4d4d-90d5-93514edb16e5","Type":"ContainerStarted","Data":"05536ed87068533cd22a1803a94ac49768ae3ad57914b962c0a18d638783df13"}
Sep 08 13:19:51.137223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:51.137152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vltmx" event={"ID":"439c09d3-0ed4-4d4d-90d5-93514edb16e5","Type":"ContainerStarted","Data":"1e266bc0814c3e2f8325b4e55d5c8bc6d11459970b0e90feafb2b6928d223eb2"}
Sep 08 13:19:51.138307 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:51.138278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"7817f63ce099fa011bce685405466f0915339e2714e4dc62c5f617b788f3e86c"}
Sep 08 13:19:51.187052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:51.187006    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vltmx" podStartSLOduration=2.161974416 podStartE2EDuration="4.186992567s" totalImagesPullingTime="1.953973631s" totalInitContainerRuntime="71.04452ms" isStatefulPod=true podCreationTimestamp="2026-09-08 13:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:51.185675375 +0000 UTC m=+197.169876172" watchObservedRunningTime="2026-09-08 13:19:51.186992567 +0000 UTC m=+197.171193561"
Sep 08 13:19:52.031261 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.031227    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"]
Sep 08 13:19:52.035379 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.035356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.038449 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.038424    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 13:19:52.038593 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.038470    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-jqbgm\""
Sep 08 13:19:52.045089 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.044792    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"]
Sep 08 13:19:52.141543 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.141422    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69fbda59-11cd-4746-92a4-1cf9630d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-sfq99\" (UID: \"69fbda59-11cd-4746-92a4-1cf9630d161e\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.141543 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.141513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppc9g\" (UniqueName: \"kubernetes.io/projected/69fbda59-11cd-4746-92a4-1cf9630d161e-kube-api-access-ppc9g\") pod \"monitoring-plugin-85bbbbbf4-sfq99\" (UID: \"69fbda59-11cd-4746-92a4-1cf9630d161e\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.243089 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.243022    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69fbda59-11cd-4746-92a4-1cf9630d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-sfq99\" (UID: \"69fbda59-11cd-4746-92a4-1cf9630d161e\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.243089 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.243080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppc9g\" (UniqueName: \"kubernetes.io/projected/69fbda59-11cd-4746-92a4-1cf9630d161e-kube-api-access-ppc9g\") pod \"monitoring-plugin-85bbbbbf4-sfq99\" (UID: \"69fbda59-11cd-4746-92a4-1cf9630d161e\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.246187 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.246157    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/69fbda59-11cd-4746-92a4-1cf9630d161e-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-sfq99\" (UID: \"69fbda59-11cd-4746-92a4-1cf9630d161e\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.251745 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.251702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppc9g\" (UniqueName: \"kubernetes.io/projected/69fbda59-11cd-4746-92a4-1cf9630d161e-kube-api-access-ppc9g\") pod \"monitoring-plugin-85bbbbbf4-sfq99\" (UID: \"69fbda59-11cd-4746-92a4-1cf9630d161e\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.348950 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.348870    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:52.663880 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:52.663806    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"]
Sep 08 13:19:53.092499 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:53.092470    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fbda59_11cd_4746_92a4_1cf9630d161e.slice/crio-2b1bbceb8cb7849821e3a2af86d39b240d839efce8c5562ca9568c24c0dd13d5 WatchSource:0}: Error finding container 2b1bbceb8cb7849821e3a2af86d39b240d839efce8c5562ca9568c24c0dd13d5: Status 404 returned error can't find the container with id 2b1bbceb8cb7849821e3a2af86d39b240d839efce8c5562ca9568c24c0dd13d5
Sep 08 13:19:53.147692 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:53.147668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99" event={"ID":"69fbda59-11cd-4746-92a4-1cf9630d161e","Type":"ContainerStarted","Data":"2b1bbceb8cb7849821e3a2af86d39b240d839efce8c5562ca9568c24c0dd13d5"}
Sep 08 13:19:53.150667 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:53.150616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"}
Sep 08 13:19:53.150769 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:53.150686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"}
Sep 08 13:19:53.150769 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:53.150730    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"}
Sep 08 13:19:54.159027 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:54.158986    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"}
Sep 08 13:19:54.159505 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:54.159080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"}
Sep 08 13:19:54.161493 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:54.161459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"b80cfa549318b4f8fc5477ef8e638e00bfb402f0d185f5500e604ddf01a528f8"}
Sep 08 13:19:54.161629 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:54.161548    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"ad45b2879bfc99a70ce514f060e58a957e3151322ff73d419c89dce84f722e09"}
Sep 08 13:19:54.161629 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:54.161579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"02f6d07c91eb278e68df98719a3476bae0b5aced1bd32b55bdea39e7960c7dda"}
Sep 08 13:19:55.168276 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.168233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerStarted","Data":"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"}
Sep 08 13:19:55.171135 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.171109    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"a2b43f221007e67d56525bbfd9ce7df820585b4c5425eb9ddc443809adcbf6b8"}
Sep 08 13:19:55.171260 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.171163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"0e55438ef2ffda1d2cabad8231f68c7aef2667f7ef35dafa57117ebc93a62025"}
Sep 08 13:19:55.171260 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.171188    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" event={"ID":"73b2fc73-81a1-4f31-b3f9-afb476de2b1f","Type":"ContainerStarted","Data":"193f2ffcd3c435a34e614c0a9605318c9616b7b1afc5d4aef99699c4068d3a35"}
Sep 08 13:19:55.171260 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.171223    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:19:55.172517 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.172489    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99" event={"ID":"69fbda59-11cd-4746-92a4-1cf9630d161e","Type":"ContainerStarted","Data":"c1b0c47ea2b3be73b38af339eaed787ea1a8442e4598f1c92fd7fbcb21f07369"}
Sep 08 13:19:55.172716 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.172699    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:55.177513 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.177495    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99"
Sep 08 13:19:55.196254 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.196216    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.61908884 podStartE2EDuration="7.196199642s" totalImagesPullingTime="3.558104591s" totalInitContainerRuntime="19.006211ms" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:55.194635703 +0000 UTC m=+201.178836500" watchObservedRunningTime="2026-09-08 13:19:55.196199642 +0000 UTC m=+201.180400440"
Sep 08 13:19:55.217575 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.217515    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f" podStartSLOduration=2.158668488 podStartE2EDuration="6.217499397s" totalImagesPullingTime="4.058830909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:55.216367248 +0000 UTC m=+201.200568047" watchObservedRunningTime="2026-09-08 13:19:55.217499397 +0000 UTC m=+201.201700193"
Sep 08 13:19:55.233324 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:55.233270    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sfq99" podStartSLOduration=1.9474941860000001 podStartE2EDuration="3.233250575s" totalImagesPullingTime="1.285756389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:55.232499949 +0000 UTC m=+201.216700751" watchObservedRunningTime="2026-09-08 13:19:55.233250575 +0000 UTC m=+201.217451377"
Sep 08 13:19:56.067711 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:56.067685    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c4849dc75-lgtxg"
Sep 08 13:19:56.490968 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:56.490943    2557 scope.go:117] "RemoveContainer" containerID="392cfa8dbf65a29466fc29df4fef40a20a29a8e920e190405f078b819cb09469"
Sep 08 13:19:57.064115 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.064074    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-w2g6n"]
Sep 08 13:19:57.067810 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.067789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:19:57.071961 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.071940    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 13:19:57.072184 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.072171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-68pgr\""
Sep 08 13:19:57.072433 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.072420    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 13:19:57.078901 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.078880    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-w2g6n"]
Sep 08 13:19:57.181677 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.181653    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:19:57.181841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.181768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" event={"ID":"2c51ea82-954f-4b15-8f62-726cfa40806b","Type":"ContainerStarted","Data":"d1f53b47b1640dbc93ea02d0d9a92735265229980983f026f2033971a2f2ab85"}
Sep 08 13:19:57.182133 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.182111    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:57.186396 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.186375    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-7nvg8"
Sep 08 13:19:57.188800 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.188779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbrl\" (UniqueName: \"kubernetes.io/projected/2b8e8bef-a6b7-4177-9e59-b5e945bdd75e-kube-api-access-wzbrl\") pod \"downloads-85d98c998f-w2g6n\" (UID: \"2b8e8bef-a6b7-4177-9e59-b5e945bdd75e\") " pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:19:57.209245 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.209202    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-7nvg8" podStartSLOduration=53.505929363 podStartE2EDuration="56.209186942s" totalImagesPullingTime="2.703257579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:19:57.208621168 +0000 UTC m=+203.192821976" watchObservedRunningTime="2026-09-08 13:19:57.209186942 +0000 UTC m=+203.193387741"
Sep 08 13:19:57.289508 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.289466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbrl\" (UniqueName: \"kubernetes.io/projected/2b8e8bef-a6b7-4177-9e59-b5e945bdd75e-kube-api-access-wzbrl\") pod \"downloads-85d98c998f-w2g6n\" (UID: \"2b8e8bef-a6b7-4177-9e59-b5e945bdd75e\") " pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:19:57.297846 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.297821    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbrl\" (UniqueName: \"kubernetes.io/projected/2b8e8bef-a6b7-4177-9e59-b5e945bdd75e-kube-api-access-wzbrl\") pod \"downloads-85d98c998f-w2g6n\" (UID: \"2b8e8bef-a6b7-4177-9e59-b5e945bdd75e\") " pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:19:57.377000 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.376924    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:19:57.651906 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:57.651880    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-w2g6n"]
Sep 08 13:19:57.652540 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:19:57.652498    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8e8bef_a6b7_4177_9e59_b5e945bdd75e.slice/crio-bdef3d9446f3ee196de3dd66cf84502fbc6af866534896b1595e1a3c61a34234 WatchSource:0}: Error finding container bdef3d9446f3ee196de3dd66cf84502fbc6af866534896b1595e1a3c61a34234: Status 404 returned error can't find the container with id bdef3d9446f3ee196de3dd66cf84502fbc6af866534896b1595e1a3c61a34234
Sep 08 13:19:58.186597 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:19:58.186559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-w2g6n" event={"ID":"2b8e8bef-a6b7-4177-9e59-b5e945bdd75e","Type":"ContainerStarted","Data":"bdef3d9446f3ee196de3dd66cf84502fbc6af866534896b1595e1a3c61a34234"}
Sep 08 13:20:01.181948 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:01.181922    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b8d7b58d4-b9b5f"
Sep 08 13:20:07.066080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.066041    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797864f985-nfb98"]
Sep 08 13:20:07.070112 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.070089    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.074967 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.074932    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 13:20:07.075382 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.075362    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 13:20:07.075727 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.075677    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 13:20:07.075855 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.075744    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 13:20:07.075855 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.075780    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 13:20:07.075855 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.075745    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mlhjd\""
Sep 08 13:20:07.083086 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.083053    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797864f985-nfb98"]
Sep 08 13:20:07.183823 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.183778    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-oauth-serving-cert\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.184014 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.183844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-serving-cert\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.184014 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.183866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-config\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.184014 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.183919    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jq9c\" (UniqueName: \"kubernetes.io/projected/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-kube-api-access-2jq9c\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.184014 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.183975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-service-ca\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.184214 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.184068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-oauth-config\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.285334 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.285293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-service-ca\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.285515 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.285370    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-oauth-config\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.285515 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.285439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-oauth-serving-cert\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.285515 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.285489    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-serving-cert\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.285725 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.285514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-config\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.285725 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.285606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jq9c\" (UniqueName: \"kubernetes.io/projected/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-kube-api-access-2jq9c\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.286176 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.286145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-service-ca\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.286466 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.286443    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-oauth-serving-cert\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.286810 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.286761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-config\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.288264 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.288239    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-serving-cert\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.288369 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.288322    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-oauth-config\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.294381 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.294355    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jq9c\" (UniqueName: \"kubernetes.io/projected/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-kube-api-access-2jq9c\") pod \"console-797864f985-nfb98\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") " pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:07.380773 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:07.380679    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:14.162495 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:14.162467    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797864f985-nfb98"]
Sep 08 13:20:14.210134 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:20:14.210099    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad30f4d1_c2b2_4d72_8a7e_5477ee7610da.slice/crio-048ee65174c67c357f58457e642ea8764f189ecd430338bdc6ece22415e5c9f2 WatchSource:0}: Error finding container 048ee65174c67c357f58457e642ea8764f189ecd430338bdc6ece22415e5c9f2: Status 404 returned error can't find the container with id 048ee65174c67c357f58457e642ea8764f189ecd430338bdc6ece22415e5c9f2
Sep 08 13:20:14.256369 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:14.256336    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797864f985-nfb98" event={"ID":"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da","Type":"ContainerStarted","Data":"048ee65174c67c357f58457e642ea8764f189ecd430338bdc6ece22415e5c9f2"}
Sep 08 13:20:15.264130 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.264083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-w2g6n" event={"ID":"2b8e8bef-a6b7-4177-9e59-b5e945bdd75e","Type":"ContainerStarted","Data":"38f7cdc92f0db1ccea73098223ec6c618e7f041230da3867cf948cd595562a32"}
Sep 08 13:20:15.264667 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.264639    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:20:15.283208 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.283112    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-w2g6n"
Sep 08 13:20:15.287079 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.287019    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-w2g6n" podStartSLOduration=1.434072821 podStartE2EDuration="18.286998394s" totalImagesPullingTime="16.852925573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:15.282482902 +0000 UTC m=+221.266683901" watchObservedRunningTime="2026-09-08 13:20:15.286998394 +0000 UTC m=+221.271199193"
Sep 08 13:20:15.582460 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.582421    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84bb589f46-dggjz"]
Sep 08 13:20:15.585013 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.584981    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.605061 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.605026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bb589f46-dggjz"]
Sep 08 13:20:15.606563 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.606301    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 13:20:15.764944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.764773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-trusted-ca-bundle\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.764944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.764876    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-service-ca\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.764944 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.764934    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-serving-cert\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.765421 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.764999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-config\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.765421 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.765029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrblt\" (UniqueName: \"kubernetes.io/projected/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-kube-api-access-zrblt\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.765421 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.765067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-oauth-serving-cert\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.765421 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.765091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-oauth-config\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.866945 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.866835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-service-ca\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.866945 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.866911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-serving-cert\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.867257 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.866984    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-config\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.867257 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.867007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrblt\" (UniqueName: \"kubernetes.io/projected/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-kube-api-access-zrblt\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.867257 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.867045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-oauth-serving-cert\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.867257 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.867070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-oauth-config\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.867257 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.867143    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-trusted-ca-bundle\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.868696 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.868119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-trusted-ca-bundle\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.868819 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.868727    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-config\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.869016 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.868967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-service-ca\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.869099 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.869058    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-oauth-serving-cert\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.871782 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.871756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-serving-cert\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.873032 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.872990    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-oauth-config\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.876119 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.876077    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrblt\" (UniqueName: \"kubernetes.io/projected/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-kube-api-access-zrblt\") pod \"console-84bb589f46-dggjz\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") " pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:15.911657 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:15.911429    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:16.206982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:16.206952    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84bb589f46-dggjz"]
Sep 08 13:20:16.271785 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:16.271747    2557 generic.go:356] "Generic (PLEG): container finished" podID="fda41fa2-ec43-44bd-b99c-26839106c353" containerID="1ee3c03c3729dbdc5a316368ee0fd853c2e3fb07f54dae66ed9e757b0ab7de63" exitCode=0
Sep 08 13:20:16.272401 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:16.272378    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs" event={"ID":"fda41fa2-ec43-44bd-b99c-26839106c353","Type":"ContainerDied","Data":"1ee3c03c3729dbdc5a316368ee0fd853c2e3fb07f54dae66ed9e757b0ab7de63"}
Sep 08 13:20:16.273035 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:16.272723    2557 scope.go:117] "RemoveContainer" containerID="1ee3c03c3729dbdc5a316368ee0fd853c2e3fb07f54dae66ed9e757b0ab7de63"
Sep 08 13:20:17.457156 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:20:17.457118    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d70c85_297e_4bc2_9e72_6b8d0d09b6ab.slice/crio-c933fa7f719ba2ce87e6da28c5f8f63349d2501be766ea54397b2657bcad84f3 WatchSource:0}: Error finding container c933fa7f719ba2ce87e6da28c5f8f63349d2501be766ea54397b2657bcad84f3: Status 404 returned error can't find the container with id c933fa7f719ba2ce87e6da28c5f8f63349d2501be766ea54397b2657bcad84f3
Sep 08 13:20:18.283458 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:18.283398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797864f985-nfb98" event={"ID":"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da","Type":"ContainerStarted","Data":"605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b"}
Sep 08 13:20:18.285680 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:18.285645    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bb589f46-dggjz" event={"ID":"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab","Type":"ContainerStarted","Data":"e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37"}
Sep 08 13:20:18.285825 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:18.285697    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bb589f46-dggjz" event={"ID":"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab","Type":"ContainerStarted","Data":"c933fa7f719ba2ce87e6da28c5f8f63349d2501be766ea54397b2657bcad84f3"}
Sep 08 13:20:18.288780 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:18.288756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-kjmxs" event={"ID":"fda41fa2-ec43-44bd-b99c-26839106c353","Type":"ContainerStarted","Data":"54a37e49c0fe36d4c9dd1e81b5139724e87df43fc90bf6fa0b282ce27afecf7d"}
Sep 08 13:20:18.306224 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:18.306169    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797864f985-nfb98" podStartSLOduration=7.737914637 podStartE2EDuration="11.306151308s" totalImagesPullingTime="3.568236671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:18.303588388 +0000 UTC m=+224.287789185" watchObservedRunningTime="2026-09-08 13:20:18.306151308 +0000 UTC m=+224.290352107"
Sep 08 13:20:18.358058 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:18.357955    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84bb589f46-dggjz" podStartSLOduration=2.816238149 podStartE2EDuration="3.357934475s" totalImagesPullingTime="541.696326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:18.356741647 +0000 UTC m=+224.340942471" watchObservedRunningTime="2026-09-08 13:20:18.357934475 +0000 UTC m=+224.342135273"
Sep 08 13:20:25.912094 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:25.912055    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:25.912624 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:25.912131    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:25.917009 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:25.916986    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:26.326262 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:26.326234    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:20:26.381726 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:26.381698    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797864f985-nfb98"]
Sep 08 13:20:27.381084 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:27.381060    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:46.233550 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:46.233500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:20:46.235697 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:46.235676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb-metrics-certs\") pod \"network-metrics-daemon-2p4wh\" (UID: \"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb\") " pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:20:46.495724 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:46.495650    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lvcfq\""
Sep 08 13:20:46.502811 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:46.502795    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2p4wh"
Sep 08 13:20:46.815917 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:46.815895    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2p4wh"]
Sep 08 13:20:47.401515 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:47.401475    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2p4wh" event={"ID":"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb","Type":"ContainerStarted","Data":"11ae9631a9aa162060ffe393681ab8dd4b193cb51fd46cba6c807277fd629485"}
Sep 08 13:20:51.408936 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.408887    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-797864f985-nfb98" podUID="ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" containerName="console" containerID="cri-o://605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b" gracePeriod=15
Sep 08 13:20:51.418858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.418826    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2p4wh" event={"ID":"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb","Type":"ContainerStarted","Data":"28d43aec1a4ce3329d3ee4ae15ab63fe88ac6ddac4e41cd7e7569638d46fd987"}
Sep 08 13:20:51.418962 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.418892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2p4wh" event={"ID":"661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb","Type":"ContainerStarted","Data":"e17988d0318113ade8955634fc02570d1a49701caecd5cd8735e2e0a8f8b80c7"}
Sep 08 13:20:51.439796 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.439757    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2p4wh" podStartSLOduration=252.219903249 podStartE2EDuration="4m16.439743178s" totalImagesPullingTime="4.219839929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:20:51.438019195 +0000 UTC m=+257.422220003" watchObservedRunningTime="2026-09-08 13:20:51.439743178 +0000 UTC m=+257.423943974"
Sep 08 13:20:51.682716 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.682688    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:51.779845 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.779813    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-oauth-serving-cert\") pod \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") "
Sep 08 13:20:51.779845 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.779848    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-config\") pod \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") "
Sep 08 13:20:51.780056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.779891    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-oauth-config\") pod \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") "
Sep 08 13:20:51.780056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.780009    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-serving-cert\") pod \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") "
Sep 08 13:20:51.780138 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.780086    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jq9c\" (UniqueName: \"kubernetes.io/projected/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-kube-api-access-2jq9c\") pod \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") "
Sep 08 13:20:51.780183 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.780142    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-service-ca\") pod \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\" (UID: \"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da\") "
Sep 08 13:20:51.780784 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.780693    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" (UID: "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:20:51.780784 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.780704    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-config" (OuterVolumeSpecName: "console-config") pod "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" (UID: "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:20:51.781170 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.781127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-service-ca" (OuterVolumeSpecName: "service-ca") pod "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" (UID: "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:20:51.782630 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.781396    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:20:51.782630 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.781428    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-oauth-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:20:51.782630 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.781442    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:20:51.787330 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.787304    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" (UID: "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:20:51.787330 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.787321    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-kube-api-access-2jq9c" (OuterVolumeSpecName: "kube-api-access-2jq9c") pod "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" (UID: "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da"). InnerVolumeSpecName "kube-api-access-2jq9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:20:51.787466 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.787321    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" (UID: "ad30f4d1-c2b2-4d72-8a7e-5477ee7610da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:20:51.882858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.882789    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jq9c\" (UniqueName: \"kubernetes.io/projected/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-kube-api-access-2jq9c\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:20:51.882858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.882818    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-oauth-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:20:51.882858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:51.882827    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da-console-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:20:52.424120 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.424087    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" containerID="605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b" exitCode=0
Sep 08 13:20:52.424502 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.424144    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797864f985-nfb98"
Sep 08 13:20:52.424502 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.424176    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797864f985-nfb98" event={"ID":"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da","Type":"ContainerDied","Data":"605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b"}
Sep 08 13:20:52.424502 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.424248    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797864f985-nfb98" event={"ID":"ad30f4d1-c2b2-4d72-8a7e-5477ee7610da","Type":"ContainerDied","Data":"048ee65174c67c357f58457e642ea8764f189ecd430338bdc6ece22415e5c9f2"}
Sep 08 13:20:52.424502 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.424271    2557 scope.go:117] "RemoveContainer" containerID="605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b"
Sep 08 13:20:52.439706 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.439680    2557 scope.go:117] "RemoveContainer" containerID="605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b"
Sep 08 13:20:52.439976 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:20:52.439955    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b\": container with ID starting with 605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b not found: ID does not exist" containerID="605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b"
Sep 08 13:20:52.440031 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.439986    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b"} err="failed to get container status \"605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b\": rpc error: code = NotFound desc = could not find container \"605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b\": container with ID starting with 605f053f0a96b27ddf05e4a57fb84755271355b68bfda617d015d86280167b1b not found: ID does not exist"
Sep 08 13:20:52.445606 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.445583    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797864f985-nfb98"]
Sep 08 13:20:52.449437 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.449416    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797864f985-nfb98"]
Sep 08 13:20:52.495886 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:20:52.495854    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" path="/var/lib/kubelet/pods/ad30f4d1-c2b2-4d72-8a7e-5477ee7610da/volumes"
Sep 08 13:21:07.639401 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639322    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:21:07.639897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639616    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="alertmanager" containerID="cri-o://81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0" gracePeriod=120
Sep 08 13:21:07.639897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639682    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-metric" containerID="cri-o://cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89" gracePeriod=120
Sep 08 13:21:07.639897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639695    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-web" containerID="cri-o://239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45" gracePeriod=120
Sep 08 13:21:07.639897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639743    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="prom-label-proxy" containerID="cri-o://ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0" gracePeriod=120
Sep 08 13:21:07.639897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639726    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy" containerID="cri-o://56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af" gracePeriod=120
Sep 08 13:21:07.639897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:07.639785    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="config-reloader" containerID="cri-o://02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab" gracePeriod=120
Sep 08 13:21:08.488074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488039    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0" exitCode=0
Sep 08 13:21:08.488074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488063    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af" exitCode=0
Sep 08 13:21:08.488074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488069    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab" exitCode=0
Sep 08 13:21:08.488074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488075    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0" exitCode=0
Sep 08 13:21:08.488329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"}
Sep 08 13:21:08.488329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488144    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"}
Sep 08 13:21:08.488329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488171    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"}
Sep 08 13:21:08.488329 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.488196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"}
Sep 08 13:21:08.882506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.882478    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:08.921065 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921207 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921073    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddxm2\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-kube-api-access-ddxm2\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921207 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921118    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-cluster-tls-config\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921207 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921138    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-out\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921207 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921164    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-tls-assets\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921207 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921190    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-web-config\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921217    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-main-db\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921248    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-metrics-client-ca\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921287    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-main-tls\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921322    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-web\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921359    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921417    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-trusted-ca-bundle\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921447    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-volume\") pod \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\" (UID: \"c2b3097e-0c56-4f3a-90a6-088de85a5db2\") "
Sep 08 13:21:08.921848 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.921802    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:21:08.922366 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.922186    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 13:21:08.922366 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.922317    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:21:08.924331 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.924302    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:08.924598 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.924568    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:21:08.925910 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.925882    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-out" (OuterVolumeSpecName: "config-out") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 13:21:08.926345 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.926313    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:08.926427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.926351    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-volume" (OuterVolumeSpecName: "config-volume") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:08.926474 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.926445    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:08.927238 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.927211    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-kube-api-access-ddxm2" (OuterVolumeSpecName: "kube-api-access-ddxm2") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "kube-api-access-ddxm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:21:08.927660 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.927635    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:08.932844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.932819    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:08.937692 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:08.937662    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-web-config" (OuterVolumeSpecName: "web-config") pod "c2b3097e-0c56-4f3a-90a6-088de85a5db2" (UID: "c2b3097e-0c56-4f3a-90a6-088de85a5db2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022207    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-tls-assets\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022252    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-web-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022262    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-main-db\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022272    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-metrics-client-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022282    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-main-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022292    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022301    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022310    2557 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2b3097e-0c56-4f3a-90a6-088de85a5db2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022306 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022318    2557 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-volume\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022326    2557 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022335    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddxm2\" (UniqueName: \"kubernetes.io/projected/c2b3097e-0c56-4f3a-90a6-088de85a5db2-kube-api-access-ddxm2\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022343    2557 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c2b3097e-0c56-4f3a-90a6-088de85a5db2-cluster-tls-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.022712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.022350    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c2b3097e-0c56-4f3a-90a6-088de85a5db2-config-out\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:09.495197 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495167    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89" exitCode=0
Sep 08 13:21:09.495197 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495191    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerID="239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45" exitCode=0
Sep 08 13:21:09.495390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495212    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"}
Sep 08 13:21:09.495390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495234    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.495390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"}
Sep 08 13:21:09.495390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c2b3097e-0c56-4f3a-90a6-088de85a5db2","Type":"ContainerDied","Data":"cc65c8942754fd16a9d207e051414b7e175a3f94dd6ddccdc31af333314c0f5a"}
Sep 08 13:21:09.495390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.495317    2557 scope.go:117] "RemoveContainer" containerID="ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"
Sep 08 13:21:09.503318 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.503300    2557 scope.go:117] "RemoveContainer" containerID="cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"
Sep 08 13:21:09.510168 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.510152    2557 scope.go:117] "RemoveContainer" containerID="56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"
Sep 08 13:21:09.516454 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.516436    2557 scope.go:117] "RemoveContainer" containerID="239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"
Sep 08 13:21:09.522481 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.522453    2557 scope.go:117] "RemoveContainer" containerID="02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"
Sep 08 13:21:09.525762 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.525737    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:21:09.529775 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.529750    2557 scope.go:117] "RemoveContainer" containerID="81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"
Sep 08 13:21:09.531251 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.531231    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:21:09.536558 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.536540    2557 scope.go:117] "RemoveContainer" containerID="d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"
Sep 08 13:21:09.542897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.542881    2557 scope.go:117] "RemoveContainer" containerID="ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"
Sep 08 13:21:09.543158 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.543141    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0\": container with ID starting with ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0 not found: ID does not exist" containerID="ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"
Sep 08 13:21:09.543212 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543166    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"} err="failed to get container status \"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0\": rpc error: code = NotFound desc = could not find container \"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0\": container with ID starting with ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0 not found: ID does not exist"
Sep 08 13:21:09.543212 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543183    2557 scope.go:117] "RemoveContainer" containerID="cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"
Sep 08 13:21:09.543424 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.543409    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89\": container with ID starting with cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89 not found: ID does not exist" containerID="cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"
Sep 08 13:21:09.543463 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543428    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"} err="failed to get container status \"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89\": rpc error: code = NotFound desc = could not find container \"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89\": container with ID starting with cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89 not found: ID does not exist"
Sep 08 13:21:09.543463 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543441    2557 scope.go:117] "RemoveContainer" containerID="56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"
Sep 08 13:21:09.543688 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.543672    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af\": container with ID starting with 56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af not found: ID does not exist" containerID="56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"
Sep 08 13:21:09.543730 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543691    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"} err="failed to get container status \"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af\": rpc error: code = NotFound desc = could not find container \"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af\": container with ID starting with 56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af not found: ID does not exist"
Sep 08 13:21:09.543730 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543703    2557 scope.go:117] "RemoveContainer" containerID="239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"
Sep 08 13:21:09.543944 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.543928    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45\": container with ID starting with 239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45 not found: ID does not exist" containerID="239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"
Sep 08 13:21:09.543987 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543947    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"} err="failed to get container status \"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45\": rpc error: code = NotFound desc = could not find container \"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45\": container with ID starting with 239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45 not found: ID does not exist"
Sep 08 13:21:09.543987 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.543959    2557 scope.go:117] "RemoveContainer" containerID="02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"
Sep 08 13:21:09.544157 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.544143    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab\": container with ID starting with 02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab not found: ID does not exist" containerID="02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"
Sep 08 13:21:09.544192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544160    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"} err="failed to get container status \"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab\": rpc error: code = NotFound desc = could not find container \"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab\": container with ID starting with 02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab not found: ID does not exist"
Sep 08 13:21:09.544192 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544172    2557 scope.go:117] "RemoveContainer" containerID="81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"
Sep 08 13:21:09.544384 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.544369    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0\": container with ID starting with 81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0 not found: ID does not exist" containerID="81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"
Sep 08 13:21:09.544434 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544386    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"} err="failed to get container status \"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0\": rpc error: code = NotFound desc = could not find container \"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0\": container with ID starting with 81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0 not found: ID does not exist"
Sep 08 13:21:09.544434 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544397    2557 scope.go:117] "RemoveContainer" containerID="d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"
Sep 08 13:21:09.544678 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:09.544662    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d\": container with ID starting with d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d not found: ID does not exist" containerID="d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"
Sep 08 13:21:09.544732 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544680    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"} err="failed to get container status \"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d\": rpc error: code = NotFound desc = could not find container \"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d\": container with ID starting with d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d not found: ID does not exist"
Sep 08 13:21:09.544732 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544695    2557 scope.go:117] "RemoveContainer" containerID="ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"
Sep 08 13:21:09.544902 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544886    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0"} err="failed to get container status \"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0\": rpc error: code = NotFound desc = could not find container \"ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0\": container with ID starting with ab15dd733104518c5243798bf6566637b56f7d4fed50e04c4a0879d05dccf7f0 not found: ID does not exist"
Sep 08 13:21:09.544939 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.544902    2557 scope.go:117] "RemoveContainer" containerID="cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"
Sep 08 13:21:09.545132 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545111    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89"} err="failed to get container status \"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89\": rpc error: code = NotFound desc = could not find container \"cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89\": container with ID starting with cc2dc52b8afdb244b485af67c52b41e08c420217d3591a6d3ddbbe3d7cd10f89 not found: ID does not exist"
Sep 08 13:21:09.545178 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545134    2557 scope.go:117] "RemoveContainer" containerID="56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"
Sep 08 13:21:09.545343 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545328    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af"} err="failed to get container status \"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af\": rpc error: code = NotFound desc = could not find container \"56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af\": container with ID starting with 56cbc5d65321062ae73bb1d3dde5e9d1811d0e04e2c9a6dd56273f0e2ebe37af not found: ID does not exist"
Sep 08 13:21:09.545385 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545343    2557 scope.go:117] "RemoveContainer" containerID="239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"
Sep 08 13:21:09.545558 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545533    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45"} err="failed to get container status \"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45\": rpc error: code = NotFound desc = could not find container \"239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45\": container with ID starting with 239d4699e1b9af434fc74c401cb3b2e2b35e7552bfe59bf6950166ef8a78ec45 not found: ID does not exist"
Sep 08 13:21:09.545558 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545558    2557 scope.go:117] "RemoveContainer" containerID="02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"
Sep 08 13:21:09.545800 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545782    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab"} err="failed to get container status \"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab\": rpc error: code = NotFound desc = could not find container \"02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab\": container with ID starting with 02e3a5e02f20227a3944d806e2a0b6ea710d548c438c1b08e7822c0c5574c7ab not found: ID does not exist"
Sep 08 13:21:09.545846 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.545800    2557 scope.go:117] "RemoveContainer" containerID="81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"
Sep 08 13:21:09.546035 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.546019    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0"} err="failed to get container status \"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0\": rpc error: code = NotFound desc = could not find container \"81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0\": container with ID starting with 81e23fe6f4daa4084a5427546ce69b3e4cfb9229c7ea6e67c3f66678668026a0 not found: ID does not exist"
Sep 08 13:21:09.546085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.546035    2557 scope.go:117] "RemoveContainer" containerID="d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"
Sep 08 13:21:09.546266 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.546247    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d"} err="failed to get container status \"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d\": rpc error: code = NotFound desc = could not find container \"d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d\": container with ID starting with d1e548546a57f15f89152bb689bd283169619f06b6aa04c924bbcbc22a58b96d not found: ID does not exist"
Sep 08 13:21:09.561947 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.561926    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:21:09.562204 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562193    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="init-config-reloader"
Sep 08 13:21:09.562247 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562206    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="init-config-reloader"
Sep 08 13:21:09.562247 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562216    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="prom-label-proxy"
Sep 08 13:21:09.562247 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562222    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="prom-label-proxy"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562247    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="alertmanager"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562253    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="alertmanager"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562259    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="config-reloader"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562265    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="config-reloader"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562271    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-web"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562276    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-web"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562283    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" containerName="console"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562288    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" containerName="console"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562295    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562300    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562308    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-metric"
Sep 08 13:21:09.562337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562313    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-metric"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562358    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="prom-label-proxy"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562369    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-metric"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562376    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562381    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad30f4d1-c2b2-4d72-8a7e-5477ee7610da" containerName="console"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562386    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="kube-rbac-proxy-web"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562391    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="config-reloader"
Sep 08 13:21:09.562707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.562396    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" containerName="alertmanager"
Sep 08 13:21:09.565655 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.565640    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.568282 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568099    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 13:21:09.568282 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568115    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 13:21:09.568282 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568115    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 13:21:09.568282 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568098    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 13:21:09.568282 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568169    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 13:21:09.568282 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568177    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rtctq\""
Sep 08 13:21:09.568584 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568497    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 13:21:09.568584 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568569    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 13:21:09.568584 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.568575    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 13:21:09.573807 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.573790    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 13:21:09.587833 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.587808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:21:09.627351 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627324    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627395    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c71058-3641-47db-bdce-ba8c3c9cd09e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c71058-3641-47db-bdce-ba8c3c9cd09e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr2fc\" (UniqueName: \"kubernetes.io/projected/80c71058-3641-47db-bdce-ba8c3c9cd09e-kube-api-access-xr2fc\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c71058-3641-47db-bdce-ba8c3c9cd09e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c71058-3641-47db-bdce-ba8c3c9cd09e-config-out\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c71058-3641-47db-bdce-ba8c3c9cd09e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.627840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.627738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-web-config\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr2fc\" (UniqueName: \"kubernetes.io/projected/80c71058-3641-47db-bdce-ba8c3c9cd09e-kube-api-access-xr2fc\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728435 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728435 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c71058-3641-47db-bdce-ba8c3c9cd09e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728551 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728426    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c71058-3641-47db-bdce-ba8c3c9cd09e-config-out\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728551 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c71058-3641-47db-bdce-ba8c3c9cd09e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728551 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728515    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-web-config\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728854 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728854 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c71058-3641-47db-bdce-ba8c3c9cd09e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728854 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c71058-3641-47db-bdce-ba8c3c9cd09e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.728854 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.729110 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.728912    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80c71058-3641-47db-bdce-ba8c3c9cd09e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.731407 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.731366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80c71058-3641-47db-bdce-ba8c3c9cd09e-config-out\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.731579 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.731559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80c71058-3641-47db-bdce-ba8c3c9cd09e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.731671 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.731559    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.731671 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.731659    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.731786 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.731767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.731921 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.731901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-config-volume\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.732043 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.732022    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.732345 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.732322    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c71058-3641-47db-bdce-ba8c3c9cd09e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.732402 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.732381    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80c71058-3641-47db-bdce-ba8c3c9cd09e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.732446 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.732430    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-web-config\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.733475 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.733453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80c71058-3641-47db-bdce-ba8c3c9cd09e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.736448 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.736426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr2fc\" (UniqueName: \"kubernetes.io/projected/80c71058-3641-47db-bdce-ba8c3c9cd09e-kube-api-access-xr2fc\") pod \"alertmanager-main-0\" (UID: \"80c71058-3641-47db-bdce-ba8c3c9cd09e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:09.876078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:09.875990    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 13:21:10.156387 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:10.156301    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 13:21:10.159018 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:21:10.158991    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c71058_3641_47db_bdce_ba8c3c9cd09e.slice/crio-71d7e85f498f42c1d8f6f5706d300399381f49d5372b550e418a651c982bf661 WatchSource:0}: Error finding container 71d7e85f498f42c1d8f6f5706d300399381f49d5372b550e418a651c982bf661: Status 404 returned error can't find the container with id 71d7e85f498f42c1d8f6f5706d300399381f49d5372b550e418a651c982bf661
Sep 08 13:21:10.495991 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:10.495963    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b3097e-0c56-4f3a-90a6-088de85a5db2" path="/var/lib/kubelet/pods/c2b3097e-0c56-4f3a-90a6-088de85a5db2/volumes"
Sep 08 13:21:10.501086 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:10.501061    2557 generic.go:356] "Generic (PLEG): container finished" podID="80c71058-3641-47db-bdce-ba8c3c9cd09e" containerID="b7f5c73cb3e52c04b7c3b3889e62f2bd9159cb800e98430455601d2e57b31a36" exitCode=0
Sep 08 13:21:10.501208 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:10.501108    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerDied","Data":"b7f5c73cb3e52c04b7c3b3889e62f2bd9159cb800e98430455601d2e57b31a36"}
Sep 08 13:21:10.501208 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:10.501151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"71d7e85f498f42c1d8f6f5706d300399381f49d5372b550e418a651c982bf661"}
Sep 08 13:21:11.509177 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.509131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"0dbd50e347c9e6f1d1a79b29026e86de50b023632c9d97908a3b7076798e9f87"}
Sep 08 13:21:11.509650 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.509217    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"b8a03706cab8b6801d824dcd474ddd4738ec0e49d31cdfdcab97d4025a857a60"}
Sep 08 13:21:11.509650 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.509245    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"a8ab89bd2d8c7742d23c44f8b12d3418a129509c233345ed528648f93efb0794"}
Sep 08 13:21:11.509650 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.509270    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"e655778d03a8c0d5b2d25df28dc9bd22c4734398e67a5ed94221c366f7688586"}
Sep 08 13:21:11.509650 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.509293    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"e217416b96226ca7a433d6438ebfde5727c02faeba0280febd161e8c29e6208d"}
Sep 08 13:21:11.509650 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.509315    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80c71058-3641-47db-bdce-ba8c3c9cd09e","Type":"ContainerStarted","Data":"3d47cd506e3fa6a6e48682f8abee61ba0fba96aff58ba61743f9ba5ef901ead8"}
Sep 08 13:21:11.553079 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.553029    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.536390681 podStartE2EDuration="2.553007507s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.616826ms" isStatefulPod=false podCreationTimestamp="2026-09-08 13:21:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:11.548954721 +0000 UTC m=+277.533155518" watchObservedRunningTime="2026-09-08 13:21:11.553007507 +0000 UTC m=+277.537208355"
Sep 08 13:21:11.679187 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.679150    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f86b44649-bwd9h"]
Sep 08 13:21:11.681357 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.681340    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.684681 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.684651    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6khsx\""
Sep 08 13:21:11.684908 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.684889    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 13:21:11.685356 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.685172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 13:21:11.685356 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.685314    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 13:21:11.685754 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.685734    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 13:21:11.685835 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.685740    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 13:21:11.691596 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.691578    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 13:21:11.710311 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.710287    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f86b44649-bwd9h"]
Sep 08 13:21:11.747091 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-telemeter-client-tls\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-federate-client-tls\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747141    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-metrics-client-ca\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747242    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-serving-certs-ca-bundle\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-secret-telemeter-client\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.747512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.747322    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r766\" (UniqueName: \"kubernetes.io/projected/72cff96a-209e-4ed7-b1ed-bb84acaad228-kube-api-access-4r766\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.848915 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.848815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-federate-client-tls\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.848915 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.848866    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-metrics-client-ca\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.848915 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.848901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.849161 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.848929    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-serving-certs-ca-bundle\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.849161 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.848958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.849161 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.848988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-secret-telemeter-client\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.849161 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.849016    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r766\" (UniqueName: \"kubernetes.io/projected/72cff96a-209e-4ed7-b1ed-bb84acaad228-kube-api-access-4r766\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.849161 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.849110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-telemeter-client-tls\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.850034 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.849976    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-serving-certs-ca-bundle\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.850172 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.850052    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-metrics-client-ca\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.850172 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.850137    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72cff96a-209e-4ed7-b1ed-bb84acaad228-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.851636 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.851614    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.852000 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.851982    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-federate-client-tls\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.852046 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.852025    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-telemeter-client-tls\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.852116 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.852095    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/72cff96a-209e-4ed7-b1ed-bb84acaad228-secret-telemeter-client\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.858188 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.858165    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r766\" (UniqueName: \"kubernetes.io/projected/72cff96a-209e-4ed7-b1ed-bb84acaad228-kube-api-access-4r766\") pod \"telemeter-client-7f86b44649-bwd9h\" (UID: \"72cff96a-209e-4ed7-b1ed-bb84acaad228\") " pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:11.991850 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:11.991812    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h"
Sep 08 13:21:12.286712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:12.286684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f86b44649-bwd9h"]
Sep 08 13:21:12.289968 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:21:12.289925    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72cff96a_209e_4ed7_b1ed_bb84acaad228.slice/crio-eefec6eabc782c71894d570ad61658b4cdd4a5e902010b21bb0e506de7bacb95 WatchSource:0}: Error finding container eefec6eabc782c71894d570ad61658b4cdd4a5e902010b21bb0e506de7bacb95: Status 404 returned error can't find the container with id eefec6eabc782c71894d570ad61658b4cdd4a5e902010b21bb0e506de7bacb95
Sep 08 13:21:12.514544 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:12.514492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h" event={"ID":"72cff96a-209e-4ed7-b1ed-bb84acaad228","Type":"ContainerStarted","Data":"eefec6eabc782c71894d570ad61658b4cdd4a5e902010b21bb0e506de7bacb95"}
Sep 08 13:21:14.524506 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.524468    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h" event={"ID":"72cff96a-209e-4ed7-b1ed-bb84acaad228","Type":"ContainerStarted","Data":"cde40af342950039d535f969854d8cbfa4ea08b91dc8c41bec37c73c17beb951"}
Sep 08 13:21:14.524929 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.524539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h" event={"ID":"72cff96a-209e-4ed7-b1ed-bb84acaad228","Type":"ContainerStarted","Data":"3c987ec6386ee84e3f883d6104aeb902d7bb2b14a0870b4057ddb24d9e8b0fc4"}
Sep 08 13:21:14.524929 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.524559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h" event={"ID":"72cff96a-209e-4ed7-b1ed-bb84acaad228","Type":"ContainerStarted","Data":"bcba05435fc0ee7b5f1d84239a4b03188a5a2206910cc84a67f42f82c120e48d"}
Sep 08 13:21:14.549950 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.549902    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f86b44649-bwd9h" podStartSLOduration=1.952889672 podStartE2EDuration="3.549882071s" totalImagesPullingTime="1.596992399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:21:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:14.549054186 +0000 UTC m=+280.533254983" watchObservedRunningTime="2026-09-08 13:21:14.549882071 +0000 UTC m=+280.534082874"
Sep 08 13:21:14.650409 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.650379    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c45d64677-rh8hg"]
Sep 08 13:21:14.652841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.652802    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674057 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674022    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c45d64677-rh8hg"]
Sep 08 13:21:14.674415 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-serving-cert\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674553 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674428    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-service-ca\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674553 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-oauth-serving-cert\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674652 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674614    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-oauth-config\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674701 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl26k\" (UniqueName: \"kubernetes.io/projected/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-kube-api-access-jl26k\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674766 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-config\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.674815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.674781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-trusted-ca-bundle\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.775815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-oauth-serving-cert\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.775815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-oauth-config\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.775815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl26k\" (UniqueName: \"kubernetes.io/projected/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-kube-api-access-jl26k\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-config\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-trusted-ca-bundle\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775866    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-serving-cert\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.775879    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-service-ca\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776699 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.776670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-config\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776699 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.776686    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-service-ca\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776886 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.776744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-trusted-ca-bundle\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.776886 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.776789    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-oauth-serving-cert\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.778360 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.778333    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-oauth-config\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.778469 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.778429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-serving-cert\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.784275 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.784247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl26k\" (UniqueName: \"kubernetes.io/projected/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-kube-api-access-jl26k\") pod \"console-5c45d64677-rh8hg\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") " pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:14.963238 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:14.963197    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:15.239145 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:15.239006    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c45d64677-rh8hg"]
Sep 08 13:21:15.241756 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:21:15.241723    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8fbf48_e18c_43fd_9455_73e7ef3f6416.slice/crio-0c3bd12738b090843b20970e582cce7abade7822fa8f1fd1c7c0bdf7a99c0b5c WatchSource:0}: Error finding container 0c3bd12738b090843b20970e582cce7abade7822fa8f1fd1c7c0bdf7a99c0b5c: Status 404 returned error can't find the container with id 0c3bd12738b090843b20970e582cce7abade7822fa8f1fd1c7c0bdf7a99c0b5c
Sep 08 13:21:15.531547 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:15.531440    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45d64677-rh8hg" event={"ID":"1a8fbf48-e18c-43fd-9455-73e7ef3f6416","Type":"ContainerStarted","Data":"54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2"}
Sep 08 13:21:15.531547 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:15.531496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45d64677-rh8hg" event={"ID":"1a8fbf48-e18c-43fd-9455-73e7ef3f6416","Type":"ContainerStarted","Data":"0c3bd12738b090843b20970e582cce7abade7822fa8f1fd1c7c0bdf7a99c0b5c"}
Sep 08 13:21:15.552171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:15.552122    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c45d64677-rh8hg" podStartSLOduration=1.5521076969999998 podStartE2EDuration="1.552107697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:21:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:21:15.550590427 +0000 UTC m=+281.534791223" watchObservedRunningTime="2026-09-08 13:21:15.552107697 +0000 UTC m=+281.536308494"
Sep 08 13:21:24.964209 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:24.964170    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:24.964687 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:24.964266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:24.968987 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:24.968968    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:25.573294 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:25.573262    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:21:25.623080 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:25.623046    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84bb589f46-dggjz"]
Sep 08 13:21:34.420116 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:34.420084    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:21:34.423055 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:34.422854    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:21:34.437092 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:34.437074    2557 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 13:21:50.645304 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:50.645250    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84bb589f46-dggjz" podUID="78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" containerName="console" containerID="cri-o://e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37" gracePeriod=15
Sep 08 13:21:50.906142 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:50.906085    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:21:51.087270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087234    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-trusted-ca-bundle\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087283    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-config\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087314    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrblt\" (UniqueName: \"kubernetes.io/projected/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-kube-api-access-zrblt\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087348    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-oauth-config\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087363    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-oauth-serving-cert\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087383    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-serving-cert\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087440    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-service-ca\") pod \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\" (UID: \"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab\") "
Sep 08 13:21:51.087815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087786    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:21:51.087983 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087888    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:21:51.087983 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.087831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-config" (OuterVolumeSpecName: "console-config") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:21:51.088099 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.088012    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:21:51.089570 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.089544    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:51.090014 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.089990    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:21:51.090078 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.090006    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-kube-api-access-zrblt" (OuterVolumeSpecName: "kube-api-access-zrblt") pod "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" (UID: "78d70c85-297e-4bc2-9e72-6b8d0d09b6ab"). InnerVolumeSpecName "kube-api-access-zrblt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:21:51.188608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188542    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-trusted-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.188608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188569    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.188608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188579    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrblt\" (UniqueName: \"kubernetes.io/projected/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-kube-api-access-zrblt\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.188608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188589    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-oauth-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.188608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188597    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-oauth-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.188608 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188605    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-console-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.188864 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.188614    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:21:51.676321 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.676286    2557 generic.go:356] "Generic (PLEG): container finished" podID="78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" containerID="e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37" exitCode=0
Sep 08 13:21:51.676708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.676328    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84bb589f46-dggjz"
Sep 08 13:21:51.676708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.676375    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bb589f46-dggjz" event={"ID":"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab","Type":"ContainerDied","Data":"e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37"}
Sep 08 13:21:51.676708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.676423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84bb589f46-dggjz" event={"ID":"78d70c85-297e-4bc2-9e72-6b8d0d09b6ab","Type":"ContainerDied","Data":"c933fa7f719ba2ce87e6da28c5f8f63349d2501be766ea54397b2657bcad84f3"}
Sep 08 13:21:51.676708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.676446    2557 scope.go:117] "RemoveContainer" containerID="e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37"
Sep 08 13:21:51.685038 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.685021    2557 scope.go:117] "RemoveContainer" containerID="e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37"
Sep 08 13:21:51.685284 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:21:51.685265    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37\": container with ID starting with e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37 not found: ID does not exist" containerID="e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37"
Sep 08 13:21:51.685336 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.685293    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37"} err="failed to get container status \"e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37\": rpc error: code = NotFound desc = could not find container \"e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37\": container with ID starting with e4f73de9967e52f4c009a922c32ea83f30f94d615feab2b7d9491ef3971a7a37 not found: ID does not exist"
Sep 08 13:21:51.697364 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.697344    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84bb589f46-dggjz"]
Sep 08 13:21:51.701201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:51.701179    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84bb589f46-dggjz"]
Sep 08 13:21:52.495998 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:21:52.495968    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" path="/var/lib/kubelet/pods/78d70c85-297e-4bc2-9e72-6b8d0d09b6ab/volumes"
Sep 08 13:22:25.416108 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.416073    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c85b784fc-kf6h2"]
Sep 08 13:22:25.416599 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.416409    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" containerName="console"
Sep 08 13:22:25.416599 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.416420    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" containerName="console"
Sep 08 13:22:25.416599 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.416471    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="78d70c85-297e-4bc2-9e72-6b8d0d09b6ab" containerName="console"
Sep 08 13:22:25.420396 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.420369    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.428997 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.428974    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c85b784fc-kf6h2"]
Sep 08 13:22:25.476182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-serving-cert\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.476336 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-service-ca\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.476336 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476208    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-trusted-ca-bundle\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.476336 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-console-config\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.476440 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476349    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-oauth-serving-cert\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.476440 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7gzw\" (UniqueName: \"kubernetes.io/projected/09698c7a-39d6-4040-84dc-e4381a6e8510-kube-api-access-q7gzw\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.476503 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.476438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-oauth-config\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.577794 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.577764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-oauth-serving-cert\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.577794 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.577798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7gzw\" (UniqueName: \"kubernetes.io/projected/09698c7a-39d6-4040-84dc-e4381a6e8510-kube-api-access-q7gzw\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.577995 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.577899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-oauth-config\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578049 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578008    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-serving-cert\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578049 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578039    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-service-ca\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578147 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-trusted-ca-bundle\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578147 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-console-config\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578595 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578568    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-oauth-serving-cert\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578741 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-service-ca\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.578741 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.578737    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-console-config\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.579113 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.579082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-trusted-ca-bundle\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.580387 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.580369    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-serving-cert\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.580501 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.580484    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-oauth-config\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.586793 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.586767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7gzw\" (UniqueName: \"kubernetes.io/projected/09698c7a-39d6-4040-84dc-e4381a6e8510-kube-api-access-q7gzw\") pod \"console-5c85b784fc-kf6h2\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") " pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:25.731195 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:25.731160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:26.006022 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:26.005998    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c85b784fc-kf6h2"]
Sep 08 13:22:26.008851 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:22:26.008818    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09698c7a_39d6_4040_84dc_e4381a6e8510.slice/crio-2aad18551e42f6f67c122311b2831a70c25f64b6518ebf0673c5ef4a8ec5593c WatchSource:0}: Error finding container 2aad18551e42f6f67c122311b2831a70c25f64b6518ebf0673c5ef4a8ec5593c: Status 404 returned error can't find the container with id 2aad18551e42f6f67c122311b2831a70c25f64b6518ebf0673c5ef4a8ec5593c
Sep 08 13:22:26.820857 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:26.820817    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c85b784fc-kf6h2" event={"ID":"09698c7a-39d6-4040-84dc-e4381a6e8510","Type":"ContainerStarted","Data":"136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c"}
Sep 08 13:22:26.821240 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:26.820873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c85b784fc-kf6h2" event={"ID":"09698c7a-39d6-4040-84dc-e4381a6e8510","Type":"ContainerStarted","Data":"2aad18551e42f6f67c122311b2831a70c25f64b6518ebf0673c5ef4a8ec5593c"}
Sep 08 13:22:26.840974 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:26.840928    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c85b784fc-kf6h2" podStartSLOduration=1.840911967 podStartE2EDuration="1.840911967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:22:26.839038514 +0000 UTC m=+352.823239312" watchObservedRunningTime="2026-09-08 13:22:26.840911967 +0000 UTC m=+352.825112768"
Sep 08 13:22:35.732270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:35.732228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:35.732668 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:35.732337    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:35.736740 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:35.736717    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:35.860074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:35.860044    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:22:35.920949 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:22:35.920913    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c45d64677-rh8hg"]
Sep 08 13:23:00.948852 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:00.948808    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c45d64677-rh8hg" podUID="1a8fbf48-e18c-43fd-9455-73e7ef3f6416" containerName="console" containerID="cri-o://54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2" gracePeriod=15
Sep 08 13:23:01.181879 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.181850    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:23:01.270897 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.270860    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-config\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.270923    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-trusted-ca-bundle\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.270958    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-serving-cert\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.270986    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-oauth-serving-cert\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271085 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271010    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-service-ca\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271303 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271177    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-oauth-config\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271303 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271218    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-config" (OuterVolumeSpecName: "console-config") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:23:01.271303 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271238    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl26k\" (UniqueName: \"kubernetes.io/projected/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-kube-api-access-jl26k\") pod \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\" (UID: \"1a8fbf48-e18c-43fd-9455-73e7ef3f6416\") "
Sep 08 13:23:01.271460 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:23:01.271460 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271430    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:23:01.271460 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271441    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:23:01.271631 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271556    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-trusted-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.271631 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271574    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-oauth-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.271631 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271588    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.271631 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.271601    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.273132 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.273110    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:23:01.273341 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.273310    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:23:01.273341 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.273319    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-kube-api-access-jl26k" (OuterVolumeSpecName: "kube-api-access-jl26k") pod "1a8fbf48-e18c-43fd-9455-73e7ef3f6416" (UID: "1a8fbf48-e18c-43fd-9455-73e7ef3f6416"). InnerVolumeSpecName "kube-api-access-jl26k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:23:01.372729 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.372692    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-oauth-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.372729 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.372721    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl26k\" (UniqueName: \"kubernetes.io/projected/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-kube-api-access-jl26k\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.372729 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.372732    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8fbf48-e18c-43fd-9455-73e7ef3f6416-console-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:23:01.957270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.957239    2557 generic.go:356] "Generic (PLEG): container finished" podID="1a8fbf48-e18c-43fd-9455-73e7ef3f6416" containerID="54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2" exitCode=0
Sep 08 13:23:01.957686 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.957284    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45d64677-rh8hg" event={"ID":"1a8fbf48-e18c-43fd-9455-73e7ef3f6416","Type":"ContainerDied","Data":"54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2"}
Sep 08 13:23:01.957686 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.957317    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c45d64677-rh8hg" event={"ID":"1a8fbf48-e18c-43fd-9455-73e7ef3f6416","Type":"ContainerDied","Data":"0c3bd12738b090843b20970e582cce7abade7822fa8f1fd1c7c0bdf7a99c0b5c"}
Sep 08 13:23:01.957686 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.957336    2557 scope.go:117] "RemoveContainer" containerID="54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2"
Sep 08 13:23:01.957686 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.957286    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c45d64677-rh8hg"
Sep 08 13:23:01.965852 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.965832    2557 scope.go:117] "RemoveContainer" containerID="54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2"
Sep 08 13:23:01.966147 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:23:01.966128    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2\": container with ID starting with 54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2 not found: ID does not exist" containerID="54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2"
Sep 08 13:23:01.966199 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.966155    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2"} err="failed to get container status \"54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2\": rpc error: code = NotFound desc = could not find container \"54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2\": container with ID starting with 54975a2f39ec1f184c1865b6843ece7060d0c9d68dc71d9ad042747b92208db2 not found: ID does not exist"
Sep 08 13:23:01.977460 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.977438    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c45d64677-rh8hg"]
Sep 08 13:23:01.981384 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:01.981364    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c45d64677-rh8hg"]
Sep 08 13:23:02.496053 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:02.496014    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a8fbf48-e18c-43fd-9455-73e7ef3f6416" path="/var/lib/kubelet/pods/1a8fbf48-e18c-43fd-9455-73e7ef3f6416/volumes"
Sep 08 13:23:51.548048 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.548015    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"]
Sep 08 13:23:51.548470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.548317    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8fbf48-e18c-43fd-9455-73e7ef3f6416" containerName="console"
Sep 08 13:23:51.548470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.548328    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8fbf48-e18c-43fd-9455-73e7ef3f6416" containerName="console"
Sep 08 13:23:51.548470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.548379    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8fbf48-e18c-43fd-9455-73e7ef3f6416" containerName="console"
Sep 08 13:23:51.552638 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.552621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.554971 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.554950    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2j4hx\""
Sep 08 13:23:51.555098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.555049    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 13:23:51.555842 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.555825    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 13:23:51.567274 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.567252    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"]
Sep 08 13:23:51.687539 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.687477    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9v58\" (UniqueName: \"kubernetes.io/projected/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-kube-api-access-x9v58\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.687539 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.687545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.687772 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.687604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.788642 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.788608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.788807 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.788648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.788807 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.788723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9v58\" (UniqueName: \"kubernetes.io/projected/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-kube-api-access-x9v58\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.789041 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.789017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.789103 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.789037    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.800270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.800217    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9v58\" (UniqueName: \"kubernetes.io/projected/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-kube-api-access-x9v58\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:51.862064 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:51.862029    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:23:52.134840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:52.134812    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"]
Sep 08 13:23:52.136922 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:23:52.136881    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a63d7c7_f39c_4e90_9d44_e37906b04f8b.slice/crio-f7aca248f063bf868f6bef2e60fd9d9b96dc4d2e75e76c49781eb273290caa76 WatchSource:0}: Error finding container f7aca248f063bf868f6bef2e60fd9d9b96dc4d2e75e76c49781eb273290caa76: Status 404 returned error can't find the container with id f7aca248f063bf868f6bef2e60fd9d9b96dc4d2e75e76c49781eb273290caa76
Sep 08 13:23:52.138911 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:52.138890    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 13:23:52.155017 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:23:52.154988    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj" event={"ID":"6a63d7c7-f39c-4e90-9d44-e37906b04f8b","Type":"ContainerStarted","Data":"f7aca248f063bf868f6bef2e60fd9d9b96dc4d2e75e76c49781eb273290caa76"}
Sep 08 13:24:01.196264 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:01.196175    2557 generic.go:356] "Generic (PLEG): container finished" podID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerID="ad251afa8cd4abb2ba1e6ba2d69fccbfd0e8e77a53f1293c4400c384e3a23476" exitCode=0
Sep 08 13:24:01.196264 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:01.196233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj" event={"ID":"6a63d7c7-f39c-4e90-9d44-e37906b04f8b","Type":"ContainerDied","Data":"ad251afa8cd4abb2ba1e6ba2d69fccbfd0e8e77a53f1293c4400c384e3a23476"}
Sep 08 13:24:03.207345 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:03.207313    2557 generic.go:356] "Generic (PLEG): container finished" podID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerID="6c667f64ce782ac4b4c3ecc559163c154768a9239163cc8dbf996b62b2829b46" exitCode=0
Sep 08 13:24:03.207728 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:03.207393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj" event={"ID":"6a63d7c7-f39c-4e90-9d44-e37906b04f8b","Type":"ContainerDied","Data":"6c667f64ce782ac4b4c3ecc559163c154768a9239163cc8dbf996b62b2829b46"}
Sep 08 13:24:11.249297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:11.249259    2557 generic.go:356] "Generic (PLEG): container finished" podID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerID="7dea7c2a884c97bfc8b574b55cf1e86bfb50036e4bfb8293e75b7a6b67c589d3" exitCode=0
Sep 08 13:24:11.249742 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:11.249302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj" event={"ID":"6a63d7c7-f39c-4e90-9d44-e37906b04f8b","Type":"ContainerDied","Data":"7dea7c2a884c97bfc8b574b55cf1e86bfb50036e4bfb8293e75b7a6b67c589d3"}
Sep 08 13:24:12.386986 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.386959    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:24:12.471072 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.471031    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-util\") pod \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") "
Sep 08 13:24:12.471249 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.471086    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-bundle\") pod \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") "
Sep 08 13:24:12.471249 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.471117    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9v58\" (UniqueName: \"kubernetes.io/projected/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-kube-api-access-x9v58\") pod \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\" (UID: \"6a63d7c7-f39c-4e90-9d44-e37906b04f8b\") "
Sep 08 13:24:12.471726 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.471689    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-bundle" (OuterVolumeSpecName: "bundle") pod "6a63d7c7-f39c-4e90-9d44-e37906b04f8b" (UID: "6a63d7c7-f39c-4e90-9d44-e37906b04f8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 13:24:12.473327 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.473299    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-kube-api-access-x9v58" (OuterVolumeSpecName: "kube-api-access-x9v58") pod "6a63d7c7-f39c-4e90-9d44-e37906b04f8b" (UID: "6a63d7c7-f39c-4e90-9d44-e37906b04f8b"). InnerVolumeSpecName "kube-api-access-x9v58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:24:12.475200 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.475181    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-util" (OuterVolumeSpecName: "util") pod "6a63d7c7-f39c-4e90-9d44-e37906b04f8b" (UID: "6a63d7c7-f39c-4e90-9d44-e37906b04f8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 13:24:12.572443 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.572390    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-util\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:24:12.572443 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.572428    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:24:12.572653 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:12.572455    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9v58\" (UniqueName: \"kubernetes.io/projected/6a63d7c7-f39c-4e90-9d44-e37906b04f8b-kube-api-access-x9v58\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:24:13.259226 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:13.259189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj" event={"ID":"6a63d7c7-f39c-4e90-9d44-e37906b04f8b","Type":"ContainerDied","Data":"f7aca248f063bf868f6bef2e60fd9d9b96dc4d2e75e76c49781eb273290caa76"}
Sep 08 13:24:13.259226 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:13.259227    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1aczgfj"
Sep 08 13:24:13.259474 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:13.259233    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7aca248f063bf868f6bef2e60fd9d9b96dc4d2e75e76c49781eb273290caa76"
Sep 08 13:24:20.679083 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679050    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"]
Sep 08 13:24:20.679464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679386    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="extract"
Sep 08 13:24:20.679464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679399    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="extract"
Sep 08 13:24:20.679464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679419    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="util"
Sep 08 13:24:20.679464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679425    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="util"
Sep 08 13:24:20.679464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679433    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="pull"
Sep 08 13:24:20.679464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679438    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="pull"
Sep 08 13:24:20.679668 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.679491    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a63d7c7-f39c-4e90-9d44-e37906b04f8b" containerName="extract"
Sep 08 13:24:20.729844 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.729810    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"]
Sep 08 13:24:20.730000 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.729903    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:20.734251 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.734227    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 08 13:24:20.734373 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.734259    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 08 13:24:20.734373 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.734238    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 08 13:24:20.738512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.738492    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-6h5jm\""
Sep 08 13:24:20.839213 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.839182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0144b99a-28eb-4119-8010-c63f981b76ee-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-85q82\" (UID: \"0144b99a-28eb-4119-8010-c63f981b76ee\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:20.839341 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.839234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kppvz\" (UniqueName: \"kubernetes.io/projected/0144b99a-28eb-4119-8010-c63f981b76ee-kube-api-access-kppvz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-85q82\" (UID: \"0144b99a-28eb-4119-8010-c63f981b76ee\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:20.940668 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.940598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0144b99a-28eb-4119-8010-c63f981b76ee-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-85q82\" (UID: \"0144b99a-28eb-4119-8010-c63f981b76ee\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:20.940668 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.940645    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kppvz\" (UniqueName: \"kubernetes.io/projected/0144b99a-28eb-4119-8010-c63f981b76ee-kube-api-access-kppvz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-85q82\" (UID: \"0144b99a-28eb-4119-8010-c63f981b76ee\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:20.943007 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.942987    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/0144b99a-28eb-4119-8010-c63f981b76ee-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-85q82\" (UID: \"0144b99a-28eb-4119-8010-c63f981b76ee\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:20.952485 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:20.952457    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kppvz\" (UniqueName: \"kubernetes.io/projected/0144b99a-28eb-4119-8010-c63f981b76ee-kube-api-access-kppvz\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-85q82\" (UID: \"0144b99a-28eb-4119-8010-c63f981b76ee\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:21.039492 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:21.039461    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:21.328593 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:21.328563    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"]
Sep 08 13:24:21.330599 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:24:21.330568    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0144b99a_28eb_4119_8010_c63f981b76ee.slice/crio-960593a789725fc371a140588e8e29e695a594353f8a1e81479cc912d48088ec WatchSource:0}: Error finding container 960593a789725fc371a140588e8e29e695a594353f8a1e81479cc912d48088ec: Status 404 returned error can't find the container with id 960593a789725fc371a140588e8e29e695a594353f8a1e81479cc912d48088ec
Sep 08 13:24:22.298939 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:22.298898    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82" event={"ID":"0144b99a-28eb-4119-8010-c63f981b76ee","Type":"ContainerStarted","Data":"960593a789725fc371a140588e8e29e695a594353f8a1e81479cc912d48088ec"}
Sep 08 13:24:24.310119 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:24.310077    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82" event={"ID":"0144b99a-28eb-4119-8010-c63f981b76ee","Type":"ContainerStarted","Data":"196f1e5359d4880c4596c790c4b28759d3f375f1ffa24cb2a2a485edec003da3"}
Sep 08 13:24:24.310491 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:24.310141    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:24.343440 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:24.343379    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82" podStartSLOduration=1.751120099 podStartE2EDuration="4.34335971s" totalImagesPullingTime="2.592239611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:24:24.343158869 +0000 UTC m=+470.327359665" watchObservedRunningTime="2026-09-08 13:24:24.34335971 +0000 UTC m=+470.327560508"
Sep 08 13:24:24.967695 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:24.967658    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-mdjl7"]
Sep 08 13:24:24.969701 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:24.969684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:24.972478 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:24:24.972435    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"keda-operator-certs\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" type="*v1.Secret"
Sep 08 13:24:24.972629 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:24:24.972532    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"keda-operator-dockercfg-l8bh4\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-l8bh4\"" type="*v1.Secret"
Sep 08 13:24:24.972629 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:24:24.972560    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"keda-operator-579c8958f7-mdjl7\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" podUID="1a32b76c-0f56-45d5-b0a7-8dc37f79648a" pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:24.972745 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:24:24.972686    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"keda-ocp-cabundle\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-keda\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" type="*v1.ConfigMap"
Sep 08 13:24:24.989909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:24.989885    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-mdjl7"]
Sep 08 13:24:25.079377 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.079341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-certificates\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.079565 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.079395    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-cabundle0\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.079565 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.079497    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6f84\" (UniqueName: \"kubernetes.io/projected/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-kube-api-access-c6f84\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.180083 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.180052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-certificates\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.180256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.180101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-cabundle0\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.180256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.180169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6f84\" (UniqueName: \"kubernetes.io/projected/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-kube-api-access-c6f84\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.192621 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.192590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6f84\" (UniqueName: \"kubernetes.io/projected/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-kube-api-access-c6f84\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.762685 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.762652    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-drxkk"]
Sep 08 13:24:25.764887 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.764866    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:25.767794 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.767775    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Sep 08 13:24:25.777108 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.777085    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-drxkk"]
Sep 08 13:24:25.862779 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.862744    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 08 13:24:25.872873 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.872841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-certificates\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:25.885110 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.885072    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7246c0f-19ae-41d1-935d-19c6513259a6-certificates\") pod \"keda-admission-6c4d864b86-drxkk\" (UID: \"e7246c0f-19ae-41d1-935d-19c6513259a6\") " pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:25.885270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.885145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmbk6\" (UniqueName: \"kubernetes.io/projected/e7246c0f-19ae-41d1-935d-19c6513259a6-kube-api-access-xmbk6\") pod \"keda-admission-6c4d864b86-drxkk\" (UID: \"e7246c0f-19ae-41d1-935d-19c6513259a6\") " pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:25.986252 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.986215    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7246c0f-19ae-41d1-935d-19c6513259a6-certificates\") pod \"keda-admission-6c4d864b86-drxkk\" (UID: \"e7246c0f-19ae-41d1-935d-19c6513259a6\") " pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:25.986447 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:25.986285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmbk6\" (UniqueName: \"kubernetes.io/projected/e7246c0f-19ae-41d1-935d-19c6513259a6-kube-api-access-xmbk6\") pod \"keda-admission-6c4d864b86-drxkk\" (UID: \"e7246c0f-19ae-41d1-935d-19c6513259a6\") " pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:26.005783 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.005753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmbk6\" (UniqueName: \"kubernetes.io/projected/e7246c0f-19ae-41d1-935d-19c6513259a6-kube-api-access-xmbk6\") pod \"keda-admission-6c4d864b86-drxkk\" (UID: \"e7246c0f-19ae-41d1-935d-19c6513259a6\") " pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:26.051016 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.050937    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 08 13:24:26.059465 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.059434    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e7246c0f-19ae-41d1-935d-19c6513259a6-certificates\") pod \"keda-admission-6c4d864b86-drxkk\" (UID: \"e7246c0f-19ae-41d1-935d-19c6513259a6\") " pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:26.061637 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.061609    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/1a32b76c-0f56-45d5-b0a7-8dc37f79648a-cabundle0\") pod \"keda-operator-579c8958f7-mdjl7\" (UID: \"1a32b76c-0f56-45d5-b0a7-8dc37f79648a\") " pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:26.171256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.171220    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-l8bh4\""
Sep 08 13:24:26.176261 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.176075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:26.179647 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.179615    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:26.483144 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.483097    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-6c4d864b86-drxkk"]
Sep 08 13:24:26.485405 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:24:26.485369    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7246c0f_19ae_41d1_935d_19c6513259a6.slice/crio-47a553bc694b78d10ffee42109b1815fe7924610ba0b6bb4eb93635fc77a2b3c WatchSource:0}: Error finding container 47a553bc694b78d10ffee42109b1815fe7924610ba0b6bb4eb93635fc77a2b3c: Status 404 returned error can't find the container with id 47a553bc694b78d10ffee42109b1815fe7924610ba0b6bb4eb93635fc77a2b3c
Sep 08 13:24:26.505571 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:26.505545    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-mdjl7"]
Sep 08 13:24:26.509045 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:24:26.509017    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a32b76c_0f56_45d5_b0a7_8dc37f79648a.slice/crio-47f134c2c13fe737c299c8ea3486a401c7ec3fef2dacd2d501eda950f16214ea WatchSource:0}: Error finding container 47f134c2c13fe737c299c8ea3486a401c7ec3fef2dacd2d501eda950f16214ea: Status 404 returned error can't find the container with id 47f134c2c13fe737c299c8ea3486a401c7ec3fef2dacd2d501eda950f16214ea
Sep 08 13:24:27.324838 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:27.324792    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-mdjl7" event={"ID":"1a32b76c-0f56-45d5-b0a7-8dc37f79648a","Type":"ContainerStarted","Data":"47f134c2c13fe737c299c8ea3486a401c7ec3fef2dacd2d501eda950f16214ea"}
Sep 08 13:24:27.326135 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:27.326108    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-drxkk" event={"ID":"e7246c0f-19ae-41d1-935d-19c6513259a6","Type":"ContainerStarted","Data":"47a553bc694b78d10ffee42109b1815fe7924610ba0b6bb4eb93635fc77a2b3c"}
Sep 08 13:24:30.342182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:30.342153    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-mdjl7" event={"ID":"1a32b76c-0f56-45d5-b0a7-8dc37f79648a","Type":"ContainerStarted","Data":"27cc5991308abc5ba5128a893158b30555e03fa8a41e78640ebaa85a00130305"}
Sep 08 13:24:30.348235 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:30.342778    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:24:30.350300 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:30.350268    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-6c4d864b86-drxkk" event={"ID":"e7246c0f-19ae-41d1-935d-19c6513259a6","Type":"ContainerStarted","Data":"c9ea069d10174745d56e2fa2e07c3a562500d283a956d0bd3eef2aaa8ec4c1ec"}
Sep 08 13:24:30.350440 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:30.350421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:30.409238 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:30.409187    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-mdjl7" podStartSLOduration=3.550552456 podStartE2EDuration="6.409171406s" totalImagesPullingTime="2.85861895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:24:30.375888977 +0000 UTC m=+476.360089787" watchObservedRunningTime="2026-09-08 13:24:30.409171406 +0000 UTC m=+476.393372266"
Sep 08 13:24:30.409382 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:30.409276    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-6c4d864b86-drxkk" podStartSLOduration=1.61683198 podStartE2EDuration="5.409269618s" totalImagesPullingTime="3.792437638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:24:30.408450968 +0000 UTC m=+476.392651765" watchObservedRunningTime="2026-09-08 13:24:30.409269618 +0000 UTC m=+476.393470416"
Sep 08 13:24:45.316511 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:45.316483    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-85q82"
Sep 08 13:24:51.357477 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:51.357445    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-6c4d864b86-drxkk"
Sep 08 13:24:51.357880 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:24:51.357515    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-mdjl7"
Sep 08 13:25:16.711975 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.711937    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7bc5bdb8-9lbwj"]
Sep 08 13:25:16.716154 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.716132    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.729370 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.729342    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7bc5bdb8-9lbwj"]
Sep 08 13:25:16.821047 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821006    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-oauth-serving-cert\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.821047 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6djgp\" (UniqueName: \"kubernetes.io/projected/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-kube-api-access-6djgp\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.821270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-trusted-ca-bundle\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.821270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-oauth-config\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.821270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-config\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.821270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-service-ca\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.821270 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.821227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-serving-cert\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.921714 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.921676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-service-ca\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.921909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.921721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-serving-cert\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.921909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.921759    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-oauth-serving-cert\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.921909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.921774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6djgp\" (UniqueName: \"kubernetes.io/projected/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-kube-api-access-6djgp\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.921909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.921794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-trusted-ca-bundle\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.921909 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.921820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-oauth-config\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.922172 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.922017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-config\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.922516 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.922489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-service-ca\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.922645 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.922548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-oauth-serving-cert\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.922718 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.922653    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-trusted-ca-bundle\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.922718 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.922663    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-config\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.924221 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.924199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-serving-cert\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.924340 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.924287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-console-oauth-config\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:16.931788 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:16.931767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6djgp\" (UniqueName: \"kubernetes.io/projected/d399ba8e-7bf2-47d4-9443-6b69d1f1f933-kube-api-access-6djgp\") pod \"console-f7bc5bdb8-9lbwj\" (UID: \"d399ba8e-7bf2-47d4-9443-6b69d1f1f933\") " pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:17.026360 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:17.026272    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:17.313193 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:17.313120    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7bc5bdb8-9lbwj"]
Sep 08 13:25:17.316224 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:25:17.316192    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd399ba8e_7bf2_47d4_9443_6b69d1f1f933.slice/crio-500eca14efa8a163733d57585c9035bbc5fa070911c9904e7753a0002b7ce16f WatchSource:0}: Error finding container 500eca14efa8a163733d57585c9035bbc5fa070911c9904e7753a0002b7ce16f: Status 404 returned error can't find the container with id 500eca14efa8a163733d57585c9035bbc5fa070911c9904e7753a0002b7ce16f
Sep 08 13:25:17.560934 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:17.560897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7bc5bdb8-9lbwj" event={"ID":"d399ba8e-7bf2-47d4-9443-6b69d1f1f933","Type":"ContainerStarted","Data":"55774e514cbfb21ce80622e2b42b1d0694ba8f5f91f38a6c0f951fd0f4cacb9f"}
Sep 08 13:25:17.561098 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:17.560947    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7bc5bdb8-9lbwj" event={"ID":"d399ba8e-7bf2-47d4-9443-6b69d1f1f933","Type":"ContainerStarted","Data":"500eca14efa8a163733d57585c9035bbc5fa070911c9904e7753a0002b7ce16f"}
Sep 08 13:25:27.027234 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:27.027133    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:27.027234 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:27.027220    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:27.031910 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:27.031883    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:27.069596 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:27.069544    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f7bc5bdb8-9lbwj" podStartSLOduration=11.069510661 podStartE2EDuration="11.069510661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:25:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:25:17.598383478 +0000 UTC m=+523.582584276" watchObservedRunningTime="2026-09-08 13:25:27.069510661 +0000 UTC m=+533.053711458"
Sep 08 13:25:27.608376 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:27.608345    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7bc5bdb8-9lbwj"
Sep 08 13:25:27.664651 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:27.664610    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c85b784fc-kf6h2"]
Sep 08 13:25:45.831769 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.831734    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-4qqst"]
Sep 08 13:25:45.834370 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.834350    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:45.836661 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.836640    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 08 13:25:45.837283 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.837264    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 08 13:25:45.837362 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.837284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-brrwd\""
Sep 08 13:25:45.837362 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.837268    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 08 13:25:45.847709 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.847688    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-4qqst"]
Sep 08 13:25:45.866501 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.866480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-cert\") pod \"kserve-controller-manager-575d6764f4-4qqst\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") " pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:45.866639 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.866609    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb56b\" (UniqueName: \"kubernetes.io/projected/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-kube-api-access-kb56b\") pod \"kserve-controller-manager-575d6764f4-4qqst\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") " pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:45.870937 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.870913    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-bmq4v"]
Sep 08 13:25:45.873055 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.873042    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:45.875083 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.875063    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Sep 08 13:25:45.875182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.875085    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-j4d29\""
Sep 08 13:25:45.881695 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.881673    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-bmq4v"]
Sep 08 13:25:45.967585 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.967554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb56b\" (UniqueName: \"kubernetes.io/projected/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-kube-api-access-kb56b\") pod \"kserve-controller-manager-575d6764f4-4qqst\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") " pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:45.967745 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.967606    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41b683c1-54d9-4ad9-b2b7-8dc07df43606-data\") pod \"seaweedfs-64568bcd49-bmq4v\" (UID: \"41b683c1-54d9-4ad9-b2b7-8dc07df43606\") " pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:45.967745 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.967630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-cert\") pod \"kserve-controller-manager-575d6764f4-4qqst\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") " pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:45.967745 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.967675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5d9\" (UniqueName: \"kubernetes.io/projected/41b683c1-54d9-4ad9-b2b7-8dc07df43606-kube-api-access-8m5d9\") pod \"seaweedfs-64568bcd49-bmq4v\" (UID: \"41b683c1-54d9-4ad9-b2b7-8dc07df43606\") " pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:45.969935 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.969914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-cert\") pod \"kserve-controller-manager-575d6764f4-4qqst\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") " pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:45.975039 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:45.975020    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb56b\" (UniqueName: \"kubernetes.io/projected/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-kube-api-access-kb56b\") pod \"kserve-controller-manager-575d6764f4-4qqst\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") " pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:46.068532 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.068486    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5d9\" (UniqueName: \"kubernetes.io/projected/41b683c1-54d9-4ad9-b2b7-8dc07df43606-kube-api-access-8m5d9\") pod \"seaweedfs-64568bcd49-bmq4v\" (UID: \"41b683c1-54d9-4ad9-b2b7-8dc07df43606\") " pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:46.068679 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.068580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41b683c1-54d9-4ad9-b2b7-8dc07df43606-data\") pod \"seaweedfs-64568bcd49-bmq4v\" (UID: \"41b683c1-54d9-4ad9-b2b7-8dc07df43606\") " pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:46.068885 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.068870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/41b683c1-54d9-4ad9-b2b7-8dc07df43606-data\") pod \"seaweedfs-64568bcd49-bmq4v\" (UID: \"41b683c1-54d9-4ad9-b2b7-8dc07df43606\") " pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:46.078058 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.078033    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5d9\" (UniqueName: \"kubernetes.io/projected/41b683c1-54d9-4ad9-b2b7-8dc07df43606-kube-api-access-8m5d9\") pod \"seaweedfs-64568bcd49-bmq4v\" (UID: \"41b683c1-54d9-4ad9-b2b7-8dc07df43606\") " pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:46.144541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.144451    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:46.183631 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.183602    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:46.416569 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.416487    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-4qqst"]
Sep 08 13:25:46.420130 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:25:46.420101    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eeb240f_8efd_4d1b_9f61_5fe6f98c239f.slice/crio-2e1d5057aaa2f191a395f351e889b0cf36f284bf75d98975f08fb747af6c8e6d WatchSource:0}: Error finding container 2e1d5057aaa2f191a395f351e889b0cf36f284bf75d98975f08fb747af6c8e6d: Status 404 returned error can't find the container with id 2e1d5057aaa2f191a395f351e889b0cf36f284bf75d98975f08fb747af6c8e6d
Sep 08 13:25:46.458076 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.458055    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-bmq4v"]
Sep 08 13:25:46.460161 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:25:46.460135    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b683c1_54d9_4ad9_b2b7_8dc07df43606.slice/crio-93cbec5c9ed441396b78f647a242f4f853b0ef09808d0e78e91697057199209e WatchSource:0}: Error finding container 93cbec5c9ed441396b78f647a242f4f853b0ef09808d0e78e91697057199209e: Status 404 returned error can't find the container with id 93cbec5c9ed441396b78f647a242f4f853b0ef09808d0e78e91697057199209e
Sep 08 13:25:46.692617 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.692514    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-4qqst" event={"ID":"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f","Type":"ContainerStarted","Data":"2e1d5057aaa2f191a395f351e889b0cf36f284bf75d98975f08fb747af6c8e6d"}
Sep 08 13:25:46.693701 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:46.693678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-bmq4v" event={"ID":"41b683c1-54d9-4ad9-b2b7-8dc07df43606","Type":"ContainerStarted","Data":"93cbec5c9ed441396b78f647a242f4f853b0ef09808d0e78e91697057199209e"}
Sep 08 13:25:50.717840 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:50.717793    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-bmq4v" event={"ID":"41b683c1-54d9-4ad9-b2b7-8dc07df43606","Type":"ContainerStarted","Data":"7d0d05ab9c5cc70b692922569ddb92ab066314d7dd650932c797c30fa75a7f37"}
Sep 08 13:25:50.718324 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:50.717960    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:25:50.719369 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:50.719344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-4qqst" event={"ID":"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f","Type":"ContainerStarted","Data":"e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c"}
Sep 08 13:25:50.719483 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:50.719470    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:25:50.734134 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:50.734091    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-bmq4v" podStartSLOduration=2.14828619 podStartE2EDuration="5.734078879s" totalImagesPullingTime="3.585792689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:25:50.732249174 +0000 UTC m=+556.716449971" watchObservedRunningTime="2026-09-08 13:25:50.734078879 +0000 UTC m=+556.718279675"
Sep 08 13:25:50.748847 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:50.748806    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-575d6764f4-4qqst" podStartSLOduration=2.20948719 podStartE2EDuration="5.748791709s" totalImagesPullingTime="3.539304519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:25:50.747385659 +0000 UTC m=+556.731586456" watchObservedRunningTime="2026-09-08 13:25:50.748791709 +0000 UTC m=+556.732992506"
Sep 08 13:25:52.688668 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:52.688623    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c85b784fc-kf6h2" podUID="09698c7a-39d6-4040-84dc-e4381a6e8510" containerName="console" containerID="cri-o://136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c" gracePeriod=15
Sep 08 13:25:52.931068 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:52.931043    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:25:53.031051 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031010    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-oauth-serving-cert\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031051 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031061    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-console-config\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031083    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-serving-cert\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031103    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-service-ca\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031126    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-oauth-config\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-trusted-ca-bundle\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031297 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031200    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7gzw\" (UniqueName: \"kubernetes.io/projected/09698c7a-39d6-4040-84dc-e4381a6e8510-kube-api-access-q7gzw\") pod \"09698c7a-39d6-4040-84dc-e4381a6e8510\" (UID: \"09698c7a-39d6-4040-84dc-e4381a6e8510\") "
Sep 08 13:25:53.031651 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031503    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:25:53.031651 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031549    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-console-config" (OuterVolumeSpecName: "console-config") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:25:53.031651 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031572    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-service-ca" (OuterVolumeSpecName: "service-ca") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:25:53.031771 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.031674    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:25:53.033316 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.033292    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:25:53.033419 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.033326    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:25:53.033419 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.033335    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09698c7a-39d6-4040-84dc-e4381a6e8510-kube-api-access-q7gzw" (OuterVolumeSpecName: "kube-api-access-q7gzw") pod "09698c7a-39d6-4040-84dc-e4381a6e8510" (UID: "09698c7a-39d6-4040-84dc-e4381a6e8510"). InnerVolumeSpecName "kube-api-access-q7gzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:25:53.131858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131828    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-oauth-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.131858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131854    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-console-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.131858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131863    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-serving-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.132056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131874    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-service-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.132056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131882    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09698c7a-39d6-4040-84dc-e4381a6e8510-console-oauth-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.132056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131890    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09698c7a-39d6-4040-84dc-e4381a6e8510-trusted-ca-bundle\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.132056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.131898    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7gzw\" (UniqueName: \"kubernetes.io/projected/09698c7a-39d6-4040-84dc-e4381a6e8510-kube-api-access-q7gzw\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:25:53.734361 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.734329    2557 generic.go:356] "Generic (PLEG): container finished" podID="09698c7a-39d6-4040-84dc-e4381a6e8510" containerID="136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c" exitCode=0
Sep 08 13:25:53.734770 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.734366    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c85b784fc-kf6h2"
Sep 08 13:25:53.734770 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.734371    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c85b784fc-kf6h2" event={"ID":"09698c7a-39d6-4040-84dc-e4381a6e8510","Type":"ContainerDied","Data":"136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c"}
Sep 08 13:25:53.734770 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.734505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c85b784fc-kf6h2" event={"ID":"09698c7a-39d6-4040-84dc-e4381a6e8510","Type":"ContainerDied","Data":"2aad18551e42f6f67c122311b2831a70c25f64b6518ebf0673c5ef4a8ec5593c"}
Sep 08 13:25:53.734770 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.734556    2557 scope.go:117] "RemoveContainer" containerID="136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c"
Sep 08 13:25:53.743765 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.743747    2557 scope.go:117] "RemoveContainer" containerID="136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c"
Sep 08 13:25:53.744046 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:25:53.744027    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c\": container with ID starting with 136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c not found: ID does not exist" containerID="136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c"
Sep 08 13:25:53.744092 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.744054    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c"} err="failed to get container status \"136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c\": rpc error: code = NotFound desc = could not find container \"136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c\": container with ID starting with 136e1e330ff9d76f5042c8b7094541ba01d74211f96900a433d2b774c5257e8c not found: ID does not exist"
Sep 08 13:25:53.753985 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.753960    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c85b784fc-kf6h2"]
Sep 08 13:25:53.757342 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:53.757321    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c85b784fc-kf6h2"]
Sep 08 13:25:54.496088 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:54.496054    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09698c7a-39d6-4040-84dc-e4381a6e8510" path="/var/lib/kubelet/pods/09698c7a-39d6-4040-84dc-e4381a6e8510/volumes"
Sep 08 13:25:56.726204 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:25:56.726178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-bmq4v"
Sep 08 13:26:21.729726 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:21.729692    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:26:28.341611 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.341576    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-4qqst"]
Sep 08 13:26:28.342011 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.341765    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-575d6764f4-4qqst" podUID="3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" containerName="manager" containerID="cri-o://e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c" gracePeriod=10
Sep 08 13:26:28.368366 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.368338    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-tcn96"]
Sep 08 13:26:28.368712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.368699    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09698c7a-39d6-4040-84dc-e4381a6e8510" containerName="console"
Sep 08 13:26:28.368768 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.368714    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="09698c7a-39d6-4040-84dc-e4381a6e8510" containerName="console"
Sep 08 13:26:28.368806 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.368769    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="09698c7a-39d6-4040-84dc-e4381a6e8510" containerName="console"
Sep 08 13:26:28.370554 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.370538    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.379898 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.379875    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-tcn96"]
Sep 08 13:26:28.437749 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.437720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgb8q\" (UniqueName: \"kubernetes.io/projected/1cd47b46-8ec5-424a-9071-8bf2d06c63eb-kube-api-access-zgb8q\") pod \"kserve-controller-manager-575d6764f4-tcn96\" (UID: \"1cd47b46-8ec5-424a-9071-8bf2d06c63eb\") " pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.437850 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.437766    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cd47b46-8ec5-424a-9071-8bf2d06c63eb-cert\") pod \"kserve-controller-manager-575d6764f4-tcn96\" (UID: \"1cd47b46-8ec5-424a-9071-8bf2d06c63eb\") " pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.539189 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.539154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgb8q\" (UniqueName: \"kubernetes.io/projected/1cd47b46-8ec5-424a-9071-8bf2d06c63eb-kube-api-access-zgb8q\") pod \"kserve-controller-manager-575d6764f4-tcn96\" (UID: \"1cd47b46-8ec5-424a-9071-8bf2d06c63eb\") " pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.539337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.539216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cd47b46-8ec5-424a-9071-8bf2d06c63eb-cert\") pod \"kserve-controller-manager-575d6764f4-tcn96\" (UID: \"1cd47b46-8ec5-424a-9071-8bf2d06c63eb\") " pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.541438 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.541416    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1cd47b46-8ec5-424a-9071-8bf2d06c63eb-cert\") pod \"kserve-controller-manager-575d6764f4-tcn96\" (UID: \"1cd47b46-8ec5-424a-9071-8bf2d06c63eb\") " pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.547345 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.547321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgb8q\" (UniqueName: \"kubernetes.io/projected/1cd47b46-8ec5-424a-9071-8bf2d06c63eb-kube-api-access-zgb8q\") pod \"kserve-controller-manager-575d6764f4-tcn96\" (UID: \"1cd47b46-8ec5-424a-9071-8bf2d06c63eb\") " pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.581136 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.581116    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:26:28.640113 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.640026    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-cert\") pod \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") "
Sep 08 13:26:28.640267 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.640113    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb56b\" (UniqueName: \"kubernetes.io/projected/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-kube-api-access-kb56b\") pod \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\" (UID: \"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f\") "
Sep 08 13:26:28.642111 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.642083    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-kube-api-access-kb56b" (OuterVolumeSpecName: "kube-api-access-kb56b") pod "3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" (UID: "3eeb240f-8efd-4d1b-9f61-5fe6f98c239f"). InnerVolumeSpecName "kube-api-access-kb56b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:26:28.642111 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.642094    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-cert" (OuterVolumeSpecName: "cert") pod "3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" (UID: "3eeb240f-8efd-4d1b-9f61-5fe6f98c239f"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:26:28.729543 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.729483    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:28.741935 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.741911    2557 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-cert\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:26:28.742022 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.741936    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb56b\" (UniqueName: \"kubernetes.io/projected/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f-kube-api-access-kb56b\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:26:28.903482 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.903404    2557 generic.go:356] "Generic (PLEG): container finished" podID="3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" containerID="e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c" exitCode=0
Sep 08 13:26:28.903482 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.903437    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-4qqst" event={"ID":"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f","Type":"ContainerDied","Data":"e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c"}
Sep 08 13:26:28.903682 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.903446    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-575d6764f4-4qqst"
Sep 08 13:26:28.903682 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.903497    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-4qqst" event={"ID":"3eeb240f-8efd-4d1b-9f61-5fe6f98c239f","Type":"ContainerDied","Data":"2e1d5057aaa2f191a395f351e889b0cf36f284bf75d98975f08fb747af6c8e6d"}
Sep 08 13:26:28.903682 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.903533    2557 scope.go:117] "RemoveContainer" containerID="e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c"
Sep 08 13:26:28.912116 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.912097    2557 scope.go:117] "RemoveContainer" containerID="e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c"
Sep 08 13:26:28.912372 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:26:28.912353    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c\": container with ID starting with e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c not found: ID does not exist" containerID="e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c"
Sep 08 13:26:28.912431 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.912383    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c"} err="failed to get container status \"e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c\": rpc error: code = NotFound desc = could not find container \"e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c\": container with ID starting with e03a5e62b18a6b948f0be6a2bb2fb8b41c7d23cf1c15db171cf5ae52e3a1134c not found: ID does not exist"
Sep 08 13:26:28.923118 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.923081    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-4qqst"]
Sep 08 13:26:28.926790 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.926760    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-4qqst"]
Sep 08 13:26:28.996406 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:28.996374    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-575d6764f4-tcn96"]
Sep 08 13:26:28.998970 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:26:28.998938    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd47b46_8ec5_424a_9071_8bf2d06c63eb.slice/crio-3314f80a45039227fec89f826aa8e3f9d2f9b9e20344a07d5092ca6712d17bce WatchSource:0}: Error finding container 3314f80a45039227fec89f826aa8e3f9d2f9b9e20344a07d5092ca6712d17bce: Status 404 returned error can't find the container with id 3314f80a45039227fec89f826aa8e3f9d2f9b9e20344a07d5092ca6712d17bce
Sep 08 13:26:29.909716 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:29.909681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-tcn96" event={"ID":"1cd47b46-8ec5-424a-9071-8bf2d06c63eb","Type":"ContainerStarted","Data":"3314f80a45039227fec89f826aa8e3f9d2f9b9e20344a07d5092ca6712d17bce"}
Sep 08 13:26:30.502398 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:30.502362    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" path="/var/lib/kubelet/pods/3eeb240f-8efd-4d1b-9f61-5fe6f98c239f/volumes"
Sep 08 13:26:32.925754 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:32.925711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-575d6764f4-tcn96" event={"ID":"1cd47b46-8ec5-424a-9071-8bf2d06c63eb","Type":"ContainerStarted","Data":"8b2e870eab169a05cf93f53e791db804cfe9c4eb48f2765920f3c2cec4519bcb"}
Sep 08 13:26:32.926165 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:32.925861    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:26:32.943325 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:32.943278    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-575d6764f4-tcn96" podStartSLOduration=2.034287111 podStartE2EDuration="4.943265596s" totalImagesPullingTime="2.908978485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:26:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:26:32.941989064 +0000 UTC m=+598.926189861" watchObservedRunningTime="2026-09-08 13:26:32.943265596 +0000 UTC m=+598.927466394"
Sep 08 13:26:34.455955 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:34.455928    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:26:34.456953 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:26:34.456932    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:27:03.934707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:03.934626    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-575d6764f4-tcn96"
Sep 08 13:27:05.262104 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.262074    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-vztfn"]
Sep 08 13:27:05.262475 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.262448    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" containerName="manager"
Sep 08 13:27:05.262475 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.262459    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" containerName="manager"
Sep 08 13:27:05.262578 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.262544    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eeb240f-8efd-4d1b-9f61-5fe6f98c239f" containerName="manager"
Sep 08 13:27:05.264736 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.264713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.266726 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.266697    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Sep 08 13:27:05.266857 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.266793    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Sep 08 13:27:05.266857 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.266826    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-vhtsz\""
Sep 08 13:27:05.275446 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.275426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-vztfn"]
Sep 08 13:27:05.357824 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.357793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-metrics-certs\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.357991 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.357835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgkpb\" (UniqueName: \"kubernetes.io/projected/6dc03adf-20a2-47ab-95cf-78314c6f9ada-kube-api-access-pgkpb\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.357991 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.357901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-cert\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.458841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.458803    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-metrics-certs\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.459027 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.458848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkpb\" (UniqueName: \"kubernetes.io/projected/6dc03adf-20a2-47ab-95cf-78314c6f9ada-kube-api-access-pgkpb\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.459027 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.458966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-cert\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.459163 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:27:05.459106    2557 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 13:27:05.459218 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:27:05.459176    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-cert podName:6dc03adf-20a2-47ab-95cf-78314c6f9ada nodeName:}" failed. No retries permitted until 2026-09-08 13:27:05.959160387 +0000 UTC m=+631.943361162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-cert") pod "odh-model-controller-7b966d7984-vztfn" (UID: "6dc03adf-20a2-47ab-95cf-78314c6f9ada") : secret "odh-model-controller-webhook-cert" not found
Sep 08 13:27:05.461440 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.461414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-metrics-certs\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.466109 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.466091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkpb\" (UniqueName: \"kubernetes.io/projected/6dc03adf-20a2-47ab-95cf-78314c6f9ada-kube-api-access-pgkpb\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.962652 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.962616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-cert\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:05.964952 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:05.964930    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dc03adf-20a2-47ab-95cf-78314c6f9ada-cert\") pod \"odh-model-controller-7b966d7984-vztfn\" (UID: \"6dc03adf-20a2-47ab-95cf-78314c6f9ada\") " pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:06.175783 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:06.175754    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:06.443359 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:06.443336    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-vztfn"]
Sep 08 13:27:06.445515 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:27:06.445485    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc03adf_20a2_47ab_95cf_78314c6f9ada.slice/crio-c7356c24b1ad703ad44cfe752446ff999cf56f27169a1ce1e46391a2556ef713 WatchSource:0}: Error finding container c7356c24b1ad703ad44cfe752446ff999cf56f27169a1ce1e46391a2556ef713: Status 404 returned error can't find the container with id c7356c24b1ad703ad44cfe752446ff999cf56f27169a1ce1e46391a2556ef713
Sep 08 13:27:07.078051 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:07.078017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-vztfn" event={"ID":"6dc03adf-20a2-47ab-95cf-78314c6f9ada","Type":"ContainerStarted","Data":"c7356c24b1ad703ad44cfe752446ff999cf56f27169a1ce1e46391a2556ef713"}
Sep 08 13:27:14.114886 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:14.114845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-vztfn" event={"ID":"6dc03adf-20a2-47ab-95cf-78314c6f9ada","Type":"ContainerStarted","Data":"1a0b494a9936178df1cf089eb06c86c4576f8c4160043285084b9622234ae6f9"}
Sep 08 13:27:14.115290 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:14.114924    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:27:14.132759 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:14.132707    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-vztfn" podStartSLOduration=2.034017879 podStartE2EDuration="9.132692864s" totalImagesPullingTime="7.098674985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:27:14.130655431 +0000 UTC m=+640.114856228" watchObservedRunningTime="2026-09-08 13:27:14.132692864 +0000 UTC m=+640.116893660"
Sep 08 13:27:25.121932 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:27:25.121894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-vztfn"
Sep 08 13:28:58.294920 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.294842    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"]
Sep 08 13:28:58.297290 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.297274    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.299765 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.299739    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-f794f-predictor-serving-cert\""
Sep 08 13:28:58.300210 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.300191    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-f794f-kube-rbac-proxy-sar-config\""
Sep 08 13:28:58.300716 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.300678    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 08 13:28:58.301391 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.301371    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-pw8wg\""
Sep 08 13:28:58.301489 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.301374    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 08 13:28:58.312667 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.312630    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"]
Sep 08 13:28:58.326365 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.326342    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.326470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.326416    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bhqb\" (UniqueName: \"kubernetes.io/projected/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-api-access-7bhqb\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.326470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.326462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.427423 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.427389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.427598 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.427461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bhqb\" (UniqueName: \"kubernetes.io/projected/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-api-access-7bhqb\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.427598 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.427508    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.427598 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:28:58.427577    2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-f794f-predictor-serving-cert: secret "error-404-isvc-f794f-predictor-serving-cert" not found
Sep 08 13:28:58.427736 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:28:58.427657    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls podName:15cac488-fad7-4af0-ba52-bd9c149ba2d8 nodeName:}" failed. No retries permitted until 2026-09-08 13:28:58.927636176 +0000 UTC m=+744.911836962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls") pod "error-404-isvc-f794f-predictor-f4899d6f4-94s6d" (UID: "15cac488-fad7-4af0-ba52-bd9c149ba2d8") : secret "error-404-isvc-f794f-predictor-serving-cert" not found
Sep 08 13:28:58.428144 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.428124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.438931 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.438901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bhqb\" (UniqueName: \"kubernetes.io/projected/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-api-access-7bhqb\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.932379 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.932346    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:58.934758 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:58.934729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls\") pod \"error-404-isvc-f794f-predictor-f4899d6f4-94s6d\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") " pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:59.207821 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:59.207786    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:28:59.478135 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:59.478109    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"]
Sep 08 13:28:59.480426 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:28:59.480391    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cac488_fad7_4af0_ba52_bd9c149ba2d8.slice/crio-cc13b578129260a1f15fe64f1a0cd0e704797b25bdd7451b2ac0b5a9a2c8c6c9 WatchSource:0}: Error finding container cc13b578129260a1f15fe64f1a0cd0e704797b25bdd7451b2ac0b5a9a2c8c6c9: Status 404 returned error can't find the container with id cc13b578129260a1f15fe64f1a0cd0e704797b25bdd7451b2ac0b5a9a2c8c6c9
Sep 08 13:28:59.482327 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:59.482307    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 13:28:59.596669 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:28:59.596630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" event={"ID":"15cac488-fad7-4af0-ba52-bd9c149ba2d8","Type":"ContainerStarted","Data":"cc13b578129260a1f15fe64f1a0cd0e704797b25bdd7451b2ac0b5a9a2c8c6c9"}
Sep 08 13:29:13.685810 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:13.685762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" event={"ID":"15cac488-fad7-4af0-ba52-bd9c149ba2d8","Type":"ContainerStarted","Data":"2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc"}
Sep 08 13:29:15.698582 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:15.698475    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" event={"ID":"15cac488-fad7-4af0-ba52-bd9c149ba2d8","Type":"ContainerStarted","Data":"092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d"}
Sep 08 13:29:15.698582 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:15.698552    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:29:15.698582 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:15.698577    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:29:15.699993 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:15.699961    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 08 13:29:15.717362 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:15.717313    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podStartSLOduration=1.835742429 podStartE2EDuration="17.717297378s" totalImagesPullingTime="15.881554949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:28:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:29:15.715906268 +0000 UTC m=+761.700107065" watchObservedRunningTime="2026-09-08 13:29:15.717297378 +0000 UTC m=+761.701498174"
Sep 08 13:29:16.703320 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:16.703274    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 08 13:29:21.708404 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:21.708374    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:29:21.708867 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:21.708841    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 08 13:29:31.709240 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:31.709204    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 08 13:29:41.709185 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:41.709148    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 08 13:29:51.708925 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:29:51.708890    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.35:8080: connect: connection refused"
Sep 08 13:30:01.709743 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:01.709663    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:30:32.192179 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.192143    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"]
Sep 08 13:30:32.192777 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.192450    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kube-rbac-proxy" containerID="cri-o://092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d" gracePeriod=30
Sep 08 13:30:32.192867 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.192412    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container" containerID="cri-o://2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc" gracePeriod=30
Sep 08 13:30:32.243396 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.243364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"]
Sep 08 13:30:32.246794 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.246780    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.249678 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.249653    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-87be3-predictor-serving-cert\""
Sep 08 13:30:32.249801 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.249737    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-87be3-kube-rbac-proxy-sar-config\""
Sep 08 13:30:32.256190 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.256167    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"]
Sep 08 13:30:32.370307 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.370269    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1821e85-bea3-485a-a68e-68953c5cae01-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.370479 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.370355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1821e85-bea3-485a-a68e-68953c5cae01-proxy-tls\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.370479 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.370393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fct2j\" (UniqueName: \"kubernetes.io/projected/d1821e85-bea3-485a-a68e-68953c5cae01-kube-api-access-fct2j\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.472114 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.471840    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1821e85-bea3-485a-a68e-68953c5cae01-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.472114 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.471942    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1821e85-bea3-485a-a68e-68953c5cae01-proxy-tls\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.472114 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.471980    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fct2j\" (UniqueName: \"kubernetes.io/projected/d1821e85-bea3-485a-a68e-68953c5cae01-kube-api-access-fct2j\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.472811 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.472788    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1821e85-bea3-485a-a68e-68953c5cae01-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.474590 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.474572    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1821e85-bea3-485a-a68e-68953c5cae01-proxy-tls\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.480224 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.480201    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fct2j\" (UniqueName: \"kubernetes.io/projected/d1821e85-bea3-485a-a68e-68953c5cae01-kube-api-access-fct2j\") pod \"error-404-isvc-87be3-predictor-5656fc75d4-x59s5\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") " pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.557715 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.557678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:32.829722 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:32.829695    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"]
Sep 08 13:30:32.831811 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:30:32.831783    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1821e85_bea3_485a_a68e_68953c5cae01.slice/crio-c45890dcc67bc5e1963c9d0b7fcd89e16bab774f2f0144c668049caacdfbd0c9 WatchSource:0}: Error finding container c45890dcc67bc5e1963c9d0b7fcd89e16bab774f2f0144c668049caacdfbd0c9: Status 404 returned error can't find the container with id c45890dcc67bc5e1963c9d0b7fcd89e16bab774f2f0144c668049caacdfbd0c9
Sep 08 13:30:33.053590 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.053552    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" event={"ID":"15cac488-fad7-4af0-ba52-bd9c149ba2d8","Type":"ContainerDied","Data":"092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d"}
Sep 08 13:30:33.053748 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.053620    2557 generic.go:356] "Generic (PLEG): container finished" podID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerID="092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d" exitCode=2
Sep 08 13:30:33.056083 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.056052    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" event={"ID":"d1821e85-bea3-485a-a68e-68953c5cae01","Type":"ContainerStarted","Data":"dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33"}
Sep 08 13:30:33.056232 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.056106    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" event={"ID":"d1821e85-bea3-485a-a68e-68953c5cae01","Type":"ContainerStarted","Data":"b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac"}
Sep 08 13:30:33.056232 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.056135    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" event={"ID":"d1821e85-bea3-485a-a68e-68953c5cae01","Type":"ContainerStarted","Data":"c45890dcc67bc5e1963c9d0b7fcd89e16bab774f2f0144c668049caacdfbd0c9"}
Sep 08 13:30:33.056232 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.056211    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:33.086870 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:33.086774    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podStartSLOduration=1.086756729 podStartE2EDuration="1.086756729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:30:33.08337502 +0000 UTC m=+839.067575840" watchObservedRunningTime="2026-09-08 13:30:33.086756729 +0000 UTC m=+839.070957525"
Sep 08 13:30:34.061154 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:34.061119    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:34.062723 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:34.062695    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:30:35.066292 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.066253    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:30:35.338946 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.338921    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:30:35.396459 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.396433    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls\") pod \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") "
Sep 08 13:30:35.396606 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.396494    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-rbac-proxy-sar-config\") pod \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") "
Sep 08 13:30:35.396606 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.396556    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bhqb\" (UniqueName: \"kubernetes.io/projected/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-api-access-7bhqb\") pod \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\" (UID: \"15cac488-fad7-4af0-ba52-bd9c149ba2d8\") "
Sep 08 13:30:35.396881 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.396853    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "15cac488-fad7-4af0-ba52-bd9c149ba2d8" (UID: "15cac488-fad7-4af0-ba52-bd9c149ba2d8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:30:35.398710 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.398684    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "15cac488-fad7-4af0-ba52-bd9c149ba2d8" (UID: "15cac488-fad7-4af0-ba52-bd9c149ba2d8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:30:35.398710 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.398687    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-api-access-7bhqb" (OuterVolumeSpecName: "kube-api-access-7bhqb") pod "15cac488-fad7-4af0-ba52-bd9c149ba2d8" (UID: "15cac488-fad7-4af0-ba52-bd9c149ba2d8"). InnerVolumeSpecName "kube-api-access-7bhqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:30:35.497411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.497379    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/15cac488-fad7-4af0-ba52-bd9c149ba2d8-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:30:35.497411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.497410    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:30:35.497614 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:35.497424    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bhqb\" (UniqueName: \"kubernetes.io/projected/15cac488-fad7-4af0-ba52-bd9c149ba2d8-kube-api-access-7bhqb\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:30:36.071943 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.071908    2557 generic.go:356] "Generic (PLEG): container finished" podID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerID="2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc" exitCode=0
Sep 08 13:30:36.072353 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.071959    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"
Sep 08 13:30:36.072353 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.071971    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" event={"ID":"15cac488-fad7-4af0-ba52-bd9c149ba2d8","Type":"ContainerDied","Data":"2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc"}
Sep 08 13:30:36.072353 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.072038    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d" event={"ID":"15cac488-fad7-4af0-ba52-bd9c149ba2d8","Type":"ContainerDied","Data":"cc13b578129260a1f15fe64f1a0cd0e704797b25bdd7451b2ac0b5a9a2c8c6c9"}
Sep 08 13:30:36.072353 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.072065    2557 scope.go:117] "RemoveContainer" containerID="092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d"
Sep 08 13:30:36.081645 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.081618    2557 scope.go:117] "RemoveContainer" containerID="2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc"
Sep 08 13:30:36.088810 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.088791    2557 scope.go:117] "RemoveContainer" containerID="092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d"
Sep 08 13:30:36.089058 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:30:36.089040    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d\": container with ID starting with 092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d not found: ID does not exist" containerID="092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d"
Sep 08 13:30:36.089101 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.089065    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d"} err="failed to get container status \"092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d\": rpc error: code = NotFound desc = could not find container \"092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d\": container with ID starting with 092ff951bfac76eb85b1ce0ec0f3807ee10068aa7a042eb4be5acfb8492bd10d not found: ID does not exist"
Sep 08 13:30:36.089101 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.089082    2557 scope.go:117] "RemoveContainer" containerID="2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc"
Sep 08 13:30:36.089343 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:30:36.089323    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc\": container with ID starting with 2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc not found: ID does not exist" containerID="2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc"
Sep 08 13:30:36.089404 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.089348    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc"} err="failed to get container status \"2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc\": rpc error: code = NotFound desc = could not find container \"2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc\": container with ID starting with 2c01990bbb34dd7343dd54d2aa02232898fb2b6e2d8a661797dcc1262e3b0fbc not found: ID does not exist"
Sep 08 13:30:36.094796 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.094775    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"]
Sep 08 13:30:36.098347 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.098328    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-f794f-predictor-f4899d6f4-94s6d"]
Sep 08 13:30:36.496815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:36.496786    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" path="/var/lib/kubelet/pods/15cac488-fad7-4af0-ba52-bd9c149ba2d8/volumes"
Sep 08 13:30:40.072171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:40.072140    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:30:40.072640 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:40.072614    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:30:50.073443 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:30:50.073399    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:31:00.073511 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:00.073472    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:31:08.220069 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220028    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"]
Sep 08 13:31:08.220660 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220642    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kube-rbac-proxy"
Sep 08 13:31:08.220712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220663    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kube-rbac-proxy"
Sep 08 13:31:08.220712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220675    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container"
Sep 08 13:31:08.220712 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220683    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container"
Sep 08 13:31:08.220820 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220768    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kube-rbac-proxy"
Sep 08 13:31:08.220820 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.220782    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cac488-fad7-4af0-ba52-bd9c149ba2d8" containerName="kserve-container"
Sep 08 13:31:08.224322 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.224302    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.226554 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.226534    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-30f77-predictor-serving-cert\""
Sep 08 13:31:08.227224 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.227206    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-30f77-kube-rbac-proxy-sar-config\""
Sep 08 13:31:08.233160 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.233137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"]
Sep 08 13:31:08.387500 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.387460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3ca8249-fe84-412a-9361-49044d970e51-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.387673 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.387512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.387673 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.387627    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8tk\" (UniqueName: \"kubernetes.io/projected/d3ca8249-fe84-412a-9361-49044d970e51-kube-api-access-4k8tk\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.488378 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.488291    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3ca8249-fe84-412a-9361-49044d970e51-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.488378 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.488343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.488630 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.488387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8tk\" (UniqueName: \"kubernetes.io/projected/d3ca8249-fe84-412a-9361-49044d970e51-kube-api-access-4k8tk\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.488630 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:31:08.488610    2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-30f77-predictor-serving-cert: secret "error-404-isvc-30f77-predictor-serving-cert" not found
Sep 08 13:31:08.488706 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:31:08.488686    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls podName:d3ca8249-fe84-412a-9361-49044d970e51 nodeName:}" failed. No retries permitted until 2026-09-08 13:31:08.988666936 +0000 UTC m=+874.972867723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls") pod "error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" (UID: "d3ca8249-fe84-412a-9361-49044d970e51") : secret "error-404-isvc-30f77-predictor-serving-cert" not found
Sep 08 13:31:08.488993 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.488971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3ca8249-fe84-412a-9361-49044d970e51-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.497068 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.497040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8tk\" (UniqueName: \"kubernetes.io/projected/d3ca8249-fe84-412a-9361-49044d970e51-kube-api-access-4k8tk\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.993164 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.993131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:08.995590 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:08.995551    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls\") pod \"error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") " pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:09.134291 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:09.134255    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:09.405276 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:09.405177    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"]
Sep 08 13:31:09.408102 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:31:09.408075    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ca8249_fe84_412a_9361_49044d970e51.slice/crio-5dfb26ac017b4dba5547234eb4713d8800b3ba4f1b977f2d31598cb4ed530c9a WatchSource:0}: Error finding container 5dfb26ac017b4dba5547234eb4713d8800b3ba4f1b977f2d31598cb4ed530c9a: Status 404 returned error can't find the container with id 5dfb26ac017b4dba5547234eb4713d8800b3ba4f1b977f2d31598cb4ed530c9a
Sep 08 13:31:10.073314 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:10.073274    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:31:10.234199 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:10.234162    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" event={"ID":"d3ca8249-fe84-412a-9361-49044d970e51","Type":"ContainerStarted","Data":"d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0"}
Sep 08 13:31:10.234397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:10.234231    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" event={"ID":"d3ca8249-fe84-412a-9361-49044d970e51","Type":"ContainerStarted","Data":"0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149"}
Sep 08 13:31:10.234397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:10.234263    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" event={"ID":"d3ca8249-fe84-412a-9361-49044d970e51","Type":"ContainerStarted","Data":"5dfb26ac017b4dba5547234eb4713d8800b3ba4f1b977f2d31598cb4ed530c9a"}
Sep 08 13:31:10.234397 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:10.234287    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:10.254592 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:10.254545    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podStartSLOduration=2.254511058 podStartE2EDuration="2.254511058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:31:10.251581687 +0000 UTC m=+876.235782483" watchObservedRunningTime="2026-09-08 13:31:10.254511058 +0000 UTC m=+876.238711881"
Sep 08 13:31:11.239468 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:11.239433    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:11.240748 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:11.240718    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 08 13:31:12.243896 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:12.243855    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 08 13:31:17.248226 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:17.248196    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:31:17.248707 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:17.248678    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 08 13:31:20.073184 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:20.073154    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:31:27.249123 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:27.249036    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 08 13:31:34.485375 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:34.485346    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:31:34.488103 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:34.488077    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:31:37.248718 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:37.248680    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 08 13:31:47.249036 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:47.248997    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.37:8080: connect: connection refused"
Sep 08 13:31:57.249704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:31:57.249673    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:36:34.515704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:36:34.515673    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:36:34.520741 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:36:34.520718    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:39:47.344805 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.344773    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"]
Sep 08 13:39:47.349589 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.349560    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.352825 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.352798    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-601fd-predictor-serving-cert\""
Sep 08 13:39:47.352953 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.352916    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-601fd-kube-rbac-proxy-sar-config\""
Sep 08 13:39:47.362359 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.362328    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"]
Sep 08 13:39:47.403227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.403197    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"]
Sep 08 13:39:47.403455 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.403416    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" containerID="cri-o://b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac" gracePeriod=30
Sep 08 13:39:47.403515 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.403451    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kube-rbac-proxy" containerID="cri-o://dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33" gracePeriod=30
Sep 08 13:39:47.455868 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.455834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f547ade2-8456-48a3-bc4e-668072492c63-proxy-tls\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.455992 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.455899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7c2q\" (UniqueName: \"kubernetes.io/projected/f547ade2-8456-48a3-bc4e-668072492c63-kube-api-access-h7c2q\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.455992 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.455945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f547ade2-8456-48a3-bc4e-668072492c63-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.557199 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.557158    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7c2q\" (UniqueName: \"kubernetes.io/projected/f547ade2-8456-48a3-bc4e-668072492c63-kube-api-access-h7c2q\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.557353 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.557216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f547ade2-8456-48a3-bc4e-668072492c63-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.557353 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.557243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f547ade2-8456-48a3-bc4e-668072492c63-proxy-tls\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.557968 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.557942    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f547ade2-8456-48a3-bc4e-668072492c63-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.559689 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.559665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f547ade2-8456-48a3-bc4e-668072492c63-proxy-tls\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.573996 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.573971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7c2q\" (UniqueName: \"kubernetes.io/projected/f547ade2-8456-48a3-bc4e-668072492c63-kube-api-access-h7c2q\") pod \"error-404-isvc-601fd-predictor-5978f84496-s6xpw\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") " pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.652510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.652435    2557 generic.go:356] "Generic (PLEG): container finished" podID="d1821e85-bea3-485a-a68e-68953c5cae01" containerID="dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33" exitCode=2
Sep 08 13:39:47.652665 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.652500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" event={"ID":"d1821e85-bea3-485a-a68e-68953c5cae01","Type":"ContainerDied","Data":"dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33"}
Sep 08 13:39:47.660856 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.660836    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:47.937379 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:47.937305    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"]
Sep 08 13:39:47.940753 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:39:47.940726    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf547ade2_8456_48a3_bc4e_668072492c63.slice/crio-e89181359bf6dfab37604cb5934fef6f80c34ba4246c70ac1144213c0bf27ebb WatchSource:0}: Error finding container e89181359bf6dfab37604cb5934fef6f80c34ba4246c70ac1144213c0bf27ebb: Status 404 returned error can't find the container with id e89181359bf6dfab37604cb5934fef6f80c34ba4246c70ac1144213c0bf27ebb
Sep 08 13:39:48.660128 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:48.660089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" event={"ID":"f547ade2-8456-48a3-bc4e-668072492c63","Type":"ContainerStarted","Data":"4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0"}
Sep 08 13:39:48.660507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:48.660159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" event={"ID":"f547ade2-8456-48a3-bc4e-668072492c63","Type":"ContainerStarted","Data":"9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86"}
Sep 08 13:39:48.660507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:48.660189    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" event={"ID":"f547ade2-8456-48a3-bc4e-668072492c63","Type":"ContainerStarted","Data":"e89181359bf6dfab37604cb5934fef6f80c34ba4246c70ac1144213c0bf27ebb"}
Sep 08 13:39:48.660507 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:48.660224    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:48.681159 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:48.681102    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podStartSLOduration=1.681086678 podStartE2EDuration="1.681086678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:39:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:39:48.680454806 +0000 UTC m=+1394.664655616" watchObservedRunningTime="2026-09-08 13:39:48.681086678 +0000 UTC m=+1394.665287540"
Sep 08 13:39:49.664577 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:49.664547    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:49.666090 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:49.666065    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 08 13:39:50.067420 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.067379    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.36:8643/healthz\": dial tcp 10.134.0.36:8643: connect: connection refused"
Sep 08 13:39:50.072760 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.072732    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.36:8080: connect: connection refused"
Sep 08 13:39:50.659798 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.659774    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:39:50.670015 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.669987    2557 generic.go:356] "Generic (PLEG): container finished" podID="d1821e85-bea3-485a-a68e-68953c5cae01" containerID="b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac" exitCode=0
Sep 08 13:39:50.670411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.670035    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"
Sep 08 13:39:50.670411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.670066    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" event={"ID":"d1821e85-bea3-485a-a68e-68953c5cae01","Type":"ContainerDied","Data":"b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac"}
Sep 08 13:39:50.670411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.670120    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5" event={"ID":"d1821e85-bea3-485a-a68e-68953c5cae01","Type":"ContainerDied","Data":"c45890dcc67bc5e1963c9d0b7fcd89e16bab774f2f0144c668049caacdfbd0c9"}
Sep 08 13:39:50.670411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.670147    2557 scope.go:117] "RemoveContainer" containerID="dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33"
Sep 08 13:39:50.670606 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.670461    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 08 13:39:50.678138 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.678123    2557 scope.go:117] "RemoveContainer" containerID="b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac"
Sep 08 13:39:50.686516 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.686494    2557 scope.go:117] "RemoveContainer" containerID="dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33"
Sep 08 13:39:50.686819 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:39:50.686784    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33\": container with ID starting with dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33 not found: ID does not exist" containerID="dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33"
Sep 08 13:39:50.686872 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.686831    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33"} err="failed to get container status \"dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33\": rpc error: code = NotFound desc = could not find container \"dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33\": container with ID starting with dca9ee20888a44c1fc888857a549452c30ce9501abebcb1770665699520e7b33 not found: ID does not exist"
Sep 08 13:39:50.686872 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.686853    2557 scope.go:117] "RemoveContainer" containerID="b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac"
Sep 08 13:39:50.687153 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:39:50.687132    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac\": container with ID starting with b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac not found: ID does not exist" containerID="b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac"
Sep 08 13:39:50.687215 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.687162    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac"} err="failed to get container status \"b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac\": rpc error: code = NotFound desc = could not find container \"b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac\": container with ID starting with b1cc74969995d8dde591f8fddca5b785bb7c7523814d3425024984f562204bac not found: ID does not exist"
Sep 08 13:39:50.786113 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.786086    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1821e85-bea3-485a-a68e-68953c5cae01-kube-rbac-proxy-sar-config\") pod \"d1821e85-bea3-485a-a68e-68953c5cae01\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") "
Sep 08 13:39:50.786258 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.786179    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fct2j\" (UniqueName: \"kubernetes.io/projected/d1821e85-bea3-485a-a68e-68953c5cae01-kube-api-access-fct2j\") pod \"d1821e85-bea3-485a-a68e-68953c5cae01\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") "
Sep 08 13:39:50.786258 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.786223    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1821e85-bea3-485a-a68e-68953c5cae01-proxy-tls\") pod \"d1821e85-bea3-485a-a68e-68953c5cae01\" (UID: \"d1821e85-bea3-485a-a68e-68953c5cae01\") "
Sep 08 13:39:50.786510 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.786480    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1821e85-bea3-485a-a68e-68953c5cae01-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d1821e85-bea3-485a-a68e-68953c5cae01" (UID: "d1821e85-bea3-485a-a68e-68953c5cae01"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:39:50.788362 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.788337    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1821e85-bea3-485a-a68e-68953c5cae01-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d1821e85-bea3-485a-a68e-68953c5cae01" (UID: "d1821e85-bea3-485a-a68e-68953c5cae01"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:39:50.788450 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.788339    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1821e85-bea3-485a-a68e-68953c5cae01-kube-api-access-fct2j" (OuterVolumeSpecName: "kube-api-access-fct2j") pod "d1821e85-bea3-485a-a68e-68953c5cae01" (UID: "d1821e85-bea3-485a-a68e-68953c5cae01"). InnerVolumeSpecName "kube-api-access-fct2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:39:50.893541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.893486    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d1821e85-bea3-485a-a68e-68953c5cae01-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:39:50.893541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.893541    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fct2j\" (UniqueName: \"kubernetes.io/projected/d1821e85-bea3-485a-a68e-68953c5cae01-kube-api-access-fct2j\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:39:50.893721 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.893556    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d1821e85-bea3-485a-a68e-68953c5cae01-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:39:50.993016 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.992988    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"]
Sep 08 13:39:50.997381 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:50.997354    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-87be3-predictor-5656fc75d4-x59s5"]
Sep 08 13:39:52.497332 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:52.497301    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" path="/var/lib/kubelet/pods/d1821e85-bea3-485a-a68e-68953c5cae01/volumes"
Sep 08 13:39:55.674961 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:55.674932    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:39:55.675434 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:39:55.675408    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 08 13:40:05.675658 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:05.675618    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 08 13:40:15.675803 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:15.675762    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 08 13:40:22.881601 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:22.881561    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"]
Sep 08 13:40:22.882076 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:22.881824    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container" containerID="cri-o://0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149" gracePeriod=30
Sep 08 13:40:22.882076 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:22.881832    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kube-rbac-proxy" containerID="cri-o://d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0" gracePeriod=30
Sep 08 13:40:23.210184 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210151    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"]
Sep 08 13:40:23.210579 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210564    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container"
Sep 08 13:40:23.210632 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210580    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container"
Sep 08 13:40:23.210632 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210589    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kube-rbac-proxy"
Sep 08 13:40:23.210632 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210595    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kube-rbac-proxy"
Sep 08 13:40:23.210728 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210663    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kube-rbac-proxy"
Sep 08 13:40:23.210728 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.210675    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1821e85-bea3-485a-a68e-68953c5cae01" containerName="kserve-container"
Sep 08 13:40:23.213829 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.213814    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.216146 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.216124    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e90df-predictor-serving-cert\""
Sep 08 13:40:23.216256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.216146    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e90df-kube-rbac-proxy-sar-config\""
Sep 08 13:40:23.225438 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.225416    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"]
Sep 08 13:40:23.271267 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.271232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/181ccc0c-a0af-4812-9e89-60dce95568e6-proxy-tls\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.271409 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.271291    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t86k4\" (UniqueName: \"kubernetes.io/projected/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-api-access-t86k4\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.271409 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.271340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.372187 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.372154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.372369 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.372223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/181ccc0c-a0af-4812-9e89-60dce95568e6-proxy-tls\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.372369 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.372265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t86k4\" (UniqueName: \"kubernetes.io/projected/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-api-access-t86k4\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.372881 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.372854    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.374604 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.374583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/181ccc0c-a0af-4812-9e89-60dce95568e6-proxy-tls\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.391883 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.391862    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t86k4\" (UniqueName: \"kubernetes.io/projected/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-api-access-t86k4\") pod \"error-404-isvc-e90df-predictor-5b7bc4c674-96vrn\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") " pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.524225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.524128    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:23.809562 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.809537    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"]
Sep 08 13:40:23.810969 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:40:23.810941    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181ccc0c_a0af_4812_9e89_60dce95568e6.slice/crio-0bf2df6508b33d34fb8fa75ccbcb9f7915be9709729fd2821ea8a0edc8ae6bad WatchSource:0}: Error finding container 0bf2df6508b33d34fb8fa75ccbcb9f7915be9709729fd2821ea8a0edc8ae6bad: Status 404 returned error can't find the container with id 0bf2df6508b33d34fb8fa75ccbcb9f7915be9709729fd2821ea8a0edc8ae6bad
Sep 08 13:40:23.827137 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.827112    2557 generic.go:356] "Generic (PLEG): container finished" podID="d3ca8249-fe84-412a-9361-49044d970e51" containerID="d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0" exitCode=2
Sep 08 13:40:23.827230 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.827180    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" event={"ID":"d3ca8249-fe84-412a-9361-49044d970e51","Type":"ContainerDied","Data":"d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0"}
Sep 08 13:40:23.828513 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:23.828490    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" event={"ID":"181ccc0c-a0af-4812-9e89-60dce95568e6","Type":"ContainerStarted","Data":"0bf2df6508b33d34fb8fa75ccbcb9f7915be9709729fd2821ea8a0edc8ae6bad"}
Sep 08 13:40:24.834806 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:24.834764    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" event={"ID":"181ccc0c-a0af-4812-9e89-60dce95568e6","Type":"ContainerStarted","Data":"cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60"}
Sep 08 13:40:24.835223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:24.834972    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:24.835223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:24.835029    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:24.835223 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:24.835052    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" event={"ID":"181ccc0c-a0af-4812-9e89-60dce95568e6","Type":"ContainerStarted","Data":"5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4"}
Sep 08 13:40:24.836427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:24.836395    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 08 13:40:24.863170 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:24.863120    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podStartSLOduration=1.863104332 podStartE2EDuration="1.863104332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:40:24.860646433 +0000 UTC m=+1430.844847229" watchObservedRunningTime="2026-09-08 13:40:24.863104332 +0000 UTC m=+1430.847305107"
Sep 08 13:40:25.675891 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:25.675851    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.38:8080: connect: connection refused"
Sep 08 13:40:25.839637 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:25.839598    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 08 13:40:26.134225 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.134201    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:40:26.196889 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.196856    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k8tk\" (UniqueName: \"kubernetes.io/projected/d3ca8249-fe84-412a-9361-49044d970e51-kube-api-access-4k8tk\") pod \"d3ca8249-fe84-412a-9361-49044d970e51\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") "
Sep 08 13:40:26.197051 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.196945    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3ca8249-fe84-412a-9361-49044d970e51-kube-rbac-proxy-sar-config\") pod \"d3ca8249-fe84-412a-9361-49044d970e51\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") "
Sep 08 13:40:26.197051 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.196989    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls\") pod \"d3ca8249-fe84-412a-9361-49044d970e51\" (UID: \"d3ca8249-fe84-412a-9361-49044d970e51\") "
Sep 08 13:40:26.197286 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.197259    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3ca8249-fe84-412a-9361-49044d970e51-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "d3ca8249-fe84-412a-9361-49044d970e51" (UID: "d3ca8249-fe84-412a-9361-49044d970e51"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:40:26.198948 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.198920    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ca8249-fe84-412a-9361-49044d970e51-kube-api-access-4k8tk" (OuterVolumeSpecName: "kube-api-access-4k8tk") pod "d3ca8249-fe84-412a-9361-49044d970e51" (UID: "d3ca8249-fe84-412a-9361-49044d970e51"). InnerVolumeSpecName "kube-api-access-4k8tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:40:26.199059 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.199039    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "d3ca8249-fe84-412a-9361-49044d970e51" (UID: "d3ca8249-fe84-412a-9361-49044d970e51"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:40:26.297761 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.297732    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/d3ca8249-fe84-412a-9361-49044d970e51-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:40:26.297761 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.297758    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k8tk\" (UniqueName: \"kubernetes.io/projected/d3ca8249-fe84-412a-9361-49044d970e51-kube-api-access-4k8tk\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:40:26.297915 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.297774    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/d3ca8249-fe84-412a-9361-49044d970e51-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:40:26.849012 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.848886    2557 generic.go:356] "Generic (PLEG): container finished" podID="d3ca8249-fe84-412a-9361-49044d970e51" containerID="0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149" exitCode=0
Sep 08 13:40:26.849012 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.848939    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"
Sep 08 13:40:26.849012 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.848956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" event={"ID":"d3ca8249-fe84-412a-9361-49044d970e51","Type":"ContainerDied","Data":"0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149"}
Sep 08 13:40:26.849569 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.849022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w" event={"ID":"d3ca8249-fe84-412a-9361-49044d970e51","Type":"ContainerDied","Data":"5dfb26ac017b4dba5547234eb4713d8800b3ba4f1b977f2d31598cb4ed530c9a"}
Sep 08 13:40:26.849569 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.849060    2557 scope.go:117] "RemoveContainer" containerID="d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0"
Sep 08 13:40:26.859110 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.859089    2557 scope.go:117] "RemoveContainer" containerID="0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149"
Sep 08 13:40:26.866469 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.866444    2557 scope.go:117] "RemoveContainer" containerID="d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0"
Sep 08 13:40:26.866834 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:40:26.866812    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0\": container with ID starting with d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0 not found: ID does not exist" containerID="d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0"
Sep 08 13:40:26.866930 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.866839    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0"} err="failed to get container status \"d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0\": rpc error: code = NotFound desc = could not find container \"d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0\": container with ID starting with d9c07b91f3fe7de71bdb24e3ae6e3bb25f2cc1b868ef1a5ef582a77726b703c0 not found: ID does not exist"
Sep 08 13:40:26.866930 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.866855    2557 scope.go:117] "RemoveContainer" containerID="0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149"
Sep 08 13:40:26.867109 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:40:26.867086    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149\": container with ID starting with 0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149 not found: ID does not exist" containerID="0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149"
Sep 08 13:40:26.867152 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.867115    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149"} err="failed to get container status \"0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149\": rpc error: code = NotFound desc = could not find container \"0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149\": container with ID starting with 0934743f3e09a005836df130e9a5cdf62740381626ccf15a334d77ad80a16149 not found: ID does not exist"
Sep 08 13:40:26.871248 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.871225    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"]
Sep 08 13:40:26.875256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:26.875234    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-30f77-predictor-6c9bbd784d-pwj9w"]
Sep 08 13:40:28.497860 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:28.497825    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ca8249-fe84-412a-9361-49044d970e51" path="/var/lib/kubelet/pods/d3ca8249-fe84-412a-9361-49044d970e51/volumes"
Sep 08 13:40:30.844052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:30.844021    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:40:30.844539 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:30.844489    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 08 13:40:35.676671 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:35.676641    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:40:40.844693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:40.844653    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 08 13:40:50.844860 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:50.844815    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 08 13:40:57.410604 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.410574    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"]
Sep 08 13:40:57.411062 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.410799    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container" containerID="cri-o://9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86" gracePeriod=30
Sep 08 13:40:57.411062 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.410880    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kube-rbac-proxy" containerID="cri-o://4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0" gracePeriod=30
Sep 08 13:40:57.617050 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617018    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"]
Sep 08 13:40:57.617429 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617412    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kube-rbac-proxy"
Sep 08 13:40:57.617483 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617431    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kube-rbac-proxy"
Sep 08 13:40:57.617483 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617443    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container"
Sep 08 13:40:57.617483 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617449    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container"
Sep 08 13:40:57.617600 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617512    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kserve-container"
Sep 08 13:40:57.617600 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.617545    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ca8249-fe84-412a-9361-49044d970e51" containerName="kube-rbac-proxy"
Sep 08 13:40:57.620631 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.620610    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.622870 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.622847    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-64898-predictor-serving-cert\""
Sep 08 13:40:57.622975 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.622850    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-64898-kube-rbac-proxy-sar-config\""
Sep 08 13:40:57.632013 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.631991    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"]
Sep 08 13:40:57.768296 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.768259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c00540df-0c64-499b-87b3-e89c1afabef2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.768461 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.768317    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25gg\" (UniqueName: \"kubernetes.io/projected/c00540df-0c64-499b-87b3-e89c1afabef2-kube-api-access-l25gg\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.768461 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.768425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c00540df-0c64-499b-87b3-e89c1afabef2-proxy-tls\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.869227 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.869194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25gg\" (UniqueName: \"kubernetes.io/projected/c00540df-0c64-499b-87b3-e89c1afabef2-kube-api-access-l25gg\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.869410 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.869255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c00540df-0c64-499b-87b3-e89c1afabef2-proxy-tls\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.869410 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.869286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c00540df-0c64-499b-87b3-e89c1afabef2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.869915 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.869891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c00540df-0c64-499b-87b3-e89c1afabef2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.871736 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.871714    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c00540df-0c64-499b-87b3-e89c1afabef2-proxy-tls\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.880708 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.880686    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25gg\" (UniqueName: \"kubernetes.io/projected/c00540df-0c64-499b-87b3-e89c1afabef2-kube-api-access-l25gg\") pod \"error-404-isvc-64898-predictor-c55974db4-6czmd\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") " pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:57.930968 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:57.930938    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:58.007011 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:58.006972    2557 generic.go:356] "Generic (PLEG): container finished" podID="f547ade2-8456-48a3-bc4e-668072492c63" containerID="4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0" exitCode=2
Sep 08 13:40:58.007171 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:58.007060    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" event={"ID":"f547ade2-8456-48a3-bc4e-668072492c63","Type":"ContainerDied","Data":"4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0"}
Sep 08 13:40:58.213412 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:58.213346    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"]
Sep 08 13:40:58.215780 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:40:58.215755    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00540df_0c64_499b_87b3_e89c1afabef2.slice/crio-e7de0c7dddc96e5d642f2b205389dfd05209e97e4329895baf54634d46598e03 WatchSource:0}: Error finding container e7de0c7dddc96e5d642f2b205389dfd05209e97e4329895baf54634d46598e03: Status 404 returned error can't find the container with id e7de0c7dddc96e5d642f2b205389dfd05209e97e4329895baf54634d46598e03
Sep 08 13:40:59.013049 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.013013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" event={"ID":"c00540df-0c64-499b-87b3-e89c1afabef2","Type":"ContainerStarted","Data":"a776e58a9ac9ee17ff2a623f96c0c8be4a299c8b9b2a1beb32c50ee1e10cad05"}
Sep 08 13:40:59.013468 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.013091    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:59.013468 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.013126    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" event={"ID":"c00540df-0c64-499b-87b3-e89c1afabef2","Type":"ContainerStarted","Data":"ce662e7a65e5cde9f25d60f19475b8feeeabd3832dcbdafe8f87b25bec95209a"}
Sep 08 13:40:59.013468 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.013160    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:40:59.013468 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.013193    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" event={"ID":"c00540df-0c64-499b-87b3-e89c1afabef2","Type":"ContainerStarted","Data":"e7de0c7dddc96e5d642f2b205389dfd05209e97e4329895baf54634d46598e03"}
Sep 08 13:40:59.014357 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.014330    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:40:59.038436 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:40:59.038391    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podStartSLOduration=2.03837691 podStartE2EDuration="2.03837691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:40:59.037584955 +0000 UTC m=+1465.021785753" watchObservedRunningTime="2026-09-08 13:40:59.03837691 +0000 UTC m=+1465.022577707"
Sep 08 13:41:00.017988 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.017939    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:41:00.669000 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.668974    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:41:00.795046 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.795011    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f547ade2-8456-48a3-bc4e-668072492c63-proxy-tls\") pod \"f547ade2-8456-48a3-bc4e-668072492c63\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") "
Sep 08 13:41:00.795222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.795063    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f547ade2-8456-48a3-bc4e-668072492c63-kube-rbac-proxy-sar-config\") pod \"f547ade2-8456-48a3-bc4e-668072492c63\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") "
Sep 08 13:41:00.795222 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.795154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7c2q\" (UniqueName: \"kubernetes.io/projected/f547ade2-8456-48a3-bc4e-668072492c63-kube-api-access-h7c2q\") pod \"f547ade2-8456-48a3-bc4e-668072492c63\" (UID: \"f547ade2-8456-48a3-bc4e-668072492c63\") "
Sep 08 13:41:00.795395 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.795369    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f547ade2-8456-48a3-bc4e-668072492c63-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f547ade2-8456-48a3-bc4e-668072492c63" (UID: "f547ade2-8456-48a3-bc4e-668072492c63"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:41:00.797130 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.797106    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f547ade2-8456-48a3-bc4e-668072492c63-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f547ade2-8456-48a3-bc4e-668072492c63" (UID: "f547ade2-8456-48a3-bc4e-668072492c63"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:41:00.797241 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.797190    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f547ade2-8456-48a3-bc4e-668072492c63-kube-api-access-h7c2q" (OuterVolumeSpecName: "kube-api-access-h7c2q") pod "f547ade2-8456-48a3-bc4e-668072492c63" (UID: "f547ade2-8456-48a3-bc4e-668072492c63"). InnerVolumeSpecName "kube-api-access-h7c2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:41:00.845039 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.845004    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.39:8080: connect: connection refused"
Sep 08 13:41:00.895989 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.895958    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f547ade2-8456-48a3-bc4e-668072492c63-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:41:00.895989 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.895984    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7c2q\" (UniqueName: \"kubernetes.io/projected/f547ade2-8456-48a3-bc4e-668072492c63-kube-api-access-h7c2q\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:41:00.895989 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:00.895994    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f547ade2-8456-48a3-bc4e-668072492c63-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:41:01.024605 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.024572    2557 generic.go:356] "Generic (PLEG): container finished" podID="f547ade2-8456-48a3-bc4e-668072492c63" containerID="9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86" exitCode=0
Sep 08 13:41:01.024982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.024624    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"
Sep 08 13:41:01.024982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.024653    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" event={"ID":"f547ade2-8456-48a3-bc4e-668072492c63","Type":"ContainerDied","Data":"9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86"}
Sep 08 13:41:01.024982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.024731    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw" event={"ID":"f547ade2-8456-48a3-bc4e-668072492c63","Type":"ContainerDied","Data":"e89181359bf6dfab37604cb5934fef6f80c34ba4246c70ac1144213c0bf27ebb"}
Sep 08 13:41:01.024982 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.024761    2557 scope.go:117] "RemoveContainer" containerID="4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0"
Sep 08 13:41:01.033442 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.033428    2557 scope.go:117] "RemoveContainer" containerID="9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86"
Sep 08 13:41:01.040799 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.040784    2557 scope.go:117] "RemoveContainer" containerID="4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0"
Sep 08 13:41:01.041044 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:41:01.041023    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0\": container with ID starting with 4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0 not found: ID does not exist" containerID="4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0"
Sep 08 13:41:01.041091 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.041053    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0"} err="failed to get container status \"4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0\": rpc error: code = NotFound desc = could not find container \"4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0\": container with ID starting with 4407f7b0c7ff43c7902e13f7207227178fd8ff54419475927c118cb8abb860b0 not found: ID does not exist"
Sep 08 13:41:01.041091 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.041068    2557 scope.go:117] "RemoveContainer" containerID="9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86"
Sep 08 13:41:01.041280 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:41:01.041264    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86\": container with ID starting with 9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86 not found: ID does not exist" containerID="9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86"
Sep 08 13:41:01.041324 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.041286    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86"} err="failed to get container status \"9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86\": rpc error: code = NotFound desc = could not find container \"9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86\": container with ID starting with 9da375f8ae10e7e6b5ba9faff092964050ac8b8a77ae7b7b20b31362d35bbd86 not found: ID does not exist"
Sep 08 13:41:01.048590 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.048514    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"]
Sep 08 13:41:01.055876 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:01.055856    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-601fd-predictor-5978f84496-s6xpw"]
Sep 08 13:41:02.497337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:02.497306    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f547ade2-8456-48a3-bc4e-668072492c63" path="/var/lib/kubelet/pods/f547ade2-8456-48a3-bc4e-668072492c63/volumes"
Sep 08 13:41:05.022509 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:05.022480    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:41:05.023012 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:05.022988    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:41:10.845123 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:10.845085    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:41:15.023688 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:15.023649    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:41:25.023047 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:25.023008    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:41:33.194473 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.194439    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"]
Sep 08 13:41:33.195068 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.194720    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container" containerID="cri-o://5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4" gracePeriod=30
Sep 08 13:41:33.195068 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.194736    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kube-rbac-proxy" containerID="cri-o://cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60" gracePeriod=30
Sep 08 13:41:33.492159 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492123    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"]
Sep 08 13:41:33.492511 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492500    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container"
Sep 08 13:41:33.492581 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492513    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container"
Sep 08 13:41:33.492581 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492533    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kube-rbac-proxy"
Sep 08 13:41:33.492581 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492539    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kube-rbac-proxy"
Sep 08 13:41:33.492680 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492614    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kserve-container"
Sep 08 13:41:33.492680 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.492623    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f547ade2-8456-48a3-bc4e-668072492c63" containerName="kube-rbac-proxy"
Sep 08 13:41:33.495725 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.495708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.499390 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.499367    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-c7da0-predictor-serving-cert\""
Sep 08 13:41:33.502932 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.502908    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-c7da0-kube-rbac-proxy-sar-config\""
Sep 08 13:41:33.525303 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.525283    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"]
Sep 08 13:41:33.580910 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.580877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.581059 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.580940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcgvg\" (UniqueName: \"kubernetes.io/projected/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-api-access-zcgvg\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.581059 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.580999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.681833 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.681792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.681992 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.681894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.681992 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:41:33.681929    2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-serving-cert: secret "error-404-isvc-c7da0-predictor-serving-cert" not found
Sep 08 13:41:33.681992 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.681961    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcgvg\" (UniqueName: \"kubernetes.io/projected/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-api-access-zcgvg\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.681992 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:41:33.681988    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls podName:3303adaa-a8b2-46a5-ab7d-c7af4710ee7f nodeName:}" failed. No retries permitted until 2026-09-08 13:41:34.181972784 +0000 UTC m=+1500.166173574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls") pod "error-404-isvc-c7da0-predictor-5488f9f968-qtw88" (UID: "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f") : secret "error-404-isvc-c7da0-predictor-serving-cert" not found
Sep 08 13:41:33.682512 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.682492    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:33.710704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:33.710673    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcgvg\" (UniqueName: \"kubernetes.io/projected/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-api-access-zcgvg\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:34.185241 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.185200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:34.187743 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.187718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls\") pod \"error-404-isvc-c7da0-predictor-5488f9f968-qtw88\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") " pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:34.193054 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.193028    2557 generic.go:356] "Generic (PLEG): container finished" podID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerID="cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60" exitCode=2
Sep 08 13:41:34.193180 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.193076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" event={"ID":"181ccc0c-a0af-4812-9e89-60dce95568e6","Type":"ContainerDied","Data":"cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60"}
Sep 08 13:41:34.405205 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.405169    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:34.559295 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.559261    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:41:34.563236 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.563210    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:41:34.702421 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:34.702371    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"]
Sep 08 13:41:34.704133 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:41:34.704107    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3303adaa_a8b2_46a5_ab7d_c7af4710ee7f.slice/crio-26c35d9bd5e60d3d9c51dbac3d799d0504038932d5ab3846ed0a54323e50e9dd WatchSource:0}: Error finding container 26c35d9bd5e60d3d9c51dbac3d799d0504038932d5ab3846ed0a54323e50e9dd: Status 404 returned error can't find the container with id 26c35d9bd5e60d3d9c51dbac3d799d0504038932d5ab3846ed0a54323e50e9dd
Sep 08 13:41:35.023394 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.023357    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:41:35.199323 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.199282    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" event={"ID":"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f","Type":"ContainerStarted","Data":"5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15"}
Sep 08 13:41:35.199546 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.199336    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" event={"ID":"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f","Type":"ContainerStarted","Data":"b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0"}
Sep 08 13:41:35.199546 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.199358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" event={"ID":"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f","Type":"ContainerStarted","Data":"26c35d9bd5e60d3d9c51dbac3d799d0504038932d5ab3846ed0a54323e50e9dd"}
Sep 08 13:41:35.199546 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.199383    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:35.199546 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.199413    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:35.200936 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.200913    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 08 13:41:35.840478 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:35.840436    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.39:8643/healthz\": dial tcp 10.134.0.39:8643: connect: connection refused"
Sep 08 13:41:36.203566 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.203498    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 08 13:41:36.742118 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.742095    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:41:36.762681 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.762637    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podStartSLOduration=3.762620736 podStartE2EDuration="3.762620736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:41:35.225739291 +0000 UTC m=+1501.209940088" watchObservedRunningTime="2026-09-08 13:41:36.762620736 +0000 UTC m=+1502.746821533"
Sep 08 13:41:36.806564 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.806517    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-rbac-proxy-sar-config\") pod \"181ccc0c-a0af-4812-9e89-60dce95568e6\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") "
Sep 08 13:41:36.806745 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.806589    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/181ccc0c-a0af-4812-9e89-60dce95568e6-proxy-tls\") pod \"181ccc0c-a0af-4812-9e89-60dce95568e6\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") "
Sep 08 13:41:36.806745 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.806629    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t86k4\" (UniqueName: \"kubernetes.io/projected/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-api-access-t86k4\") pod \"181ccc0c-a0af-4812-9e89-60dce95568e6\" (UID: \"181ccc0c-a0af-4812-9e89-60dce95568e6\") "
Sep 08 13:41:36.806892 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.806863    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "181ccc0c-a0af-4812-9e89-60dce95568e6" (UID: "181ccc0c-a0af-4812-9e89-60dce95568e6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:41:36.808705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.808682    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/181ccc0c-a0af-4812-9e89-60dce95568e6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "181ccc0c-a0af-4812-9e89-60dce95568e6" (UID: "181ccc0c-a0af-4812-9e89-60dce95568e6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:41:36.808791 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.808736    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-api-access-t86k4" (OuterVolumeSpecName: "kube-api-access-t86k4") pod "181ccc0c-a0af-4812-9e89-60dce95568e6" (UID: "181ccc0c-a0af-4812-9e89-60dce95568e6"). InnerVolumeSpecName "kube-api-access-t86k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:41:36.907804 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.907721    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/181ccc0c-a0af-4812-9e89-60dce95568e6-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:41:36.907804 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.907750    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t86k4\" (UniqueName: \"kubernetes.io/projected/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-api-access-t86k4\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:41:36.907804 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:36.907760    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/181ccc0c-a0af-4812-9e89-60dce95568e6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:41:37.209563 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.209505    2557 generic.go:356] "Generic (PLEG): container finished" podID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerID="5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4" exitCode=0
Sep 08 13:41:37.209735 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.209561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" event={"ID":"181ccc0c-a0af-4812-9e89-60dce95568e6","Type":"ContainerDied","Data":"5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4"}
Sep 08 13:41:37.209735 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.209580    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"
Sep 08 13:41:37.209735 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.209638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn" event={"ID":"181ccc0c-a0af-4812-9e89-60dce95568e6","Type":"ContainerDied","Data":"0bf2df6508b33d34fb8fa75ccbcb9f7915be9709729fd2821ea8a0edc8ae6bad"}
Sep 08 13:41:37.209735 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.209676    2557 scope.go:117] "RemoveContainer" containerID="cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60"
Sep 08 13:41:37.218440 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.218421    2557 scope.go:117] "RemoveContainer" containerID="5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4"
Sep 08 13:41:37.227851 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.227826    2557 scope.go:117] "RemoveContainer" containerID="cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60"
Sep 08 13:41:37.228230 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:41:37.228207    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60\": container with ID starting with cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60 not found: ID does not exist" containerID="cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60"
Sep 08 13:41:37.228300 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.228240    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60"} err="failed to get container status \"cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60\": rpc error: code = NotFound desc = could not find container \"cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60\": container with ID starting with cbee2b20a0316a9d42a0ceb71ec6b14a4fe895fd99814a73c762cd76d3b5ad60 not found: ID does not exist"
Sep 08 13:41:37.228300 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.228258    2557 scope.go:117] "RemoveContainer" containerID="5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4"
Sep 08 13:41:37.228606 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:41:37.228586    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4\": container with ID starting with 5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4 not found: ID does not exist" containerID="5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4"
Sep 08 13:41:37.228659 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.228611    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4"} err="failed to get container status \"5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4\": rpc error: code = NotFound desc = could not find container \"5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4\": container with ID starting with 5a887347efb661201d8baa6e6bbfdb7df48813d83b8a5358c05cea91267e34a4 not found: ID does not exist"
Sep 08 13:41:37.231755 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.231732    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"]
Sep 08 13:41:37.237432 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:37.237409    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e90df-predictor-5b7bc4c674-96vrn"]
Sep 08 13:41:38.497703 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:38.497669    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" path="/var/lib/kubelet/pods/181ccc0c-a0af-4812-9e89-60dce95568e6/volumes"
Sep 08 13:41:41.207951 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:41.207917    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:41:41.208387 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:41.208298    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 08 13:41:45.024296 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:45.024266    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:41:51.208450 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:41:51.208411    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 08 13:42:01.208464 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:42:01.208424    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 08 13:42:11.208984 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:42:11.208945    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.41:8080: connect: connection refused"
Sep 08 13:42:21.209113 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:42:21.209082    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:46:34.598313 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:46:34.598275    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:46:34.602123 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:46:34.602091    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:50:12.464564 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.464528    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"]
Sep 08 13:50:12.465112 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.464768    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" containerID="cri-o://ce662e7a65e5cde9f25d60f19475b8feeeabd3832dcbdafe8f87b25bec95209a" gracePeriod=30
Sep 08 13:50:12.465112 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.464798    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kube-rbac-proxy" containerID="cri-o://a776e58a9ac9ee17ff2a623f96c0c8be4a299c8b9b2a1beb32c50ee1e10cad05" gracePeriod=30
Sep 08 13:50:12.516367 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516335    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"]
Sep 08 13:50:12.516754 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516740    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container"
Sep 08 13:50:12.516808 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516755    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container"
Sep 08 13:50:12.516808 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516778    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kube-rbac-proxy"
Sep 08 13:50:12.516808 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516787    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kube-rbac-proxy"
Sep 08 13:50:12.516960 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516851    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kserve-container"
Sep 08 13:50:12.516960 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.516863    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="181ccc0c-a0af-4812-9e89-60dce95568e6" containerName="kube-rbac-proxy"
Sep 08 13:50:12.520268 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.520250    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.524112 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.524094    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-13b40-predictor-serving-cert\""
Sep 08 13:50:12.524239 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.524203    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-13b40-kube-rbac-proxy-sar-config\""
Sep 08 13:50:12.533576 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.533552    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"]
Sep 08 13:50:12.566075 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.566041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.566075 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.566075    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbcv5\" (UniqueName: \"kubernetes.io/projected/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-api-access-lbcv5\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.566289 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.566108    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62f4f732-d73b-45e1-83f9-6a05cf2ed953-proxy-tls\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.652182 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.652149    2557 generic.go:356] "Generic (PLEG): container finished" podID="c00540df-0c64-499b-87b3-e89c1afabef2" containerID="a776e58a9ac9ee17ff2a623f96c0c8be4a299c8b9b2a1beb32c50ee1e10cad05" exitCode=2
Sep 08 13:50:12.652341 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.652214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" event={"ID":"c00540df-0c64-499b-87b3-e89c1afabef2","Type":"ContainerDied","Data":"a776e58a9ac9ee17ff2a623f96c0c8be4a299c8b9b2a1beb32c50ee1e10cad05"}
Sep 08 13:50:12.666652 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.666620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.666652 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.666656    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbcv5\" (UniqueName: \"kubernetes.io/projected/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-api-access-lbcv5\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.666860 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.666834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62f4f732-d73b-45e1-83f9-6a05cf2ed953-proxy-tls\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.667495 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.667468    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.669218 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.669197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62f4f732-d73b-45e1-83f9-6a05cf2ed953-proxy-tls\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.677115 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.677093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbcv5\" (UniqueName: \"kubernetes.io/projected/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-api-access-lbcv5\") pod \"error-404-isvc-13b40-predictor-5cf559cf78-8pgvv\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") " pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:12.831005 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:12.830914    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:13.112647 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:13.112619    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"]
Sep 08 13:50:13.114728 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:50:13.114700    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f4f732_d73b_45e1_83f9_6a05cf2ed953.slice/crio-6a0f7138ea46316fcd1163950d704694e0c89f2d3ab4b7e1cdfc16007e3f9657 WatchSource:0}: Error finding container 6a0f7138ea46316fcd1163950d704694e0c89f2d3ab4b7e1cdfc16007e3f9657: Status 404 returned error can't find the container with id 6a0f7138ea46316fcd1163950d704694e0c89f2d3ab4b7e1cdfc16007e3f9657
Sep 08 13:50:13.661541 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:13.661479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" event={"ID":"62f4f732-d73b-45e1-83f9-6a05cf2ed953","Type":"ContainerStarted","Data":"68c621ce7670179766884f0542eba87a6374b520323e7b87d0b271b48038e549"}
Sep 08 13:50:13.661929 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:13.661571    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:13.661929 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:13.661595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" event={"ID":"62f4f732-d73b-45e1-83f9-6a05cf2ed953","Type":"ContainerStarted","Data":"8472576055cec18b582573efea57a55db2cf00a1ce6e09f9da9a54f6e325d742"}
Sep 08 13:50:13.661929 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:13.661614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" event={"ID":"62f4f732-d73b-45e1-83f9-6a05cf2ed953","Type":"ContainerStarted","Data":"6a0f7138ea46316fcd1163950d704694e0c89f2d3ab4b7e1cdfc16007e3f9657"}
Sep 08 13:50:13.683349 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:13.683297    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podStartSLOduration=1.683280358 podStartE2EDuration="1.683280358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:50:13.681380378 +0000 UTC m=+2019.665581174" watchObservedRunningTime="2026-09-08 13:50:13.683280358 +0000 UTC m=+2019.667481154"
Sep 08 13:50:14.666761 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:14.666729    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:14.668018 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:14.667991    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 08 13:50:15.019167 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.019123    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.40:8643/healthz\": dial tcp 10.134.0.40:8643: connect: connection refused"
Sep 08 13:50:15.023408 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.023382    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.40:8080: connect: connection refused"
Sep 08 13:50:15.674643 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.674609    2557 generic.go:356] "Generic (PLEG): container finished" podID="c00540df-0c64-499b-87b3-e89c1afabef2" containerID="ce662e7a65e5cde9f25d60f19475b8feeeabd3832dcbdafe8f87b25bec95209a" exitCode=0
Sep 08 13:50:15.675052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.674683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" event={"ID":"c00540df-0c64-499b-87b3-e89c1afabef2","Type":"ContainerDied","Data":"ce662e7a65e5cde9f25d60f19475b8feeeabd3832dcbdafe8f87b25bec95209a"}
Sep 08 13:50:15.675052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.675022    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 08 13:50:15.721284 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.721258    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:50:15.793653 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.793619    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l25gg\" (UniqueName: \"kubernetes.io/projected/c00540df-0c64-499b-87b3-e89c1afabef2-kube-api-access-l25gg\") pod \"c00540df-0c64-499b-87b3-e89c1afabef2\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") "
Sep 08 13:50:15.793847 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.793679    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c00540df-0c64-499b-87b3-e89c1afabef2-proxy-tls\") pod \"c00540df-0c64-499b-87b3-e89c1afabef2\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") "
Sep 08 13:50:15.793847 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.793792    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c00540df-0c64-499b-87b3-e89c1afabef2-kube-rbac-proxy-sar-config\") pod \"c00540df-0c64-499b-87b3-e89c1afabef2\" (UID: \"c00540df-0c64-499b-87b3-e89c1afabef2\") "
Sep 08 13:50:15.794219 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.794155    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c00540df-0c64-499b-87b3-e89c1afabef2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c00540df-0c64-499b-87b3-e89c1afabef2" (UID: "c00540df-0c64-499b-87b3-e89c1afabef2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:50:15.795849 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.795822    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c00540df-0c64-499b-87b3-e89c1afabef2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c00540df-0c64-499b-87b3-e89c1afabef2" (UID: "c00540df-0c64-499b-87b3-e89c1afabef2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:50:15.795849 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.795831    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00540df-0c64-499b-87b3-e89c1afabef2-kube-api-access-l25gg" (OuterVolumeSpecName: "kube-api-access-l25gg") pod "c00540df-0c64-499b-87b3-e89c1afabef2" (UID: "c00540df-0c64-499b-87b3-e89c1afabef2"). InnerVolumeSpecName "kube-api-access-l25gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:50:15.894918 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.894827    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c00540df-0c64-499b-87b3-e89c1afabef2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:50:15.894918 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.894869    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l25gg\" (UniqueName: \"kubernetes.io/projected/c00540df-0c64-499b-87b3-e89c1afabef2-kube-api-access-l25gg\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:50:15.894918 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:15.894879    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c00540df-0c64-499b-87b3-e89c1afabef2-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:50:16.681410 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:16.681384    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"
Sep 08 13:50:16.681889 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:16.681387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd" event={"ID":"c00540df-0c64-499b-87b3-e89c1afabef2","Type":"ContainerDied","Data":"e7de0c7dddc96e5d642f2b205389dfd05209e97e4329895baf54634d46598e03"}
Sep 08 13:50:16.681889 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:16.681627    2557 scope.go:117] "RemoveContainer" containerID="a776e58a9ac9ee17ff2a623f96c0c8be4a299c8b9b2a1beb32c50ee1e10cad05"
Sep 08 13:50:16.690148 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:16.690122    2557 scope.go:117] "RemoveContainer" containerID="ce662e7a65e5cde9f25d60f19475b8feeeabd3832dcbdafe8f87b25bec95209a"
Sep 08 13:50:16.707467 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:16.707440    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"]
Sep 08 13:50:16.710757 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:16.710736    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-64898-predictor-c55974db4-6czmd"]
Sep 08 13:50:18.497445 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:18.497409    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" path="/var/lib/kubelet/pods/c00540df-0c64-499b-87b3-e89c1afabef2/volumes"
Sep 08 13:50:20.679947 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:20.679920    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:50:20.680350 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:20.680324    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 08 13:50:30.680939 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:30.680897    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 08 13:50:40.680762 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:40.680723    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 08 13:50:47.949819 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:47.949781    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"]
Sep 08 13:50:47.950364 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:47.950015    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container" containerID="cri-o://b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0" gracePeriod=30
Sep 08 13:50:47.950364 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:47.950067    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kube-rbac-proxy" containerID="cri-o://5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15" gracePeriod=30
Sep 08 13:50:48.100620 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.100590    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"]
Sep 08 13:50:48.101003 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.100990    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container"
Sep 08 13:50:48.101052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.101005    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container"
Sep 08 13:50:48.101052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.101027    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kube-rbac-proxy"
Sep 08 13:50:48.101052 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.101034    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kube-rbac-proxy"
Sep 08 13:50:48.101145 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.101093    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kserve-container"
Sep 08 13:50:48.101145 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.101107    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00540df-0c64-499b-87b3-e89c1afabef2" containerName="kube-rbac-proxy"
Sep 08 13:50:48.104257 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.104241    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.107581 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.107554    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ce1f6-predictor-serving-cert\""
Sep 08 13:50:48.108278 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.108263    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ce1f6-kube-rbac-proxy-sar-config\""
Sep 08 13:50:48.124298 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.124276    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"]
Sep 08 13:50:48.183324 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.183287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.183508 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.183408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/425c75dd-b702-487e-b465-bb5e6709f43c-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.183508 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.183437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phcqk\" (UniqueName: \"kubernetes.io/projected/425c75dd-b702-487e-b465-bb5e6709f43c-kube-api-access-phcqk\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.283970 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.283934    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/425c75dd-b702-487e-b465-bb5e6709f43c-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.284142 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.283977    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phcqk\" (UniqueName: \"kubernetes.io/projected/425c75dd-b702-487e-b465-bb5e6709f43c-kube-api-access-phcqk\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.284142 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.284012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.284142 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:50:48.284128    2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-serving-cert: secret "error-404-isvc-ce1f6-predictor-serving-cert" not found
Sep 08 13:50:48.284265 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:50:48.284186    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls podName:425c75dd-b702-487e-b465-bb5e6709f43c nodeName:}" failed. No retries permitted until 2026-09-08 13:50:48.784167543 +0000 UTC m=+2054.768368319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls") pod "error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" (UID: "425c75dd-b702-487e-b465-bb5e6709f43c") : secret "error-404-isvc-ce1f6-predictor-serving-cert" not found
Sep 08 13:50:48.284687 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.284668    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/425c75dd-b702-487e-b465-bb5e6709f43c-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.293736 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.293714    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phcqk\" (UniqueName: \"kubernetes.io/projected/425c75dd-b702-487e-b465-bb5e6709f43c-kube-api-access-phcqk\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.787941 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.787898    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.790337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.790307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls\") pod \"error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") " pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:48.845168 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.845137    2557 generic.go:356] "Generic (PLEG): container finished" podID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerID="5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15" exitCode=2
Sep 08 13:50:48.845332 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:48.845210    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" event={"ID":"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f","Type":"ContainerDied","Data":"5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15"}
Sep 08 13:50:49.014628 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.014589    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:49.298635 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:50:49.298599    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425c75dd_b702_487e_b465_bb5e6709f43c.slice/crio-3eb2e537a0d1b20ee7fdef3de2b2420b47443444945adf69e45f6035ca15cb98 WatchSource:0}: Error finding container 3eb2e537a0d1b20ee7fdef3de2b2420b47443444945adf69e45f6035ca15cb98: Status 404 returned error can't find the container with id 3eb2e537a0d1b20ee7fdef3de2b2420b47443444945adf69e45f6035ca15cb98
Sep 08 13:50:49.298907 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.298882    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"]
Sep 08 13:50:49.853429 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.853387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" event={"ID":"425c75dd-b702-487e-b465-bb5e6709f43c","Type":"ContainerStarted","Data":"e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad"}
Sep 08 13:50:49.853704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.853471    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:49.853704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.853503    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" event={"ID":"425c75dd-b702-487e-b465-bb5e6709f43c","Type":"ContainerStarted","Data":"84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c"}
Sep 08 13:50:49.853704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.853558    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" event={"ID":"425c75dd-b702-487e-b465-bb5e6709f43c","Type":"ContainerStarted","Data":"3eb2e537a0d1b20ee7fdef3de2b2420b47443444945adf69e45f6035ca15cb98"}
Sep 08 13:50:49.853704 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.853592    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:49.855360 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.855332    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 08 13:50:49.880871 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:49.880823    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podStartSLOduration=1.880809317 podStartE2EDuration="1.880809317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:50:49.878014091 +0000 UTC m=+2055.862214899" watchObservedRunningTime="2026-09-08 13:50:49.880809317 +0000 UTC m=+2055.865010165"
Sep 08 13:50:50.680410 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:50.680370    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.42:8080: connect: connection refused"
Sep 08 13:50:50.858876 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:50.858838    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 08 13:50:51.202350 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.202324    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:50:51.205470 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.205453    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-rbac-proxy-sar-config\") pod \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") "
Sep 08 13:50:51.205545 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.205489    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls\") pod \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") "
Sep 08 13:50:51.205588 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.205554    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcgvg\" (UniqueName: \"kubernetes.io/projected/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-api-access-zcgvg\") pod \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\" (UID: \"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f\") "
Sep 08 13:50:51.205836 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.205815    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" (UID: "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:50:51.207641 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.207613    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" (UID: "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:50:51.207778 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.207756    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-api-access-zcgvg" (OuterVolumeSpecName: "kube-api-access-zcgvg") pod "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" (UID: "3303adaa-a8b2-46a5-ab7d-c7af4710ee7f"). InnerVolumeSpecName "kube-api-access-zcgvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:50:51.307067 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.307029    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcgvg\" (UniqueName: \"kubernetes.io/projected/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-api-access-zcgvg\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:50:51.307067 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.307067    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:50:51.307271 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.307078    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:50:51.864837 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.864805    2557 generic.go:356] "Generic (PLEG): container finished" podID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerID="b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0" exitCode=0
Sep 08 13:50:51.865330 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.864856    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"
Sep 08 13:50:51.865330 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.864894    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" event={"ID":"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f","Type":"ContainerDied","Data":"b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0"}
Sep 08 13:50:51.865330 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.864969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88" event={"ID":"3303adaa-a8b2-46a5-ab7d-c7af4710ee7f","Type":"ContainerDied","Data":"26c35d9bd5e60d3d9c51dbac3d799d0504038932d5ab3846ed0a54323e50e9dd"}
Sep 08 13:50:51.865330 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.865012    2557 scope.go:117] "RemoveContainer" containerID="5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15"
Sep 08 13:50:51.874287 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.874268    2557 scope.go:117] "RemoveContainer" containerID="b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0"
Sep 08 13:50:51.881841 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.881822    2557 scope.go:117] "RemoveContainer" containerID="5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15"
Sep 08 13:50:51.882091 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:50:51.882070    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15\": container with ID starting with 5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15 not found: ID does not exist" containerID="5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15"
Sep 08 13:50:51.882136 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.882100    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15"} err="failed to get container status \"5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15\": rpc error: code = NotFound desc = could not find container \"5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15\": container with ID starting with 5bb2c8758c37c31c7ee33b1d11158348ff47a5bd83742b09dba2987a10513a15 not found: ID does not exist"
Sep 08 13:50:51.882136 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.882117    2557 scope.go:117] "RemoveContainer" containerID="b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0"
Sep 08 13:50:51.882379 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:50:51.882364    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0\": container with ID starting with b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0 not found: ID does not exist" containerID="b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0"
Sep 08 13:50:51.882432 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.882382    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0"} err="failed to get container status \"b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0\": rpc error: code = NotFound desc = could not find container \"b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0\": container with ID starting with b40a6b265df38ceefd708f8a49d773d2785d33e6cc9857429c56ee49ccfda5f0 not found: ID does not exist"
Sep 08 13:50:51.889759 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.889737    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"]
Sep 08 13:50:51.895074 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:51.895054    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-c7da0-predictor-5488f9f968-qtw88"]
Sep 08 13:50:52.496974 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:52.496942    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" path="/var/lib/kubelet/pods/3303adaa-a8b2-46a5-ab7d-c7af4710ee7f/volumes"
Sep 08 13:50:55.863705 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:55.863669    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:50:55.864256 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:50:55.864187    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 08 13:51:00.681727 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:00.681646    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:51:05.864612 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:05.864575    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 08 13:51:15.865177 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:15.865141    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 08 13:51:22.685826 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.685794    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"]
Sep 08 13:51:22.686262 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.686019    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container" containerID="cri-o://8472576055cec18b582573efea57a55db2cf00a1ce6e09f9da9a54f6e325d742" gracePeriod=30
Sep 08 13:51:22.686262 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.686061    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kube-rbac-proxy" containerID="cri-o://68c621ce7670179766884f0542eba87a6374b520323e7b87d0b271b48038e549" gracePeriod=30
Sep 08 13:51:22.947815 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.947737    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"]
Sep 08 13:51:22.948131 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.948119    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container"
Sep 08 13:51:22.948174 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.948132    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container"
Sep 08 13:51:22.948174 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.948158    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kube-rbac-proxy"
Sep 08 13:51:22.948174 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.948164    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kube-rbac-proxy"
Sep 08 13:51:22.948267 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.948222    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kserve-container"
Sep 08 13:51:22.948267 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.948230    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3303adaa-a8b2-46a5-ab7d-c7af4710ee7f" containerName="kube-rbac-proxy"
Sep 08 13:51:22.951764 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.951740    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:22.954288 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.954262    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-7d014-predictor-serving-cert\""
Sep 08 13:51:22.954411 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.954341    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-7d014-kube-rbac-proxy-sar-config\""
Sep 08 13:51:22.965693 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:22.965672    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"]
Sep 08 13:51:23.015468 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.015436    2557 generic.go:356] "Generic (PLEG): container finished" podID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerID="68c621ce7670179766884f0542eba87a6374b520323e7b87d0b271b48038e549" exitCode=2
Sep 08 13:51:23.015635 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.015503    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" event={"ID":"62f4f732-d73b-45e1-83f9-6a05cf2ed953","Type":"ContainerDied","Data":"68c621ce7670179766884f0542eba87a6374b520323e7b87d0b271b48038e549"}
Sep 08 13:51:23.087670 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.087636    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/842e9175-e850-428d-a685-db646f801d9c-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.087818 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.087686    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.087866 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.087812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwlxk\" (UniqueName: \"kubernetes.io/projected/842e9175-e850-428d-a685-db646f801d9c-kube-api-access-xwlxk\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.189155 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.189116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwlxk\" (UniqueName: \"kubernetes.io/projected/842e9175-e850-428d-a685-db646f801d9c-kube-api-access-xwlxk\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.189322 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.189168    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/842e9175-e850-428d-a685-db646f801d9c-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.189322 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.189206    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.189426 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:51:23.189337    2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-7d014-predictor-serving-cert: secret "error-404-isvc-7d014-predictor-serving-cert" not found
Sep 08 13:51:23.189426 ip-10-0-141-177 kubenswrapper[2557]: E0908 13:51:23.189411    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls podName:842e9175-e850-428d-a685-db646f801d9c nodeName:}" failed. No retries permitted until 2026-09-08 13:51:23.689390763 +0000 UTC m=+2089.673591538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls") pod "error-404-isvc-7d014-predictor-57c444947d-llcg9" (UID: "842e9175-e850-428d-a685-db646f801d9c") : secret "error-404-isvc-7d014-predictor-serving-cert" not found
Sep 08 13:51:23.189874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.189854    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/842e9175-e850-428d-a685-db646f801d9c-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.198318 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.198262    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwlxk\" (UniqueName: \"kubernetes.io/projected/842e9175-e850-428d-a685-db646f801d9c-kube-api-access-xwlxk\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.693653 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.693607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.696147 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.696124    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls\") pod \"error-404-isvc-7d014-predictor-57c444947d-llcg9\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") " pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:23.863056 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:23.863015    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:24.135337 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:24.135310    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"]
Sep 08 13:51:24.137176 ip-10-0-141-177 kubenswrapper[2557]: W0908 13:51:24.137143    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod842e9175_e850_428d_a685_db646f801d9c.slice/crio-0e84c1e2e472759f935251639c617f678548011e52ef7550fc563d317a66d4b9 WatchSource:0}: Error finding container 0e84c1e2e472759f935251639c617f678548011e52ef7550fc563d317a66d4b9: Status 404 returned error can't find the container with id 0e84c1e2e472759f935251639c617f678548011e52ef7550fc563d317a66d4b9
Sep 08 13:51:25.027090 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.027055    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" event={"ID":"842e9175-e850-428d-a685-db646f801d9c","Type":"ContainerStarted","Data":"8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e"}
Sep 08 13:51:25.027563 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.027143    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:25.027563 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.027296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:25.027563 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.027357    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" event={"ID":"842e9175-e850-428d-a685-db646f801d9c","Type":"ContainerStarted","Data":"95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b"}
Sep 08 13:51:25.027563 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.027394    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" event={"ID":"842e9175-e850-428d-a685-db646f801d9c","Type":"ContainerStarted","Data":"0e84c1e2e472759f935251639c617f678548011e52ef7550fc563d317a66d4b9"}
Sep 08 13:51:25.028794 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.028770    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Sep 08 13:51:25.048242 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.048200    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podStartSLOduration=3.048188547 podStartE2EDuration="3.048188547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 13:51:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 13:51:25.046216204 +0000 UTC m=+2091.030417001" watchObservedRunningTime="2026-09-08 13:51:25.048188547 +0000 UTC m=+2091.032389343"
Sep 08 13:51:25.675740 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.675692    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.42:8643/healthz\": dial tcp 10.134.0.42:8643: connect: connection refused"
Sep 08 13:51:25.864758 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:25.864719    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.43:8080: connect: connection refused"
Sep 08 13:51:26.034858 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.034823    2557 generic.go:356] "Generic (PLEG): container finished" podID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerID="8472576055cec18b582573efea57a55db2cf00a1ce6e09f9da9a54f6e325d742" exitCode=0
Sep 08 13:51:26.035269 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.034903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" event={"ID":"62f4f732-d73b-45e1-83f9-6a05cf2ed953","Type":"ContainerDied","Data":"8472576055cec18b582573efea57a55db2cf00a1ce6e09f9da9a54f6e325d742"}
Sep 08 13:51:26.035373 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.035284    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Sep 08 13:51:26.141624 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.141597    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:51:26.217033 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.216955    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-rbac-proxy-sar-config\") pod \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") "
Sep 08 13:51:26.217033 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.216997    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbcv5\" (UniqueName: \"kubernetes.io/projected/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-api-access-lbcv5\") pod \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") "
Sep 08 13:51:26.217206 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.217036    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62f4f732-d73b-45e1-83f9-6a05cf2ed953-proxy-tls\") pod \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\" (UID: \"62f4f732-d73b-45e1-83f9-6a05cf2ed953\") "
Sep 08 13:51:26.217358 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.217337    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "62f4f732-d73b-45e1-83f9-6a05cf2ed953" (UID: "62f4f732-d73b-45e1-83f9-6a05cf2ed953"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 13:51:26.219149 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.219123    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62f4f732-d73b-45e1-83f9-6a05cf2ed953-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "62f4f732-d73b-45e1-83f9-6a05cf2ed953" (UID: "62f4f732-d73b-45e1-83f9-6a05cf2ed953"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 13:51:26.219218 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.219176    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-api-access-lbcv5" (OuterVolumeSpecName: "kube-api-access-lbcv5") pod "62f4f732-d73b-45e1-83f9-6a05cf2ed953" (UID: "62f4f732-d73b-45e1-83f9-6a05cf2ed953"). InnerVolumeSpecName "kube-api-access-lbcv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 13:51:26.317976 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.317942    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/62f4f732-d73b-45e1-83f9-6a05cf2ed953-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:51:26.317976 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.317972    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:51:26.317976 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:26.317982    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbcv5\" (UniqueName: \"kubernetes.io/projected/62f4f732-d73b-45e1-83f9-6a05cf2ed953-kube-api-access-lbcv5\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 13:51:27.042201 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:27.042170    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"
Sep 08 13:51:27.042714 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:27.042199    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv" event={"ID":"62f4f732-d73b-45e1-83f9-6a05cf2ed953","Type":"ContainerDied","Data":"6a0f7138ea46316fcd1163950d704694e0c89f2d3ab4b7e1cdfc16007e3f9657"}
Sep 08 13:51:27.042714 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:27.042265    2557 scope.go:117] "RemoveContainer" containerID="68c621ce7670179766884f0542eba87a6374b520323e7b87d0b271b48038e549"
Sep 08 13:51:27.052874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:27.052853    2557 scope.go:117] "RemoveContainer" containerID="8472576055cec18b582573efea57a55db2cf00a1ce6e09f9da9a54f6e325d742"
Sep 08 13:51:27.062597 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:27.062576    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"]
Sep 08 13:51:27.066243 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:27.066218    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-13b40-predictor-5cf559cf78-8pgvv"]
Sep 08 13:51:28.496303 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:28.496259    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" path="/var/lib/kubelet/pods/62f4f732-d73b-45e1-83f9-6a05cf2ed953/volumes"
Sep 08 13:51:31.040122 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:31.040091    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:51:31.040591 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:31.040569    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Sep 08 13:51:34.629646 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:34.629619    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:51:34.633650 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:34.633625    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:51:35.865352 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:35.865324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 13:51:41.041427 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:41.041386    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Sep 08 13:51:51.040624 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:51:51.040577    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Sep 08 13:52:01.040622 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:52:01.040579    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.44:8080: connect: connection refused"
Sep 08 13:52:11.041713 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:52:11.041679    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 13:56:34.661073 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:56:34.661043    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 13:56:34.665874 ip-10-0-141-177 kubenswrapper[2557]: I0908 13:56:34.665857    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 14:00:37.594742 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:37.594710    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"]
Sep 08 14:00:37.595290 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:37.594941    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container" containerID="cri-o://95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b" gracePeriod=30
Sep 08 14:00:37.595290 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:37.594993    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kube-rbac-proxy" containerID="cri-o://8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e" gracePeriod=30
Sep 08 14:00:38.624604 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:38.624569    2557 generic.go:356] "Generic (PLEG): container finished" podID="842e9175-e850-428d-a685-db646f801d9c" containerID="8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e" exitCode=2
Sep 08 14:00:38.624986 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:38.624650    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" event={"ID":"842e9175-e850-428d-a685-db646f801d9c","Type":"ContainerDied","Data":"8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e"}
Sep 08 14:00:40.547018 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.546980    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 14:00:40.561101 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.561077    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/842e9175-e850-428d-a685-db646f801d9c-kube-rbac-proxy-sar-config\") pod \"842e9175-e850-428d-a685-db646f801d9c\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") "
Sep 08 14:00:40.561227 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.561135    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwlxk\" (UniqueName: \"kubernetes.io/projected/842e9175-e850-428d-a685-db646f801d9c-kube-api-access-xwlxk\") pod \"842e9175-e850-428d-a685-db646f801d9c\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") "
Sep 08 14:00:40.561227 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.561202    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls\") pod \"842e9175-e850-428d-a685-db646f801d9c\" (UID: \"842e9175-e850-428d-a685-db646f801d9c\") "
Sep 08 14:00:40.561395 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.561369    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/842e9175-e850-428d-a685-db646f801d9c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "842e9175-e850-428d-a685-db646f801d9c" (UID: "842e9175-e850-428d-a685-db646f801d9c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:00:40.561502 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.561483    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/842e9175-e850-428d-a685-db646f801d9c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 14:00:40.563123 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.563094    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "842e9175-e850-428d-a685-db646f801d9c" (UID: "842e9175-e850-428d-a685-db646f801d9c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:00:40.563123 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.563112    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/842e9175-e850-428d-a685-db646f801d9c-kube-api-access-xwlxk" (OuterVolumeSpecName: "kube-api-access-xwlxk") pod "842e9175-e850-428d-a685-db646f801d9c" (UID: "842e9175-e850-428d-a685-db646f801d9c"). InnerVolumeSpecName "kube-api-access-xwlxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:00:40.634948 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.634866    2557 generic.go:356] "Generic (PLEG): container finished" podID="842e9175-e850-428d-a685-db646f801d9c" containerID="95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b" exitCode=0
Sep 08 14:00:40.634948 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.634909    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"
Sep 08 14:00:40.635139 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.634953    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" event={"ID":"842e9175-e850-428d-a685-db646f801d9c","Type":"ContainerDied","Data":"95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b"}
Sep 08 14:00:40.635139 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.635022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9" event={"ID":"842e9175-e850-428d-a685-db646f801d9c","Type":"ContainerDied","Data":"0e84c1e2e472759f935251639c617f678548011e52ef7550fc563d317a66d4b9"}
Sep 08 14:00:40.635139 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.635052    2557 scope.go:117] "RemoveContainer" containerID="8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e"
Sep 08 14:00:40.643678 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.643661    2557 scope.go:117] "RemoveContainer" containerID="95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b"
Sep 08 14:00:40.651048 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.651032    2557 scope.go:117] "RemoveContainer" containerID="8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e"
Sep 08 14:00:40.651298 ip-10-0-141-177 kubenswrapper[2557]: E0908 14:00:40.651278    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e\": container with ID starting with 8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e not found: ID does not exist" containerID="8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e"
Sep 08 14:00:40.651374 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.651310    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e"} err="failed to get container status \"8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e\": rpc error: code = NotFound desc = could not find container \"8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e\": container with ID starting with 8900d8c8199cfe2bf55a0cc8324a39374c96602698c14517880ab20c3f254a7e not found: ID does not exist"
Sep 08 14:00:40.651374 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.651333    2557 scope.go:117] "RemoveContainer" containerID="95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b"
Sep 08 14:00:40.651597 ip-10-0-141-177 kubenswrapper[2557]: E0908 14:00:40.651573    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b\": container with ID starting with 95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b not found: ID does not exist" containerID="95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b"
Sep 08 14:00:40.651701 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.651603    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b"} err="failed to get container status \"95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b\": rpc error: code = NotFound desc = could not find container \"95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b\": container with ID starting with 95fc1a580a9c301b162f5dc7ecc4a336717bfcce5d823badbb19024ade09be5b not found: ID does not exist"
Sep 08 14:00:40.658074 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.658051    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"]
Sep 08 14:00:40.662743 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.662712    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwlxk\" (UniqueName: \"kubernetes.io/projected/842e9175-e850-428d-a685-db646f801d9c-kube-api-access-xwlxk\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 14:00:40.662743 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.662743    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/842e9175-e850-428d-a685-db646f801d9c-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 14:00:40.664229 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:40.664211    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7d014-predictor-57c444947d-llcg9"]
Sep 08 14:00:42.496590 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:00:42.496558    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="842e9175-e850-428d-a685-db646f801d9c" path="/var/lib/kubelet/pods/842e9175-e850-428d-a685-db646f801d9c/volumes"
Sep 08 14:01:34.695949 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:01:34.695847    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 14:01:34.704385 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:01:34.704362    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 14:06:34.728709 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:06:34.728682    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 14:06:34.735414 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:06:34.735389    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 14:08:07.510592 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:07.510553    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"]
Sep 08 14:08:07.511220 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:07.510784    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container" containerID="cri-o://84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c" gracePeriod=30
Sep 08 14:08:07.511220 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:07.510820    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kube-rbac-proxy" containerID="cri-o://e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad" gracePeriod=30
Sep 08 14:08:07.661508 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:07.661474    2557 generic.go:356] "Generic (PLEG): container finished" podID="425c75dd-b702-487e-b465-bb5e6709f43c" containerID="e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad" exitCode=2
Sep 08 14:08:07.661675 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:07.661554    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" event={"ID":"425c75dd-b702-487e-b465-bb5e6709f43c","Type":"ContainerDied","Data":"e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad"}
Sep 08 14:08:10.659796 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.659772    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 14:08:10.676247 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.676220    2557 generic.go:356] "Generic (PLEG): container finished" podID="425c75dd-b702-487e-b465-bb5e6709f43c" containerID="84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c" exitCode=0
Sep 08 14:08:10.676384 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.676262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" event={"ID":"425c75dd-b702-487e-b465-bb5e6709f43c","Type":"ContainerDied","Data":"84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c"}
Sep 08 14:08:10.676384 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.676275    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"
Sep 08 14:08:10.676384 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.676311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk" event={"ID":"425c75dd-b702-487e-b465-bb5e6709f43c","Type":"ContainerDied","Data":"3eb2e537a0d1b20ee7fdef3de2b2420b47443444945adf69e45f6035ca15cb98"}
Sep 08 14:08:10.676384 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.676341    2557 scope.go:117] "RemoveContainer" containerID="e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad"
Sep 08 14:08:10.686574 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.686553    2557 scope.go:117] "RemoveContainer" containerID="84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c"
Sep 08 14:08:10.693966 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.693943    2557 scope.go:117] "RemoveContainer" containerID="e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad"
Sep 08 14:08:10.694231 ip-10-0-141-177 kubenswrapper[2557]: E0908 14:08:10.694211    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad\": container with ID starting with e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad not found: ID does not exist" containerID="e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad"
Sep 08 14:08:10.694310 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694241    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad"} err="failed to get container status \"e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad\": rpc error: code = NotFound desc = could not find container \"e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad\": container with ID starting with e533448bb0b6938aa4418a5cd72fb3a09a6efbf264c5c7e8da0e5d03f836abad not found: ID does not exist"
Sep 08 14:08:10.694310 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694258    2557 scope.go:117] "RemoveContainer" containerID="84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c"
Sep 08 14:08:10.694310 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694297    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/425c75dd-b702-487e-b465-bb5e6709f43c-kube-rbac-proxy-sar-config\") pod \"425c75dd-b702-487e-b465-bb5e6709f43c\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") "
Sep 08 14:08:10.694484 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694391    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls\") pod \"425c75dd-b702-487e-b465-bb5e6709f43c\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") "
Sep 08 14:08:10.694484 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694416    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phcqk\" (UniqueName: \"kubernetes.io/projected/425c75dd-b702-487e-b465-bb5e6709f43c-kube-api-access-phcqk\") pod \"425c75dd-b702-487e-b465-bb5e6709f43c\" (UID: \"425c75dd-b702-487e-b465-bb5e6709f43c\") "
Sep 08 14:08:10.694727 ip-10-0-141-177 kubenswrapper[2557]: E0908 14:08:10.694689    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c\": container with ID starting with 84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c not found: ID does not exist" containerID="84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c"
Sep 08 14:08:10.694827 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694733    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c"} err="failed to get container status \"84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c\": rpc error: code = NotFound desc = could not find container \"84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c\": container with ID starting with 84b7192174950ca6ae44388a537b7da9b694e3f1c1805902d4b2439dec6b328c not found: ID does not exist"
Sep 08 14:08:10.694827 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.694771    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/425c75dd-b702-487e-b465-bb5e6709f43c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "425c75dd-b702-487e-b465-bb5e6709f43c" (UID: "425c75dd-b702-487e-b465-bb5e6709f43c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:08:10.696394 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.696375    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "425c75dd-b702-487e-b465-bb5e6709f43c" (UID: "425c75dd-b702-487e-b465-bb5e6709f43c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:08:10.696895 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.696879    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425c75dd-b702-487e-b465-bb5e6709f43c-kube-api-access-phcqk" (OuterVolumeSpecName: "kube-api-access-phcqk") pod "425c75dd-b702-487e-b465-bb5e6709f43c" (UID: "425c75dd-b702-487e-b465-bb5e6709f43c"). InnerVolumeSpecName "kube-api-access-phcqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:08:10.795666 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.795638    2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/425c75dd-b702-487e-b465-bb5e6709f43c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 14:08:10.795666 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.795660    2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/425c75dd-b702-487e-b465-bb5e6709f43c-proxy-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 14:08:10.795666 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:10.795669    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phcqk\" (UniqueName: \"kubernetes.io/projected/425c75dd-b702-487e-b465-bb5e6709f43c-kube-api-access-phcqk\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\""
Sep 08 14:08:11.007669 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:11.007638    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"]
Sep 08 14:08:11.011372 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:11.011343    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ce1f6-predictor-b77d84c64-v2lwk"]
Sep 08 14:08:12.496344 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:12.496310    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" path="/var/lib/kubelet/pods/425c75dd-b702-487e-b465-bb5e6709f43c/volumes"
Sep 08 14:08:43.261671 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:43.261640    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g4579_009f7ad2-9b62-474a-a02a-a0e8db9014b6/global-pull-secret-syncer/0.log"
Sep 08 14:08:43.429487 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:43.429445    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fqvbq_a90054cb-b7dc-4b4c-b0e1-9e64203f2b03/konnectivity-agent/0.log"
Sep 08 14:08:43.548089 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:43.547997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-177.ec2.internal_fdf29c3cd2e403aedd9a5d1cadaf161a/haproxy/0.log"
Sep 08 14:08:47.657237 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.657193    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/alertmanager/0.log"
Sep 08 14:08:47.700539 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.700500    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/config-reloader/0.log"
Sep 08 14:08:47.735101 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.735079    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/kube-rbac-proxy-web/0.log"
Sep 08 14:08:47.766279 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.766255    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/kube-rbac-proxy/0.log"
Sep 08 14:08:47.795633 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.795607    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/kube-rbac-proxy-metric/0.log"
Sep 08 14:08:47.828637 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.828611    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/prom-label-proxy/0.log"
Sep 08 14:08:47.858062 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:47.858036    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80c71058-3641-47db-bdce-ba8c3c9cd09e/init-config-reloader/0.log"
Sep 08 14:08:48.158131 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.158100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-sfq99_69fbda59-11cd-4746-92a4-1cf9630d161e/monitoring-plugin/0.log"
Sep 08 14:08:48.447030 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.446949    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vltmx_439c09d3-0ed4-4d4d-90d5-93514edb16e5/node-exporter/0.log"
Sep 08 14:08:48.473194 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.473170    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vltmx_439c09d3-0ed4-4d4d-90d5-93514edb16e5/kube-rbac-proxy/0.log"
Sep 08 14:08:48.496695 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.496672    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vltmx_439c09d3-0ed4-4d4d-90d5-93514edb16e5/init-textfile/0.log"
Sep 08 14:08:48.871298 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.871265    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kbw7r_57605426-96ca-48ba-921b-a3e6ed3bc248/prometheus-operator/0.log"
Sep 08 14:08:48.900013 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.899989    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-kbw7r_57605426-96ca-48ba-921b-a3e6ed3bc248/kube-rbac-proxy/0.log"
Sep 08 14:08:48.967025 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.966992    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f86b44649-bwd9h_72cff96a-209e-4ed7-b1ed-bb84acaad228/telemeter-client/0.log"
Sep 08 14:08:48.998260 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:48.998219    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f86b44649-bwd9h_72cff96a-209e-4ed7-b1ed-bb84acaad228/reload/0.log"
Sep 08 14:08:49.024601 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.024573    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f86b44649-bwd9h_72cff96a-209e-4ed7-b1ed-bb84acaad228/kube-rbac-proxy/0.log"
Sep 08 14:08:49.059532 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.059499    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8d7b58d4-b9b5f_73b2fc73-81a1-4f31-b3f9-afb476de2b1f/thanos-query/0.log"
Sep 08 14:08:49.089906 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.089884    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8d7b58d4-b9b5f_73b2fc73-81a1-4f31-b3f9-afb476de2b1f/kube-rbac-proxy-web/0.log"
Sep 08 14:08:49.114580 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.114556    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8d7b58d4-b9b5f_73b2fc73-81a1-4f31-b3f9-afb476de2b1f/kube-rbac-proxy/0.log"
Sep 08 14:08:49.141650 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.141593    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8d7b58d4-b9b5f_73b2fc73-81a1-4f31-b3f9-afb476de2b1f/prom-label-proxy/0.log"
Sep 08 14:08:49.183227 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.183205    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8d7b58d4-b9b5f_73b2fc73-81a1-4f31-b3f9-afb476de2b1f/kube-rbac-proxy-rules/0.log"
Sep 08 14:08:49.210753 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:49.210730    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b8d7b58d4-b9b5f_73b2fc73-81a1-4f31-b3f9-afb476de2b1f/kube-rbac-proxy-metrics/0.log"
Sep 08 14:08:50.536655 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:50.536628    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-d59lb_6e898303-3e30-4691-b769-e4b45a70d80d/networking-console-plugin/0.log"
Sep 08 14:08:51.128564 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.128517    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/2.log"
Sep 08 14:08:51.132934 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.132910    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-7nvg8_2c51ea82-954f-4b15-8f62-726cfa40806b/console-operator/3.log"
Sep 08 14:08:51.575307 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.575267    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f7bc5bdb8-9lbwj_d399ba8e-7bf2-47d4-9443-6b69d1f1f933/console/0.log"
Sep 08 14:08:51.611962 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.611935    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-w2g6n_2b8e8bef-a6b7-4177-9e59-b5e945bdd75e/download-server/0.log"
Sep 08 14:08:51.710671 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.710636    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"]
Sep 08 14:08:51.710990 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.710978    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.710992    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711008    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711014    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711024    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711030    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711041    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container"
Sep 08 14:08:51.711051 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711046    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711058    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711066    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711074    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711079    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711130    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kserve-container"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711139    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="62f4f732-d73b-45e1-83f9-6a05cf2ed953" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711145    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711152    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kube-rbac-proxy"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711158    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="842e9175-e850-428d-a685-db646f801d9c" containerName="kserve-container"
Sep 08 14:08:51.711291 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.711166    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="425c75dd-b702-487e-b465-bb5e6709f43c" containerName="kserve-container"
Sep 08 14:08:51.714222 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.714181    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.717889 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.717851    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p58cr\"/\"kube-root-ca.crt\""
Sep 08 14:08:51.718029 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.717897    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p58cr\"/\"openshift-service-ca.crt\""
Sep 08 14:08:51.719871 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.719851    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p58cr\"/\"default-dockercfg-zjqml\""
Sep 08 14:08:51.725981 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.725945    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"]
Sep 08 14:08:51.746695 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.746671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-proc\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.746812 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.746712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-sys\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.746877 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.746808    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzsjs\" (UniqueName: \"kubernetes.io/projected/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-kube-api-access-lzsjs\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.746921 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.746906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-lib-modules\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.746973 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.746933    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-podres\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848382 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-proc\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848382 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848346    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-sys\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848551 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzsjs\" (UniqueName: \"kubernetes.io/projected/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-kube-api-access-lzsjs\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848551 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848426    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-lib-modules\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848551 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-podres\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848551 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-proc\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848551 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848488    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-sys\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848720 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848578    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-lib-modules\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.848720 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.848581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-podres\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:51.856842 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:51.856818    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzsjs\" (UniqueName: \"kubernetes.io/projected/0f2a1bb5-9ace-4be7-a282-2b0a009b55ae-kube-api-access-lzsjs\") pod \"perf-node-gather-daemonset-wj8fd\" (UID: \"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae\") " pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:52.024114 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.024075    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:52.207287 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.207252    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-r4cwb_2aac9f15-b5c1-45cc-a64f-1569cd662464/volume-data-source-validator/0.log"
Sep 08 14:08:52.292960 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.292850    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"]
Sep 08 14:08:52.295149 ip-10-0-141-177 kubenswrapper[2557]: W0908 14:08:52.295111    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0f2a1bb5_9ace_4be7_a282_2b0a009b55ae.slice/crio-b5f02267700a29d5e5e8de5178dab76a402302fd24ebb00d420ef218cb10f399 WatchSource:0}: Error finding container b5f02267700a29d5e5e8de5178dab76a402302fd24ebb00d420ef218cb10f399: Status 404 returned error can't find the container with id b5f02267700a29d5e5e8de5178dab76a402302fd24ebb00d420ef218cb10f399
Sep 08 14:08:52.868674 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.868638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd" event={"ID":"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae","Type":"ContainerStarted","Data":"a3edc8084509007d272fe2c0ca786f9d8e193d386bf69acbcd700a115549d9d0"}
Sep 08 14:08:52.869054 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.868688    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd" event={"ID":"0f2a1bb5-9ace-4be7-a282-2b0a009b55ae","Type":"ContainerStarted","Data":"b5f02267700a29d5e5e8de5178dab76a402302fd24ebb00d420ef218cb10f399"}
Sep 08 14:08:52.869054 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.868729    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:08:52.898893 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:52.898843    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd" podStartSLOduration=1.8988298590000001 podStartE2EDuration="1.898829859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:08:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:08:52.898058387 +0000 UTC m=+3138.882259207" watchObservedRunningTime="2026-09-08 14:08:52.898829859 +0000 UTC m=+3138.883030656"
Sep 08 14:08:53.182988 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:53.182914    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqf7p_b4df4e94-a39c-4bc8-a71d-6c16ada47713/dns/0.log"
Sep 08 14:08:53.205973 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:53.205948    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nqf7p_b4df4e94-a39c-4bc8-a71d-6c16ada47713/kube-rbac-proxy/0.log"
Sep 08 14:08:53.320959 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:53.320928    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xb2bf_76910f97-dbe6-443e-9667-ecf5cd273c6c/dns-node-resolver/0.log"
Sep 08 14:08:53.789043 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:53.789017    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c4849dc75-lgtxg_c88ed404-a453-4bd2-a33f-28bdff99f398/registry/0.log"
Sep 08 14:08:53.833853 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:53.833831    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kj8dv_aa082cbb-38d0-4bfa-94ef-2e621f2cd695/node-ca/0.log"
Sep 08 14:08:54.632901 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:54.632871    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-745d49b47b-s9nxb_d8fbe9fd-5644-4ea9-86d1-9bbdc106d983/router/0.log"
Sep 08 14:08:54.996078 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:54.996049    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fdc92_ee5b509f-dd85-422e-b31b-b9b1bd569184/serve-healthcheck-canary/0.log"
Sep 08 14:08:55.445131 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:55.445057    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-kjmxs_fda41fa2-ec43-44bd-b99c-26839106c353/insights-operator/0.log"
Sep 08 14:08:55.445425 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:55.445404    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-kjmxs_fda41fa2-ec43-44bd-b99c-26839106c353/insights-operator/1.log"
Sep 08 14:08:55.543148 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:55.543121    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrnws_daaf83ce-6d45-48fb-9365-b4fa89b32bf9/kube-rbac-proxy/0.log"
Sep 08 14:08:55.580481 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:55.580453    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrnws_daaf83ce-6d45-48fb-9365-b4fa89b32bf9/exporter/0.log"
Sep 08 14:08:55.602183 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:55.602161    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nrnws_daaf83ce-6d45-48fb-9365-b4fa89b32bf9/extractor/0.log"
Sep 08 14:08:57.947262 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:57.947183    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-575d6764f4-tcn96_1cd47b46-8ec5-424a-9071-8bf2d06c63eb/manager/0.log"
Sep 08 14:08:58.095208 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:58.095178    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-vztfn_6dc03adf-20a2-47ab-95cf-78314c6f9ada/manager/0.log"
Sep 08 14:08:58.177101 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:58.177070    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-bmq4v_41b683c1-54d9-4ad9-b2b7-8dc07df43606/seaweedfs/0.log"
Sep 08 14:08:58.883590 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:08:58.883561    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p58cr/perf-node-gather-daemonset-wj8fd"
Sep 08 14:09:03.838847 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:03.838816    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9s457_a28e79eb-f639-4083-9e0c-2cf3d4168d51/kube-multus/0.log"
Sep 08 14:09:03.859353 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:03.859328    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/kube-multus-additional-cni-plugins/0.log"
Sep 08 14:09:03.880867 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:03.880844    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/egress-router-binary-copy/0.log"
Sep 08 14:09:03.901130 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:03.901081    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/cni-plugins/0.log"
Sep 08 14:09:03.919290 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:03.919268    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/bond-cni-plugin/0.log"
Sep 08 14:09:03.938609 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:03.938588    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/routeoverride-cni/0.log"
Sep 08 14:09:04.006298 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:04.006269    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/whereabouts-cni-bincopy/0.log"
Sep 08 14:09:04.038022 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:04.037998    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhcr9_f23da5e0-9c0e-4fb1-835b-de796e9e53c4/whereabouts-cni/0.log"
Sep 08 14:09:04.480534 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:04.480487    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2p4wh_661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb/network-metrics-daemon/0.log"
Sep 08 14:09:04.502948 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:04.502922    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2p4wh_661811d7-ddfd-4c2f-b5a6-9573fbfdb6eb/kube-rbac-proxy/0.log"
Sep 08 14:09:05.597102 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.597074    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/ovn-controller/0.log"
Sep 08 14:09:05.616945 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.616918    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/ovn-acl-logging/0.log"
Sep 08 14:09:05.655247 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.655212    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/kube-rbac-proxy-node/0.log"
Sep 08 14:09:05.674966 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.674940    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 14:09:05.694337 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.694316    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/northd/0.log"
Sep 08 14:09:05.715931 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.715907    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/nbdb/0.log"
Sep 08 14:09:05.739503 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.739472    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/sbdb/0.log"
Sep 08 14:09:05.776273 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:05.776245    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bfnz6_30f663d5-adcb-4a5c-81ec-3a2bae5eea2d/ovnkube-controller/0.log"
Sep 08 14:09:07.121315 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:07.121286    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xdhvc_63fe69db-afac-4d88-86bb-06b560fba0b6/network-check-target-container/0.log"
Sep 08 14:09:08.080045 ip-10-0-141-177 kubenswrapper[2557]: I0908 14:09:08.080018    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bpd77_455da77c-c5bb-40c9-a5c7-e3c7d3ed062d/iptables-alerter/0.log"