Sep 17 17:56:35.692146 ip-10-0-133-113 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 17:56:39.160149 ip-10-0-133-113 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:56:39.160149 ip-10-0-133-113 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 17:56:39.160149 ip-10-0-133-113 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:56:39.160149 ip-10-0-133-113 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 17:56:39.160149 ip-10-0-133-113 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 17:56:39.160719 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.160226    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 17:56:39.165497 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165473    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:56:39.165497 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165496    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:56:39.165497 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165502    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:56:39.165673 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165507    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:56:39.165673 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165512    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:56:39.165673 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165516    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:56:39.165673 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165521    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:56:39.165985 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165970    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:56:39.165985 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165983    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165988    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.165993    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166000    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166006    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166010    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166015    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166020    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166033    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166059    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166064    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166069    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166074    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166081    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:56:39.166089 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166085    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166098    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166127    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166248    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166257    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166261    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166264    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166266    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166269    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166272    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166275    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166277    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166281    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166283    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166286    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166288    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166291    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166294    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166296    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:56:39.166445 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166299    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166302    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166305    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166308    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166310    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166313    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166315    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166318    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166320    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166326    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166328    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166331    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166333    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166336    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166339    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166342    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166344    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166347    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166350    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166352    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:56:39.166887 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166355    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166357    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166360    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166362    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166365    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166369    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166372    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166375    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166377    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166380    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166382    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166385    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166387    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166389    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166392    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166395    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166397    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166400    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166403    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166405    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:56:39.167367 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166407    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166410    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166413    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166415    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166418    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166420    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166423    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166427    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166431    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166435    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166437    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166440    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166442    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166445    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166448    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166450    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166453    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.166456    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167131    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167138    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:56:39.167842 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167141    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167143    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167146    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167149    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167152    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167157    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167161    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167163    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167166    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167169    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167171    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167173    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167176    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167178    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167181    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167184    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167187    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167189    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167192    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167195    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:56:39.168330 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167198    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167201    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167203    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167206    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167208    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167211    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167213    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167216    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167218    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167222    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167224    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167227    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167229    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167232    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167234    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167237    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167239    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167241    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167244    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167246    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:56:39.168932 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167249    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167251    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167253    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167256    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167258    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167260    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167263    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167265    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167268    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167270    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167273    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167276    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167279    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167282    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167284    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167286    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167289    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167291    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167294    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:56:39.169414 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167296    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167298    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167301    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167303    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167306    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167308    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167310    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167312    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167315    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167317    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167320    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167323    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167325    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167328    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167330    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167333    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167335    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167337    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167340    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:56:39.169866 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167342    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167345    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167347    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167350    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167352    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167355    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167358    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167360    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167363    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167365    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167370    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167373    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167376    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167379    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167383    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167386    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167388    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167390    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167393    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:56:39.170327 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167731    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167735    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167738    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167741    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167744    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167746    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167749    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167751    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167754    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167756    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167759    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167761    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167763    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167766    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167769    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167773    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167776    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167779    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167784    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:56:39.170767 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167789    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167792    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167795    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167799    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167803    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167805    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167808    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167810    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167813    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167816    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167818    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167820    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167824    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167826    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167829    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167831    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167833    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167836    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167838    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167840    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:56:39.171218 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167843    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167846    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167848    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167851    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167853    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167856    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167859    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167861    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167863    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167866    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167869    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167873    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167876    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167878    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167881    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167884    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167886    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167889    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167891    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167893    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:56:39.171691 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167896    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167898    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167915    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167918    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167920    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167923    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167925    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167928    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167930    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167933    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167935    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167937    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167940    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167942    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167945    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167947    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167950    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167952    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167954    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:56:39.172185 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167957    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167959    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167961    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167964    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167968    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167970    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167973    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167975    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167978    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167980    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167982    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167985    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167987    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167989    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167991    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167994    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167996    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.167998    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168001    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168003    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:56:39.172612 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168005    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168075    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168110    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168115    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168119    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168123    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168126    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168130    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168133    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168136    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168139    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168142    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168145    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168148    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168151    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168153    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168160    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168164    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168167    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168171    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168174    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168177    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168180    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168183    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 17:56:39.173099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168186    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168189    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168192    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168195    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168198    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168201    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168204    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168207    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168209    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168213    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168216    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168219    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168222    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168224    2577 flags.go:64] FLAG: --enable-server="true"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168227    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168231    2577 flags.go:64] FLAG: --event-burst="100"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168234    2577 flags.go:64] FLAG: --event-qps="50"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168237    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168240    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168242    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168246    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168249    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168252    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168255    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168259    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 17:56:39.173652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168262    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168266    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168268    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168271    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168274    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168276    2577 flags.go:64] FLAG: --feature-gates=""
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168280    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168283    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168286    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168288    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168291    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168294    2577 flags.go:64] FLAG: --help="false"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168297    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168299    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168302    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168305    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168308    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168311    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168314    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168316    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168319    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168322    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168324    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168327    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 17:56:39.174287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168330    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168333    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168336    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168339    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168341    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168344    2577 flags.go:64] FLAG: --lock-file=""
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168347    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168351    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168354    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168359    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168362    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168365    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168368    2577 flags.go:64] FLAG: --logging-format="text"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168371    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168374    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168376    2577 flags.go:64] FLAG: --manifest-url=""
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168379    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168383    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168386    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168390    2577 flags.go:64] FLAG: --max-pods="110"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168392    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168395    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168398    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168400    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168403    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 17:56:39.174870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168406    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168409    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168415    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168418    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168421    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168424    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168426    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168431    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168434    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168437    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168440    2577 flags.go:64] FLAG: --port="10250"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168442    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168445    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0001d00a3fc6fee53"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168448    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168451    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168455    2577 flags.go:64] FLAG: --register-node="true"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168458    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168461    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168465    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168468    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168471    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168474    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168477    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168480    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168482    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 17:56:39.175529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168485    2577 flags.go:64] FLAG: --runonce="false"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168488    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168490    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168493    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168496    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168498    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168501    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168504    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168507    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168509    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168512    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168515    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168517    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168520    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168523    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168525    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168530    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168533    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168535    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168539    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168541    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168544    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168549    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168552    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168554    2577 flags.go:64] FLAG: --v="2"
Sep 17 17:56:39.176167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168558    2577 flags.go:64] FLAG: --version="false"
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168562    2577 flags.go:64] FLAG: --vmodule=""
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168566    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.168569    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168672    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168676    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168679    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168682    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168684    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168687    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168689    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168691    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168694    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168696    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168699    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168701    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168704    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168706    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168709    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168711    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168714    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:56:39.176749 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168716    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168718    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168721    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168723    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168725    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168728    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168730    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168733    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168737    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168740    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168744    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168747    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168750    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168753    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168756    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168759    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168761    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168763    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168766    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:56:39.177234 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168768    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168771    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168773    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168775    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168778    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168780    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168783    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168786    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168789    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168792    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168794    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168796    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168799    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168801    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168804    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168806    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168809    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168811    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168814    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:56:39.177692 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168816    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168820    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168824    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168827    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168830    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168833    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168836    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168839    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168843    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168845    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168848    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168850    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168852    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168855    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168857    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168860    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168862    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168864    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168867    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:56:39.178154 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168869    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168872    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168874    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168876    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168879    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168881    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168884    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168886    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168888    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168891    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168893    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168895    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168898    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168916    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168920    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168924    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168927    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168930    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168932    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168935    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:56:39.178598 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168938    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168940    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168943    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168946    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.168949    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.169493    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.175945    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.175960    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.175973    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.175981    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176033    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176037    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176040    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176044    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176048    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:56:39.179095 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176051    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176053    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176056    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176059    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176061    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176063    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176066    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176068    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176071    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176074    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176076    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176079    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176081    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176084    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176086    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176090    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176094    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176096    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176099    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176102    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:56:39.179458 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176104    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176107    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176109    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176112    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176115    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176118    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176121    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176123    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176126    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176129    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176131    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176134    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176136    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176139    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176141    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176144    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176146    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176149    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176151    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176154    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:56:39.180007 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176156    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176159    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176162    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176164    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176166    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176169    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176172    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176174    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176177    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176180    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176182    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176185    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176188    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176190    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176193    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176196    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176199    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176202    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176205    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176208    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:56:39.180472 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176210    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176213    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176217    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176220    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176223    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176226    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176229    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176231    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176234    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176236    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176239    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176241    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176244    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176246    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176250    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176253    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176256    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176259    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176262    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:56:39.180995 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176264    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176267    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176270    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176272    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176275    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176277    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176280    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176283    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176285    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176289    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176291    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176294    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176296    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176299    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:56:39.181438 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176302    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.176307    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176411    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176414    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176417    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176420    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176422    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176425    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176428    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176430    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176433    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176435    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176438    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176440    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176443    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 17:56:39.181774 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176445    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176448    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176450    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176453    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176455    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176458    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176461    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176463    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176465    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176468    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176470    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176473    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176476    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176478    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176481    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176484    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176486    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176489    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176491    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176494    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 17:56:39.182222 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176496    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176499    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176501    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176503    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176506    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176508    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176511    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176513    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176516    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176518    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176521    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176524    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176526    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176529    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176531    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176534    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176536    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176539    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176541    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176544    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 17:56:39.182724 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176546    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176548    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176551    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176553    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176556    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176559    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176561    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176564    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176568    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176571    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176574    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176577    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176580    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176583    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176586    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176588    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176591    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176593    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176596    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176598    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 17:56:39.183264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176601    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176603    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176606    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176608    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176612    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176615    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176618    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176621    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176624    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176627    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176629    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176632    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176634    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176637    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176639    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176641    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176644    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176647    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176649    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 17:56:39.183734 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176652    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176655    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176659    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176662    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176664    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176667    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:39.176669    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.176674    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.176766    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.178798    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.179927    2577 server.go:1019] "Starting client certificate rotation"
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.180021    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.180048    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 17:56:39.184192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.183143    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:56:39.185633 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.185619    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 17:56:39.190394 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.190377    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 17 17:56:39.191880 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.191866    2577 log.go:25] "Validated CRI v1 image API"
Sep 17 17:56:39.192686 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.192671    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 17:56:39.195527 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.195507    2577 fs.go:135] Filesystem UUIDs: map[2fcc1599-1bec-4281-a009-62b025f63afc:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b2aa0c98-4698-4e8c-ba0e-17c885df3c03:/dev/nvme0n1p4]
Sep 17 17:56:39.195603 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.195526    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 17:56:39.199447 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.199351    2577 manager.go:216] Machine: {Timestamp:2026-09-17 17:56:39.198923605 +0000 UTC m=+1.951663925 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3209147 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25a793782e16cee4e089558e7d76cf SystemUUID:ec25a793-782e-16ce-e4e0-89558e7d76cf BootID:93eb5897-015c-4fcb-bd7d-9c8a6639ad55 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d8:6c:0e:7f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d8:6c:0e:7f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:25:38:2d:3b:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 17:56:39.199447 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.199444    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 17:56:39.199540 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.199523    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 17:56:39.202929 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.202894    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 17:56:39.203047 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.202930    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-113.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 17:56:39.204383 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.204373    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 17:56:39.204419 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.204386    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 17:56:39.204419 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.204393    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:56:39.204419 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.204403    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 17:56:39.204497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.204463    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 17:56:39.208584 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208571    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:56:39.208708 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208699    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 17:56:39.208740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208732    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 17:56:39.208776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208741    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 17:56:39.208776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208756    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 17:56:39.208776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208764    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 17 17:56:39.208776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.208773    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 17:56:39.209363 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.209350    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:56:39.209409 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.209369    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 17:56:39.211570 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.211546    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 17:56:39.216699 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.216686    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 17:56:39.216746 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.216714    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 17:56:39.217722 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217708    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 17:56:39.217761 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217727    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 17:56:39.217761 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217734    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 17:56:39.217761 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217742    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 17:56:39.217761 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217752    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 17:56:39.217761 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217757    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217770    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217776    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217781    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217786    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217800    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217804    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217832    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 17:56:39.217883 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.217837    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 17:56:39.218220 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.218206    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:56:39.221347 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.221333    2577 server.go:1268] "Started kubelet"
Sep 17 17:56:39.221430 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.221405    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 17:56:39.221660 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.221492    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 17:56:39.221788 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.221773    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 17:56:39.221955 ip-10-0-133-113 systemd[1]: Started Kubernetes Kubelet.
Sep 17 17:56:39.254408 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.254385    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 17:56:39.255785 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.255771    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 17:56:39.256652 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.256623    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 17:56:39.258260 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.258245    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-113.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 17:56:39.258595 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.258575    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 17:56:39.258864 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.258844    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 17:56:39.260060 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260037    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 17:56:39.260141 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260058    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 17:56:39.260242 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.260174    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260718    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260782    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260797    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260861    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.260873    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261247    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261262    2577 factory.go:55] Registering systemd factory
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261270    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261464    2577 factory.go:153] Registering CRI-O factory
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261475    2577 factory.go:223] Registration of the crio container factory successfully
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261492    2577 factory.go:103] Registering Raw factory
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261506    2577 manager.go:1196] Started watching for new ooms in manager
Sep 17 17:56:39.263816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.261880    2577 manager.go:349] Starting recovery of all containers
Sep 17 17:56:39.265351 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.265318    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-113.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 17:56:39.270975 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.270951    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 17:56:39.271638 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.271622    2577 manager.go:354] Recovery completed
Sep 17 17:56:39.271820 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.271801    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6f4zl"
Sep 17 17:56:39.271960 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.270948    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-113.ec2.internal.18d62d619e8a937d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-113.ec2.internal,UID:ip-10-0-133-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-113.ec2.internal,},FirstTimestamp:2026-09-17 17:56:39.221310333 +0000 UTC m=+1.974050652,LastTimestamp:2026-09-17 17:56:39.221310333 +0000 UTC m=+1.974050652,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-113.ec2.internal,}"
Sep 17 17:56:39.275601 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.275588    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.277280 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277267    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.277330 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277294    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.277330 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277305    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.277826 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277814    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 17:56:39.277885 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277828    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 17:56:39.277885 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277835    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.277885 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.277844    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 17:56:39.278557 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.278522    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.278557 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.278551    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.278655 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.278567    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.279972 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.279960    2577 policy_none.go:49] "None policy: Start"
Sep 17 17:56:39.280016 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.279976    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 17:56:39.280016 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.279986    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 17:56:39.281913 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.281889    2577 policy_none.go:47] "Start"
Sep 17 17:56:39.282646 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.282581    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-113.ec2.internal.18d62d61a1e0a090  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-113.ec2.internal,UID:ip-10-0-133-113.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-113.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-113.ec2.internal,},FirstTimestamp:2026-09-17 17:56:39.277281424 +0000 UTC m=+2.030021748,LastTimestamp:2026-09-17 17:56:39.277281424 +0000 UTC m=+2.030021748,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-113.ec2.internal,}"
Sep 17 17:56:39.282726 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.282707    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6f4zl"
Sep 17 17:56:39.311418 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311403    2577 manager.go:337] "Starting Device Plugin manager"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.311434    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311443    2577 server.go:87] "Starting device plugin registration server"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311604    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311620    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311707    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311773    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.311781    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.312397    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.312447    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.318350    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.319548    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.319595    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.319613    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.319651    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 17:56:39.327214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.321884    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:56:39.411931 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.411872    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.412575 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.412562    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.412642 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.412586    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.412642 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.412595    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.412642 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.412612    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.419793 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.419776    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"]
Sep 17 17:56:39.419869 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.419834    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.421717 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.421703    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.421780 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.421727    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.421780 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.421739    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.422099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.422086    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.422155 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.422108    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-113.ec2.internal\": node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.423862 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.423850    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.423979 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.423963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.424028 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.423992    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.424489 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.424475    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.424551 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.424490    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.424551 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.424503    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.424551 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.424511    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.424551 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.424517    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.424551 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.424521    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.426616 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.426599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.426702 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.426622    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 17:56:39.427319 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.427302    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 17:56:39.427395 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.427330    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 17:56:39.427395 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.427342    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeHasSufficientPID"
Sep 17 17:56:39.447193 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.447171    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.458356 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.458334    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-113.ec2.internal\" not found" node="ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.461885 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.461867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1687c29f4de0497448ee89348c1bced3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-113.ec2.internal\" (UID: \"1687c29f4de0497448ee89348c1bced3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.461979 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.461915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dc5bbcef9cb6c31dbd1c4277954fb6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal\" (UID: \"1dc5bbcef9cb6c31dbd1c4277954fb6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.461979 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.461942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc5bbcef9cb6c31dbd1c4277954fb6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal\" (UID: \"1dc5bbcef9cb6c31dbd1c4277954fb6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.462301 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.462286    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-113.ec2.internal\" not found" node="ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.547484 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.547467    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.562981 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.562962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1687c29f4de0497448ee89348c1bced3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-113.ec2.internal\" (UID: \"1687c29f4de0497448ee89348c1bced3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.563040 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.562985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dc5bbcef9cb6c31dbd1c4277954fb6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal\" (UID: \"1dc5bbcef9cb6c31dbd1c4277954fb6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.563040 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.562999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc5bbcef9cb6c31dbd1c4277954fb6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal\" (UID: \"1dc5bbcef9cb6c31dbd1c4277954fb6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.563040 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.563035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc5bbcef9cb6c31dbd1c4277954fb6b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal\" (UID: \"1dc5bbcef9cb6c31dbd1c4277954fb6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.563173 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.563059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1687c29f4de0497448ee89348c1bced3-config\") pod \"kube-apiserver-proxy-ip-10-0-133-113.ec2.internal\" (UID: \"1687c29f4de0497448ee89348c1bced3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.563173 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.563089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1dc5bbcef9cb6c31dbd1c4277954fb6b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal\" (UID: \"1dc5bbcef9cb6c31dbd1c4277954fb6b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.648010 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.647990    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.749007 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.748862    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.762133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.762116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.765587 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:39.765572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:39.849351 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.849328    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:39.949805 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:39.949787    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:40.050261 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:40.050246    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:40.150783 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:40.150766    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-113.ec2.internal\" not found"
Sep 17 17:56:40.179232 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.179215    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 17:56:40.179522 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.179323    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 17:56:40.231585 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.231566    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:56:40.260350 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.260330    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 17:56:40.260925 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.260889    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:40.280639 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.280620    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:56:40.281504 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.281486    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 17:56:40.282362 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.282347    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal"
Sep 17 17:56:40.288168 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.288130    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 17:51:39 +0000 UTC" deadline="2028-04-27 13:32:30.571911263 +0000 UTC"
Sep 17 17:56:40.288168 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.288159    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14107h35m50.283756664s"
Sep 17 17:56:40.307775 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.307736    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 17:56:40.336468 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.336449    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hrkb"
Sep 17 17:56:40.350918 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.350890    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hrkb"
Sep 17 17:56:40.395000 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:40.394976    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1687c29f4de0497448ee89348c1bced3.slice/crio-fc447b93e991a4d2b8ad33b048de3d9a510e36e91a5c1a359ffa63414451d32a WatchSource:0}: Error finding container fc447b93e991a4d2b8ad33b048de3d9a510e36e91a5c1a359ffa63414451d32a: Status 404 returned error can't find the container with id fc447b93e991a4d2b8ad33b048de3d9a510e36e91a5c1a359ffa63414451d32a
Sep 17 17:56:40.395385 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:40.395369    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc5bbcef9cb6c31dbd1c4277954fb6b.slice/crio-03b9a5c05cfd6ffdaa470b43ebe9372e0fb02afe7197e1b6de7ab26130560c9b WatchSource:0}: Error finding container 03b9a5c05cfd6ffdaa470b43ebe9372e0fb02afe7197e1b6de7ab26130560c9b: Status 404 returned error can't find the container with id 03b9a5c05cfd6ffdaa470b43ebe9372e0fb02afe7197e1b6de7ab26130560c9b
Sep 17 17:56:40.400104 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.400084    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 17:56:40.418917 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.418886    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:56:40.635045 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:40.635000    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:56:41.163219 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.163186    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 17:56:41.209795 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.209767    2577 apiserver.go:52] "Watching apiserver"
Sep 17 17:56:41.220148 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.219977    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 17:56:41.220417 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.220389    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tmbzr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw","openshift-dns/node-resolver-tvbl4","openshift-image-registry/node-ca-m25vn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal","openshift-multus/network-metrics-daemon-q6mtq","openshift-network-operator/iptables-alerter-qlwg7","openshift-ovn-kubernetes/ovnkube-node-ww9br","kube-system/konnectivity-agent-5pcfw","kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal","openshift-cluster-node-tuning-operator/tuned-k9nfk","openshift-multus/multus-additional-cni-plugins-24ngd","openshift-multus/multus-zxfhr","openshift-network-diagnostics/network-check-target-tvgp2"]
Sep 17 17:56:41.222986 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.222965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.225534 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.225175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.227357 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.227341    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.229271 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.229249    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 17:56:41.229481 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.229461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.229565 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.229529    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-grfdw\""
Sep 17 17:56:41.230127 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.229645    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.230127 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.229702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.231768 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.231753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:41.231855 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.231813    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:41.234381 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.234363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.234453 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.234420    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:41.236931 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.236761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.237324 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.237306    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 17:56:41.237555 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.237538    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.237807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.237790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.238223 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.238203    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.238561 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.238539    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.239769 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.239750    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.239872 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.239853    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gzwx7\""
Sep 17 17:56:41.239980 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.239964    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cpt87\""
Sep 17 17:56:41.240032 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.239978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.240709 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.240555    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 17:56:41.241495 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.241474    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bjnpk\""
Sep 17 17:56:41.241717 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.241703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.244462 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.243737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.244462 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.244263    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 17:56:41.244593 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.244516    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 17:56:41.245058 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245041    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.245120 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245090    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-97qm6\""
Sep 17 17:56:41.245273 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245254    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 17:56:41.245338 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245319    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.245458 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245263    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.245533 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245518    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 17:56:41.245581 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245553    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.245735 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qh27t\""
Sep 17 17:56:41.245926 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.245893    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.247320 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.247294    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.247394 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.247346    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:41.249934 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.249897    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.258312 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.258289    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 17:56:41.258423 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.258333    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 17:56:41.259409 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.259389    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 17:56:41.262016 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.261998    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 17:56:41.269542 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.269233    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 17:56:41.269542 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.269248    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zs2vt\""
Sep 17 17:56:41.269542 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.269323    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-znm7s\""
Sep 17 17:56:41.269542 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.269454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hdlzw\""
Sep 17 17:56:41.269542 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.269458    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 17:56:41.270502 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.270483    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 17:56:41.270502 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.270487    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 17:56:41.270630 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.270565    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 17:56:41.271702 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-device-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.271791 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-var-lib-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.271791 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d483dbc2-17ca-43c8-8738-22f5584b3f71-iptables-alerter-script\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.271893 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-ovn\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.271893 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ql5b\" (UniqueName: \"kubernetes.io/projected/de9a5ba3-4824-48c9-9498-d6c8963cada3-kube-api-access-7ql5b\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.271893 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-system-cni-dir\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.272048 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cnibin\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.272048 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cni-binary-copy\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.272048 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272048 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-env-overrides\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272048 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.271989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-modprobe-d\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.272048 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-kubernetes\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-tuned\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104f3713-9564-4733-90e1-cc0923af9610-dbus\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-systemd\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-tmp\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-hosts-file\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a033a4bf-2f57-4cc8-8235-4aaa23f96261-host\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a033a4bf-2f57-4cc8-8235-4aaa23f96261-serviceca\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.272311 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272259    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-system-cni-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-systemd\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-log-socket\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovnkube-script-lib\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7006b69-52b5-423f-989e-69b139de701a-cni-binary-copy\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d483dbc2-17ca-43c8-8738-22f5584b3f71-host-slash\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e35697e-1b29-401b-9729-5e222483ed9f-konnectivity-ca\") pod \"konnectivity-agent-5pcfw\" (UID: \"6e35697e-1b29-401b-9729-5e222483ed9f\") " pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvbbw\" (UniqueName: \"kubernetes.io/projected/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-kube-api-access-kvbbw\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-cnibin\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.272608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-kubelet\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-run-netns\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-cni-bin\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovnkube-config\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovn-node-metrics-cert\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-socket-dir-parent\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e35697e-1b29-401b-9729-5e222483ed9f-agent-certs\") pod \"konnectivity-agent-5pcfw\" (UID: \"6e35697e-1b29-401b-9729-5e222483ed9f\") " pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-etc-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-node-log\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfgdk\" (UniqueName: \"kubernetes.io/projected/a033a4bf-2f57-4cc8-8235-4aaa23f96261-kube-api-access-lfgdk\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-hostroot\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-multus-certs\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j56h\" (UniqueName: \"kubernetes.io/projected/5ac29325-e1fc-4ff8-9420-580e4662f27f-kube-api-access-4j56h\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.272979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-slash\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-k8s-cni-cncf-io\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-cni-bin\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7006b69-52b5-423f-989e-69b139de701a-multus-daemon-config\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-etc-kubernetes\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z88hh\" (UniqueName: \"kubernetes.io/projected/e7006b69-52b5-423f-989e-69b139de701a-kube-api-access-z88hh\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-registration-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-sys-fs\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-run\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-sys\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-host\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2czqg\" (UniqueName: \"kubernetes.io/projected/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-kube-api-access-2czqg\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-cni-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-systemd-units\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-cni-netd\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysctl-conf\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-var-lib-kubelet\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.273667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-cni-multus\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-socket-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-kubelet\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysconfig\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysctl-d\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmrft\" (UniqueName: \"kubernetes.io/projected/d483dbc2-17ca-43c8-8738-22f5584b3f71-kube-api-access-zmrft\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104f3713-9564-4733-90e1-cc0923af9610-kubelet-config\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-lib-modules\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-tmp-dir\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-netns\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsdss\" (UniqueName: \"kubernetes.io/projected/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-kube-api-access-rsdss\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.274341 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdbzq\" (UniqueName: \"kubernetes.io/projected/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-kube-api-access-vdbzq\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.274998 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.273816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-conf-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.324288 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.324203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal" event={"ID":"1dc5bbcef9cb6c31dbd1c4277954fb6b","Type":"ContainerStarted","Data":"03b9a5c05cfd6ffdaa470b43ebe9372e0fb02afe7197e1b6de7ab26130560c9b"}
Sep 17 17:56:41.325606 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.325587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal" event={"ID":"1687c29f4de0497448ee89348c1bced3","Type":"ContainerStarted","Data":"fc447b93e991a4d2b8ad33b048de3d9a510e36e91a5c1a359ffa63414451d32a"}
Sep 17 17:56:41.353869 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.353815    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:51:40 +0000 UTC" deadline="2028-03-11 14:15:27.735712847 +0000 UTC"
Sep 17 17:56:41.353869 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.353867    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12980h18m46.381852526s"
Sep 17 17:56:41.374708 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysctl-d\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.374807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:41.374807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.374807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmrft\" (UniqueName: \"kubernetes.io/projected/d483dbc2-17ca-43c8-8738-22f5584b3f71-kube-api-access-zmrft\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.374807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104f3713-9564-4733-90e1-cc0923af9610-kubelet-config\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.374807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-lib-modules\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-tmp-dir\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/104f3713-9564-4733-90e1-cc0923af9610-kubelet-config\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-netns\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-lib-modules\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysctl-d\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsdss\" (UniqueName: \"kubernetes.io/projected/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-kube-api-access-rsdss\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.374997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdbzq\" (UniqueName: \"kubernetes.io/projected/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-kube-api-access-vdbzq\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-conf-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-device-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-var-lib-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-conf-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d483dbc2-17ca-43c8-8738-22f5584b3f71-iptables-alerter-script\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-ovn\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-var-lib-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-device-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-netns\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375216    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-ovn\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ql5b\" (UniqueName: \"kubernetes.io/projected/de9a5ba3-4824-48c9-9498-d6c8963cada3-kube-api-access-7ql5b\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-system-cni-dir\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cnibin\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-system-cni-dir\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375363    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-tmp-dir\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cni-binary-copy\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cnibin\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-env-overrides\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-modprobe-d\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.375743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-kubernetes\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-tuned\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104f3713-9564-4733-90e1-cc0923af9610-dbus\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-systemd\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-tmp\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-hosts-file\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d483dbc2-17ca-43c8-8738-22f5584b3f71-iptables-alerter-script\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a033a4bf-2f57-4cc8-8235-4aaa23f96261-host\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-modprobe-d\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-kubernetes\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a033a4bf-2f57-4cc8-8235-4aaa23f96261-serviceca\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-systemd\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-system-cni-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/104f3713-9564-4733-90e1-cc0923af9610-dbus\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a033a4bf-2f57-4cc8-8235-4aaa23f96261-host\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-systemd\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-log-socket\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.376497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovnkube-script-lib\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.375802    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7006b69-52b5-423f-989e-69b139de701a-cni-binary-copy\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375818    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.375861    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:41.875843909 +0000 UTC m=+4.628584239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-cni-binary-copy\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d483dbc2-17ca-43c8-8738-22f5584b3f71-host-slash\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-env-overrides\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e35697e-1b29-401b-9729-5e222483ed9f-konnectivity-ca\") pod \"konnectivity-agent-5pcfw\" (UID: \"6e35697e-1b29-401b-9729-5e222483ed9f\") " pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d483dbc2-17ca-43c8-8738-22f5584b3f71-host-slash\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.375990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvbbw\" (UniqueName: \"kubernetes.io/projected/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-kube-api-access-kvbbw\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-hosts-file\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-cnibin\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-kubelet\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-log-socket\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.377377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-run-netns\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-cni-bin\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovnkube-config\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovn-node-metrics-cert\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-socket-dir-parent\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e35697e-1b29-401b-9729-5e222483ed9f-agent-certs\") pod \"konnectivity-agent-5pcfw\" (UID: \"6e35697e-1b29-401b-9729-5e222483ed9f\") " pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-etc-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a033a4bf-2f57-4cc8-8235-4aaa23f96261-serviceca\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-run-netns\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-node-log\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-kubelet\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfgdk\" (UniqueName: \"kubernetes.io/projected/a033a4bf-2f57-4cc8-8235-4aaa23f96261-kube-api-access-lfgdk\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-cnibin\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-system-cni-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-hostroot\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.378194 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-hostroot\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-cni-bin\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-socket-dir-parent\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovnkube-config\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-systemd\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e35697e-1b29-401b-9729-5e222483ed9f-konnectivity-ca\") pod \"konnectivity-agent-5pcfw\" (UID: \"6e35697e-1b29-401b-9729-5e222483ed9f\") " pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-multus-certs\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j56h\" (UniqueName: \"kubernetes.io/projected/5ac29325-e1fc-4ff8-9420-580e4662f27f-kube-api-access-4j56h\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovnkube-script-lib\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-slash\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.376995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-k8s-cni-cncf-io\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-run-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-cni-bin\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7006b69-52b5-423f-989e-69b139de701a-multus-daemon-config\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-etc-openvswitch\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-etc-kubernetes\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-slash\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z88hh\" (UniqueName: \"kubernetes.io/projected/e7006b69-52b5-423f-989e-69b139de701a-kube-api-access-z88hh\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-registration-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377123    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-k8s-cni-cncf-io\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-sys-fs\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-run-multus-certs\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-run\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-etc-kubernetes\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-sys\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-host\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-sys\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2czqg\" (UniqueName: \"kubernetes.io/projected/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-kube-api-access-2czqg\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-cni-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-systemd-units\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-cni-netd\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysctl-conf\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-var-lib-kubelet\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-registration-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.379776 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-cni-multus\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-socket-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-sys-fs\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377556    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-run\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-kubelet\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysconfig\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-node-log\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-host\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-multus-cni-dir\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7006b69-52b5-423f-989e-69b139de701a-cni-binary-copy\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-systemd-units\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7006b69-52b5-423f-989e-69b139de701a-multus-daemon-config\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377775    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-cni-netd\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-etc-selinux\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-cni-bin\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.377882    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:41.380415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377932    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysconfig\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7006b69-52b5-423f-989e-69b139de701a-host-var-lib-cni-multus\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.377966    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret podName:104f3713-9564-4733-90e1-cc0923af9610 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:41.877951677 +0000 UTC m=+4.630691997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret") pod "global-pull-secret-syncer-tmbzr" (UID: "104f3713-9564-4733-90e1-cc0923af9610") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-var-lib-kubelet\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-sysctl-conf\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.377997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-host-kubelet\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.378083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5ac29325-e1fc-4ff8-9420-580e4662f27f-socket-dir\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.379586    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-tmp\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.379644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-etc-tuned\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.380032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-ovn-node-metrics-cert\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.380964 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.380117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e35697e-1b29-401b-9729-5e222483ed9f-agent-certs\") pod \"konnectivity-agent-5pcfw\" (UID: \"6e35697e-1b29-401b-9729-5e222483ed9f\") " pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.402440 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.402416    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ql5b\" (UniqueName: \"kubernetes.io/projected/de9a5ba3-4824-48c9-9498-d6c8963cada3-kube-api-access-7ql5b\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.403886 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.403865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j56h\" (UniqueName: \"kubernetes.io/projected/5ac29325-e1fc-4ff8-9420-580e4662f27f-kube-api-access-4j56h\") pod \"aws-ebs-csi-driver-node-cjzdw\" (UID: \"5ac29325-e1fc-4ff8-9420-580e4662f27f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.404358 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.404334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdbzq\" (UniqueName: \"kubernetes.io/projected/e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4-kube-api-access-vdbzq\") pod \"tuned-k9nfk\" (UID: \"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4\") " pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.405721 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.405476    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:56:41.405721 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.405496    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:56:41.405721 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.405509    2577 projected.go:196] Error preparing data for projected volume kube-api-access-4lbls for pod openshift-network-diagnostics/network-check-target-tvgp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:41.405721 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.405555    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls podName:04b43c83-4a08-4d2d-8bba-1f16853d7410 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:41.905541114 +0000 UTC m=+4.658281437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4lbls" (UniqueName: "kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls") pod "network-check-target-tvgp2" (UID: "04b43c83-4a08-4d2d-8bba-1f16853d7410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:41.407503 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.407477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2czqg\" (UniqueName: \"kubernetes.io/projected/7ed9af67-a459-4e78-8e14-d5e6a492f7a7-kube-api-access-2czqg\") pod \"node-resolver-tvbl4\" (UID: \"7ed9af67-a459-4e78-8e14-d5e6a492f7a7\") " pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.408252 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.408227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmrft\" (UniqueName: \"kubernetes.io/projected/d483dbc2-17ca-43c8-8738-22f5584b3f71-kube-api-access-zmrft\") pod \"iptables-alerter-qlwg7\" (UID: \"d483dbc2-17ca-43c8-8738-22f5584b3f71\") " pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.408406 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.408382    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfgdk\" (UniqueName: \"kubernetes.io/projected/a033a4bf-2f57-4cc8-8235-4aaa23f96261-kube-api-access-lfgdk\") pod \"node-ca-m25vn\" (UID: \"a033a4bf-2f57-4cc8-8235-4aaa23f96261\") " pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.408793 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.408759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z88hh\" (UniqueName: \"kubernetes.io/projected/e7006b69-52b5-423f-989e-69b139de701a-kube-api-access-z88hh\") pod \"multus-zxfhr\" (UID: \"e7006b69-52b5-423f-989e-69b139de701a\") " pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.409710 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.409660    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvbbw\" (UniqueName: \"kubernetes.io/projected/c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9-kube-api-access-kvbbw\") pod \"ovnkube-node-ww9br\" (UID: \"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.409989 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.409968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsdss\" (UniqueName: \"kubernetes.io/projected/06618c28-7ec8-4f43-aae8-5eaff3e4d55b-kube-api-access-rsdss\") pod \"multus-additional-cni-plugins-24ngd\" (UID: \"06618c28-7ec8-4f43-aae8-5eaff3e4d55b\") " pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.536373 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.536347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qlwg7"
Sep 17 17:56:41.544214 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.544189    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k9nfk"
Sep 17 17:56:41.552502 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.552479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tvbl4"
Sep 17 17:56:41.562170 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.562154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m25vn"
Sep 17 17:56:41.566702 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.566685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:56:41.573694 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.573674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zxfhr"
Sep 17 17:56:41.581390 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.581371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw"
Sep 17 17:56:41.589026 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.589006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:56:41.593331 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.593304    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24ngd"
Sep 17 17:56:41.882082 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.882006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:41.882082 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.882066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:41.882281 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.882155    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:41.882281 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.882163    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:41.882281 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.882216    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret podName:104f3713-9564-4733-90e1-cc0923af9610 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:42.882199871 +0000 UTC m=+5.634940195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret") pod "global-pull-secret-syncer-tmbzr" (UID: "104f3713-9564-4733-90e1-cc0923af9610") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:41.882281 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.882238    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:42.88222233 +0000 UTC m=+5.634962636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:41.982582 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:41.982552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:41.982728 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.982666    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:56:41.982728 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.982688    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:56:41.982728 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.982699    2577 projected.go:196] Error preparing data for projected volume kube-api-access-4lbls for pod openshift-network-diagnostics/network-check-target-tvgp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:41.982873 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:41.982755    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls podName:04b43c83-4a08-4d2d-8bba-1f16853d7410 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:42.982738815 +0000 UTC m=+5.735479122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lbls" (UniqueName: "kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls") pod "network-check-target-tvgp2" (UID: "04b43c83-4a08-4d2d-8bba-1f16853d7410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:42.145491 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.145456    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dc4fca_6bcc_4a13_ba13_c76c0be8efd9.slice/crio-d0181a0757610abc542de70e17748e1b7fea1518ce8d7c59c8f42d14d8256d8a WatchSource:0}: Error finding container d0181a0757610abc542de70e17748e1b7fea1518ce8d7c59c8f42d14d8256d8a: Status 404 returned error can't find the container with id d0181a0757610abc542de70e17748e1b7fea1518ce8d7c59c8f42d14d8256d8a
Sep 17 17:56:42.147282 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.147261    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f5f34f_39bb_4098_a77b_6c9b1bfe55c4.slice/crio-d5955b758603aa76c73e4b357517dceb73af01c72725bcd428e2bd83ac1a9d92 WatchSource:0}: Error finding container d5955b758603aa76c73e4b357517dceb73af01c72725bcd428e2bd83ac1a9d92: Status 404 returned error can't find the container with id d5955b758603aa76c73e4b357517dceb73af01c72725bcd428e2bd83ac1a9d92
Sep 17 17:56:42.148796 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.148778    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda033a4bf_2f57_4cc8_8235_4aaa23f96261.slice/crio-ba577ea141da7b421c993b7d8e24f64f52dcf59e3f10a84c8db716a3b69aae32 WatchSource:0}: Error finding container ba577ea141da7b421c993b7d8e24f64f52dcf59e3f10a84c8db716a3b69aae32: Status 404 returned error can't find the container with id ba577ea141da7b421c993b7d8e24f64f52dcf59e3f10a84c8db716a3b69aae32
Sep 17 17:56:42.151437 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.151406    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac29325_e1fc_4ff8_9420_580e4662f27f.slice/crio-b9987c1b03406ea777a2293492c70b35e814ba083e3cce449a10a3ebd7ac26d2 WatchSource:0}: Error finding container b9987c1b03406ea777a2293492c70b35e814ba083e3cce449a10a3ebd7ac26d2: Status 404 returned error can't find the container with id b9987c1b03406ea777a2293492c70b35e814ba083e3cce449a10a3ebd7ac26d2
Sep 17 17:56:42.171369 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.171349    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e35697e_1b29_401b_9729_5e222483ed9f.slice/crio-fded051e59198a84686800592c613762b5fb88994e5bd76db06330fbb956724b WatchSource:0}: Error finding container fded051e59198a84686800592c613762b5fb88994e5bd76db06330fbb956724b: Status 404 returned error can't find the container with id fded051e59198a84686800592c613762b5fb88994e5bd76db06330fbb956724b
Sep 17 17:56:42.171999 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.171978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7006b69_52b5_423f_989e_69b139de701a.slice/crio-7c07b1de8ae6a914a653f6b25f7458e459b04a5cd44e65c94a9a25a216c98334 WatchSource:0}: Error finding container 7c07b1de8ae6a914a653f6b25f7458e459b04a5cd44e65c94a9a25a216c98334: Status 404 returned error can't find the container with id 7c07b1de8ae6a914a653f6b25f7458e459b04a5cd44e65c94a9a25a216c98334
Sep 17 17:56:42.172933 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.172892    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06618c28_7ec8_4f43_aae8_5eaff3e4d55b.slice/crio-3566256d14ae91e960cd91112ee21c7e0943fb8dbc489dfa75979bd8c01c9c7b WatchSource:0}: Error finding container 3566256d14ae91e960cd91112ee21c7e0943fb8dbc489dfa75979bd8c01c9c7b: Status 404 returned error can't find the container with id 3566256d14ae91e960cd91112ee21c7e0943fb8dbc489dfa75979bd8c01c9c7b
Sep 17 17:56:42.173710 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.173689    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed9af67_a459_4e78_8e14_d5e6a492f7a7.slice/crio-12bcac8c4ea7d245daddf954dc4c3ef760fdbca225b4656afc69bdb83124ab6b WatchSource:0}: Error finding container 12bcac8c4ea7d245daddf954dc4c3ef760fdbca225b4656afc69bdb83124ab6b: Status 404 returned error can't find the container with id 12bcac8c4ea7d245daddf954dc4c3ef760fdbca225b4656afc69bdb83124ab6b
Sep 17 17:56:42.174860 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:56:42.174827    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd483dbc2_17ca_43c8_8738_22f5584b3f71.slice/crio-2b6ff9074aad69708232572a3e1a4fba83fd1797dfaedb63dd9e5f62f6cc9c91 WatchSource:0}: Error finding container 2b6ff9074aad69708232572a3e1a4fba83fd1797dfaedb63dd9e5f62f6cc9c91: Status 404 returned error can't find the container with id 2b6ff9074aad69708232572a3e1a4fba83fd1797dfaedb63dd9e5f62f6cc9c91
Sep 17 17:56:42.320756 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.320735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:42.321256 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.320835    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:42.321256 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.320874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:42.321256 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.320995    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:42.327845 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.327822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw" event={"ID":"5ac29325-e1fc-4ff8-9420-580e4662f27f","Type":"ContainerStarted","Data":"b9987c1b03406ea777a2293492c70b35e814ba083e3cce449a10a3ebd7ac26d2"}
Sep 17 17:56:42.329066 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.329038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k9nfk" event={"ID":"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4","Type":"ContainerStarted","Data":"d5955b758603aa76c73e4b357517dceb73af01c72725bcd428e2bd83ac1a9d92"}
Sep 17 17:56:42.330315 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.330281    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"d0181a0757610abc542de70e17748e1b7fea1518ce8d7c59c8f42d14d8256d8a"}
Sep 17 17:56:42.331471 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.331449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerStarted","Data":"3566256d14ae91e960cd91112ee21c7e0943fb8dbc489dfa75979bd8c01c9c7b"}
Sep 17 17:56:42.332605 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.332581    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zxfhr" event={"ID":"e7006b69-52b5-423f-989e-69b139de701a","Type":"ContainerStarted","Data":"7c07b1de8ae6a914a653f6b25f7458e459b04a5cd44e65c94a9a25a216c98334"}
Sep 17 17:56:42.333712 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.333688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5pcfw" event={"ID":"6e35697e-1b29-401b-9729-5e222483ed9f","Type":"ContainerStarted","Data":"fded051e59198a84686800592c613762b5fb88994e5bd76db06330fbb956724b"}
Sep 17 17:56:42.334872 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.334851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m25vn" event={"ID":"a033a4bf-2f57-4cc8-8235-4aaa23f96261","Type":"ContainerStarted","Data":"ba577ea141da7b421c993b7d8e24f64f52dcf59e3f10a84c8db716a3b69aae32"}
Sep 17 17:56:42.336758 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.336733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal" event={"ID":"1687c29f4de0497448ee89348c1bced3","Type":"ContainerStarted","Data":"7a68f0f9b4494c08c574db5a4926e91eceae8df6256f6609803a3692adf77c40"}
Sep 17 17:56:42.337947 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.337926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlwg7" event={"ID":"d483dbc2-17ca-43c8-8738-22f5584b3f71","Type":"ContainerStarted","Data":"2b6ff9074aad69708232572a3e1a4fba83fd1797dfaedb63dd9e5f62f6cc9c91"}
Sep 17 17:56:42.338942 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.338919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tvbl4" event={"ID":"7ed9af67-a459-4e78-8e14-d5e6a492f7a7","Type":"ContainerStarted","Data":"12bcac8c4ea7d245daddf954dc4c3ef760fdbca225b4656afc69bdb83124ab6b"}
Sep 17 17:56:42.354179 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.354131    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 17:51:40 +0000 UTC" deadline="2028-02-29 01:19:11.476110211 +0000 UTC"
Sep 17 17:56:42.354179 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.354179    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12703h22m29.121934635s"
Sep 17 17:56:42.892824 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.892124    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:42.892824 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.892209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:42.892824 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.892318    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:42.892824 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.892375    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret podName:104f3713-9564-4733-90e1-cc0923af9610 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:44.892357931 +0000 UTC m=+7.645098250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret") pod "global-pull-secret-syncer-tmbzr" (UID: "104f3713-9564-4733-90e1-cc0923af9610") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:42.892824 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.892744    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:42.892824 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.892792    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:44.892778084 +0000 UTC m=+7.645518396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:42.993009 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:42.992962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:42.993183 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.993110    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:56:42.993183 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.993130    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:56:42.993183 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.993141    2577 projected.go:196] Error preparing data for projected volume kube-api-access-4lbls for pod openshift-network-diagnostics/network-check-target-tvgp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:42.993331 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:42.993192    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls podName:04b43c83-4a08-4d2d-8bba-1f16853d7410 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:44.993176347 +0000 UTC m=+7.745916658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lbls" (UniqueName: "kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls") pod "network-check-target-tvgp2" (UID: "04b43c83-4a08-4d2d-8bba-1f16853d7410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:43.322472 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:43.322261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:43.322472 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:43.322381    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:43.351109 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:43.351078    2577 generic.go:356] "Generic (PLEG): container finished" podID="1dc5bbcef9cb6c31dbd1c4277954fb6b" containerID="1437a3676dd6531ecda2d2fa197c027b48b404be78cd907d7461f06f00e60b67" exitCode=0
Sep 17 17:56:43.351948 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:43.351923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal" event={"ID":"1dc5bbcef9cb6c31dbd1c4277954fb6b","Type":"ContainerDied","Data":"1437a3676dd6531ecda2d2fa197c027b48b404be78cd907d7461f06f00e60b67"}
Sep 17 17:56:43.374528 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:43.374479    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-113.ec2.internal" podStartSLOduration=3.374463079 podStartE2EDuration="3.374463079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:56:42.359965393 +0000 UTC m=+5.112705721" watchObservedRunningTime="2026-09-17 17:56:43.374463079 +0000 UTC m=+6.127203410"
Sep 17 17:56:44.320385 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:44.320357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:44.320562 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:44.320478    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:44.320825 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:44.320773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:44.320952 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:44.320853    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:44.377650 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:44.377615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal" event={"ID":"1dc5bbcef9cb6c31dbd1c4277954fb6b","Type":"ContainerStarted","Data":"bce0ffbc1d8c11f6223b5cd6b33adcbb08c51373aa190de6d2f100ad8d70a3dc"}
Sep 17 17:56:44.908308 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:44.908217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:44.908308 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:44.908294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:44.908529 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:44.908445    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:44.908529 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:44.908501    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret podName:104f3713-9564-4733-90e1-cc0923af9610 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:48.908484623 +0000 UTC m=+11.661224935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret") pod "global-pull-secret-syncer-tmbzr" (UID: "104f3713-9564-4733-90e1-cc0923af9610") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:44.908930 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:44.908881    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:44.909014 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:44.908952    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:48.908937321 +0000 UTC m=+11.661677632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:45.008790 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:45.008753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:45.009073 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:45.009053    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:56:45.009169 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:45.009087    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:56:45.009169 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:45.009101    2577 projected.go:196] Error preparing data for projected volume kube-api-access-4lbls for pod openshift-network-diagnostics/network-check-target-tvgp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:45.009273 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:45.009173    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls podName:04b43c83-4a08-4d2d-8bba-1f16853d7410 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:49.009152744 +0000 UTC m=+11.761893394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lbls" (UniqueName: "kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls") pod "network-check-target-tvgp2" (UID: "04b43c83-4a08-4d2d-8bba-1f16853d7410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:45.322018 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:45.321987    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:45.322167 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:45.322115    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:46.319804 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:46.319771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:46.320254 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:46.319926    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:46.320254 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:46.319990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:46.320254 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:46.320091    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:47.322087 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:47.322043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:47.322561 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:47.322162    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:48.320254 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:48.320225    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:48.320254 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:48.320251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:48.320465 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:48.320357    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:48.320833 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:48.320780    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:48.939343 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:48.939306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:48.939780 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:48.939380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:48.939780 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:48.939491    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:48.939780 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:48.939546    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:56.939528628 +0000 UTC m=+19.692268937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:48.939780 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:48.939620    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:48.939780 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:48.939654    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret podName:104f3713-9564-4733-90e1-cc0923af9610 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:56.939643004 +0000 UTC m=+19.692383314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret") pod "global-pull-secret-syncer-tmbzr" (UID: "104f3713-9564-4733-90e1-cc0923af9610") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:49.040558 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:49.040514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:49.040722 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:49.040665    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:56:49.040722 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:49.040687    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:56:49.040722 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:49.040701    2577 projected.go:196] Error preparing data for projected volume kube-api-access-4lbls for pod openshift-network-diagnostics/network-check-target-tvgp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:49.040877 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:49.040754    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls podName:04b43c83-4a08-4d2d-8bba-1f16853d7410 nodeName:}" failed. No retries permitted until 2026-09-17 17:56:57.040737911 +0000 UTC m=+19.793478235 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lbls" (UniqueName: "kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls") pod "network-check-target-tvgp2" (UID: "04b43c83-4a08-4d2d-8bba-1f16853d7410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:49.321175 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:49.321116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:49.322264 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:49.322227    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:50.320706 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:50.320669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:50.321158 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:50.320711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:50.321158 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:50.320819    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:50.321158 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:50.320963    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:51.320201 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:51.320174    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:51.320462 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:51.320296    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:52.320764 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:52.320734    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:52.321228 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:52.320862    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:52.321228 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:52.320919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:52.321228 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:52.321006    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:53.320952 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:53.320898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:53.321307 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:53.321035    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:54.320323 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:54.320285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:54.320323 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:54.320317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:54.320489 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:54.320404    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:54.320541 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:54.320518    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:55.320365 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:55.320334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:55.320766 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:55.320458    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:56.320049 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:56.320020    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:56.320299 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:56.320057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:56.320299 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:56.320150    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:56.320299 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:56.320274    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:56.999127 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:56.999090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:56.999297 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:56.999177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:56.999297 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:56.999248    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:56.999297 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:56.999279    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:56.999439 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:56.999318    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret podName:104f3713-9564-4733-90e1-cc0923af9610 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:12.999297673 +0000 UTC m=+35.752037995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret") pod "global-pull-secret-syncer-tmbzr" (UID: "104f3713-9564-4733-90e1-cc0923af9610") : object "kube-system"/"original-pull-secret" not registered
Sep 17 17:56:56.999439 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:56.999337    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:12.999327985 +0000 UTC m=+35.752068292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 17:56:57.099463 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:57.099435    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:57.099626 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:57.099611    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 17:56:57.099693 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:57.099633    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 17:56:57.099693 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:57.099644    2577 projected.go:196] Error preparing data for projected volume kube-api-access-4lbls for pod openshift-network-diagnostics/network-check-target-tvgp2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:57.099776 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:57.099717    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls podName:04b43c83-4a08-4d2d-8bba-1f16853d7410 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:13.099683246 +0000 UTC m=+35.852423556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4lbls" (UniqueName: "kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls") pod "network-check-target-tvgp2" (UID: "04b43c83-4a08-4d2d-8bba-1f16853d7410") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 17:56:57.321032 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:57.321002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:57.321469 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:57.321121    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:56:58.319919 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:58.319876    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:56:58.320075 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:58.320014    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:56:58.320135 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:58.320073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:56:58.320180 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:58.320164    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:56:59.320608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:56:59.320585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:56:59.320885 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:56:59.320677    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:00.320919 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.320583    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:00.321605 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.320648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:00.321605 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:00.321031    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:00.321605 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:00.321101    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:00.409662 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.409576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tvbl4" event={"ID":"7ed9af67-a459-4e78-8e14-d5e6a492f7a7","Type":"ContainerStarted","Data":"5a1a64aeea40cdfdd0d85774cc145f85aab9c06b8ed4ad96890d8fd5707fb1f9"}
Sep 17 17:57:00.410993 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.410970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw" event={"ID":"5ac29325-e1fc-4ff8-9420-580e4662f27f","Type":"ContainerStarted","Data":"cd7b05874495326664d38b6838d34523c631e657459f18fb6af364ace5d07a71"}
Sep 17 17:57:00.412343 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.412323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k9nfk" event={"ID":"e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4","Type":"ContainerStarted","Data":"d9b1c4adaf2b28e89015dec4708570d424f01fcb74832be5c06bf86775a6686b"}
Sep 17 17:57:00.414972 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.414955    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 17:57:00.415258 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415239    2577 generic.go:356] "Generic (PLEG): container finished" podID="c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9" containerID="d4de824f79d7d46c98da02ce3fd6c998da9356dcefe3a13845712fddfe86e175" exitCode=1
Sep 17 17:57:00.415333 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"475c1e9880f94cfc64000e4c645bde4fe68d886427a40d51e8467d855a992872"}
Sep 17 17:57:00.415382 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"f7c061a40c37ab5c70ae783124d18373b055662fadea4504d339be2c12337f22"}
Sep 17 17:57:00.415382 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"d08ab833ec34204d78393580dd547e0cc538b766ab225b51f6bdf4d69df55c8a"}
Sep 17 17:57:00.415451 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"07a4b97238c06a64313244f92eaa7399d997c19f661b3e210c460587390e9915"}
Sep 17 17:57:00.415451 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerDied","Data":"d4de824f79d7d46c98da02ce3fd6c998da9356dcefe3a13845712fddfe86e175"}
Sep 17 17:57:00.415527 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.415476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"c20d717d5fda9ba8ab4280c1a529770cdcfdd8c4be4c4a627d753752c9cada74"}
Sep 17 17:57:00.416665 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.416647    2577 generic.go:356] "Generic (PLEG): container finished" podID="06618c28-7ec8-4f43-aae8-5eaff3e4d55b" containerID="c1fe9753c7edcd1f60b3a6da8438f9e6b4f28df09f35b213979a252b226ec1af" exitCode=0
Sep 17 17:57:00.416729 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.416701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerDied","Data":"c1fe9753c7edcd1f60b3a6da8438f9e6b4f28df09f35b213979a252b226ec1af"}
Sep 17 17:57:00.418218 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.418197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zxfhr" event={"ID":"e7006b69-52b5-423f-989e-69b139de701a","Type":"ContainerStarted","Data":"e2aea86b0e4cc938a83c00452656dd2a70310bbdb75c6e4246959846755da61a"}
Sep 17 17:57:00.419594 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.419571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5pcfw" event={"ID":"6e35697e-1b29-401b-9729-5e222483ed9f","Type":"ContainerStarted","Data":"56dbe0720c65fc57861818026112454c7f34c715b2d2ffef415cc3c5597dc19b"}
Sep 17 17:57:00.420848 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.420828    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m25vn" event={"ID":"a033a4bf-2f57-4cc8-8235-4aaa23f96261","Type":"ContainerStarted","Data":"23cf77af660b2cf08930c15f6f08cc7c289a6b1b08f26c2c0fa77c1507e5eb42"}
Sep 17 17:57:00.438577 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.438545    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-113.ec2.internal" podStartSLOduration=20.438520287 podStartE2EDuration="20.438520287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:56:44.395471496 +0000 UTC m=+7.148211824" watchObservedRunningTime="2026-09-17 17:57:00.438520287 +0000 UTC m=+23.191260612"
Sep 17 17:57:00.439146 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.439123    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tvbl4" podStartSLOduration=4.298522741 podStartE2EDuration="21.439113986s" totalImagesPullingTime="17.140591245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:00.438298593 +0000 UTC m=+23.191038943" watchObservedRunningTime="2026-09-17 17:57:00.439113986 +0000 UTC m=+23.191854313"
Sep 17 17:57:00.523286 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.523253    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5pcfw" podStartSLOduration=4.377924876 podStartE2EDuration="21.523241667s" totalImagesPullingTime="17.145316791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:00.479511332 +0000 UTC m=+23.232251660" watchObservedRunningTime="2026-09-17 17:57:00.523241667 +0000 UTC m=+23.275981995"
Sep 17 17:57:00.523890 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.523444    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zxfhr" podStartSLOduration=4.295266121 podStartE2EDuration="21.523435742s" totalImagesPullingTime="17.228169621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:00.523199741 +0000 UTC m=+23.275940094" watchObservedRunningTime="2026-09-17 17:57:00.523435742 +0000 UTC m=+23.276176071"
Sep 17 17:57:00.580293 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.580256    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k9nfk" podStartSLOduration=4.365594585 podStartE2EDuration="21.580241545s" totalImagesPullingTime="17.21464696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:00.548527018 +0000 UTC m=+23.301267415" watchObservedRunningTime="2026-09-17 17:57:00.580241545 +0000 UTC m=+23.332981874"
Sep 17 17:57:00.580547 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.580529    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m25vn" podStartSLOduration=4.413056488 podStartE2EDuration="21.580524454s" totalImagesPullingTime="17.167467966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:00.580327747 +0000 UTC m=+23.333068074" watchObservedRunningTime="2026-09-17 17:57:00.580524454 +0000 UTC m=+23.333264831"
Sep 17 17:57:00.704580 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.704561    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 17:57:00.797226 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:00.797189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:01.320427 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:01.320397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:01.320607 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:01.320513    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:01.322685 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:01.322549    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T17:57:00.7045763Z","UUID":"68ee6ec9-3886-4ddd-8b3c-85aaf767d479","Handler":null,"Name":"","Endpoint":""}
Sep 17 17:57:01.324087 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:01.324069    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 17:57:01.324174 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:01.324097    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 17:57:01.425544 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:01.425510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw" event={"ID":"5ac29325-e1fc-4ff8-9420-580e4662f27f","Type":"ContainerStarted","Data":"fcea4f2022ff413c9ef07baabeb8db08cfd7e4df9ec37a969f6eb636a80331dc"}
Sep 17 17:57:01.427522 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:01.427489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qlwg7" event={"ID":"d483dbc2-17ca-43c8-8738-22f5584b3f71","Type":"ContainerStarted","Data":"2ae0cd6c781df5051d018ed03ada6aa4e322c60ce0d032a514d3bbfb1a65b3bf"}
Sep 17 17:57:02.189739 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.189698    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:02.286131 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.286104    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:02.320043 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.320017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:02.320176 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:02.320125    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:02.320176 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.320165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:02.320311 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:02.320291    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:02.432335 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.431804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw" event={"ID":"5ac29325-e1fc-4ff8-9420-580e4662f27f","Type":"ContainerStarted","Data":"4d7c844cbf32299e498603eccb362c5f84330fc802bb94b69db22d39ea1446c4"}
Sep 17 17:57:02.435481 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.435462    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 17:57:02.436168 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.436145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"714eaf2d2ea8e7394a8654ad9d7f43c5f4595a18d459ad1d251ec5bc2c44e5aa"}
Sep 17 17:57:02.460144 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:02.460098    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qlwg7" podStartSLOduration=6.27284326 podStartE2EDuration="23.460086402s" totalImagesPullingTime="17.187243142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:01.457843108 +0000 UTC m=+24.210583435" watchObservedRunningTime="2026-09-17 17:57:02.460086402 +0000 UTC m=+25.212826730"
Sep 17 17:57:03.323713 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:03.323683    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:03.323872 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:03.323787    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:04.320036 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:04.320011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:04.320377 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:04.320052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:04.320377 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:04.320115    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:04.320377 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:04.320261    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:04.487024 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:04.486999    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:57:04.487889 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:04.487734    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:57:04.558844 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:04.558796    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cjzdw" podStartSLOduration=6.389890635 podStartE2EDuration="25.558778139s" totalImagesPullingTime="19.168887504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:02.459866554 +0000 UTC m=+25.212606884" watchObservedRunningTime="2026-09-17 17:57:04.558778139 +0000 UTC m=+27.311518467"
Sep 17 17:57:05.323305 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.323282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:05.323829 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:05.323366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:05.444040 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.444017    2577 generic.go:356] "Generic (PLEG): container finished" podID="06618c28-7ec8-4f43-aae8-5eaff3e4d55b" containerID="283c215daf8226a35fc181c7ef6f1d81529c1c9940b1c225274f5dea6dac2c4d" exitCode=0
Sep 17 17:57:05.444162 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.444097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerDied","Data":"283c215daf8226a35fc181c7ef6f1d81529c1c9940b1c225274f5dea6dac2c4d"}
Sep 17 17:57:05.447490 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.447473    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 17:57:05.447855 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.447827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"7af22385660a49f3d2305c4a58192e213d723f5226ca5c2fb3463b07cdb6cdc5"}
Sep 17 17:57:05.448069 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.448036    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:57:05.448137 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.448082    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:57:05.448137 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.448133    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:57:05.448294 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.448235    2577 scope.go:117] "RemoveContainer" containerID="d4de824f79d7d46c98da02ce3fd6c998da9356dcefe3a13845712fddfe86e175"
Sep 17 17:57:05.448448 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.448433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5pcfw"
Sep 17 17:57:05.465047 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.465028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:57:05.595222 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:05.595176    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:06.320570 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.320428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:06.320684 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.320483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:06.320737 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:06.320682    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:06.320737 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:06.320709    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:06.452110 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.451746    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6mtq"]
Sep 17 17:57:06.452511 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.452494    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmbzr"]
Sep 17 17:57:06.452892 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.452581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:06.452892 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:06.452656    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:06.454460 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.454443    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvgp2"]
Sep 17 17:57:06.454816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.454802    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 17:57:06.455306 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.455280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" event={"ID":"c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9","Type":"ContainerStarted","Data":"a62d3e96e218a4ed6c961e6a742232669b90fd74aa27cb575dcd4e7fc38aeec1"}
Sep 17 17:57:06.455573 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.455555    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:57:06.458403 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.458381    2577 generic.go:356] "Generic (PLEG): container finished" podID="06618c28-7ec8-4f43-aae8-5eaff3e4d55b" containerID="c61a4506e416cdded7653b479782b2252c694b41d07a4c20da6429b99ea45819" exitCode=0
Sep 17 17:57:06.458499 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.458462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerDied","Data":"c61a4506e416cdded7653b479782b2252c694b41d07a4c20da6429b99ea45819"}
Sep 17 17:57:06.458597 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.458569    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:06.458696 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:06.458677    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:06.458753 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.458728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:06.458804 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:06.458789    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:06.472173 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.472155    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:57:06.487018 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:06.486984    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br" podStartSLOduration=10.268605407999999 podStartE2EDuration="27.486971825s" totalImagesPullingTime="17.218366417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:06.484960179 +0000 UTC m=+29.237700506" watchObservedRunningTime="2026-09-17 17:57:06.486971825 +0000 UTC m=+29.239712197"
Sep 17 17:57:07.462845 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:07.462793    2577 generic.go:356] "Generic (PLEG): container finished" podID="06618c28-7ec8-4f43-aae8-5eaff3e4d55b" containerID="634d14f25994e755cba019181133707261491d92d362ea3e16708bb8c9006519" exitCode=0
Sep 17 17:57:07.463147 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:07.462877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerDied","Data":"634d14f25994e755cba019181133707261491d92d362ea3e16708bb8c9006519"}
Sep 17 17:57:08.320114 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:08.320080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:08.320285 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:08.320123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:08.320285 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:08.320192    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:08.320285 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:08.320205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:08.320398 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:08.320277    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:08.320398 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:08.320333    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:10.321114 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:10.320622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:10.321114 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:10.320622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:10.321114 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:10.320755    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q6mtq" podUID="de9a5ba3-4824-48c9-9498-d6c8963cada3"
Sep 17 17:57:10.321114 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:10.320783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:10.321114 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:10.320873    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tmbzr" podUID="104f3713-9564-4733-90e1-cc0923af9610"
Sep 17 17:57:10.321114 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:10.320967    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tvgp2" podUID="04b43c83-4a08-4d2d-8bba-1f16853d7410"
Sep 17 17:57:11.498858 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:11.498695    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:11.578369 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:11.578341    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:12.164960 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.164939    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-113.ec2.internal" event="NodeReady"
Sep 17 17:57:12.165129 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.165033    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 17:57:12.272326 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.272304    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lqd7j"]
Sep 17 17:57:12.275186 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.275172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.280230 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.280211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 17:57:12.280348 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.280211    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 17:57:12.280467 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.280456    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqrn8\""
Sep 17 17:57:12.284747 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.284730    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6fklv"]
Sep 17 17:57:12.287323 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.287308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.293285 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.293027    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 17:57:12.293457 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.293434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 17:57:12.293565 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.293545    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nvjd9\""
Sep 17 17:57:12.293648 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.293613    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 17:57:12.300552 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.300505    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqd7j"]
Sep 17 17:57:12.307690 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.307670    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fklv"]
Sep 17 17:57:12.320398 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.320383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:12.320522 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.320506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:12.320675 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.320662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:12.323604 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.323586    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 17:57:12.323810 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.323786    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 17:57:12.323810 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.323796    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 17:57:12.323983 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.323793    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm6gd\""
Sep 17 17:57:12.323983 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.323971    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 17:57:12.324605 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.324591    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7pjs\""
Sep 17 17:57:12.416020 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.415997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3c40b9d-ccff-42de-9041-00d5cde9bf61-cert\") pod \"ingress-canary-6fklv\" (UID: \"d3c40b9d-ccff-42de-9041-00d5cde9bf61\") " pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.416110 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.416023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5fd24e-55a0-445a-9c31-0502336fa9fd-tmp-dir\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.416110 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.416058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.416110 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.416076    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pnv\" (UniqueName: \"kubernetes.io/projected/7c5fd24e-55a0-445a-9c31-0502336fa9fd-kube-api-access-v4pnv\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.416110 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.416094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5fd24e-55a0-445a-9c31-0502336fa9fd-config-volume\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.416252 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.416117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bzgr\" (UniqueName: \"kubernetes.io/projected/d3c40b9d-ccff-42de-9041-00d5cde9bf61-kube-api-access-5bzgr\") pod \"ingress-canary-6fklv\" (UID: \"d3c40b9d-ccff-42de-9041-00d5cde9bf61\") " pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.449190 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.449163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:12.476995 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.476975    2577 generic.go:356] "Generic (PLEG): container finished" podID="06618c28-7ec8-4f43-aae8-5eaff3e4d55b" containerID="146d09f3d8ea3265d4a4a85615621ce4445fccd0033d20331ac65d7a71eba682" exitCode=0
Sep 17 17:57:12.477075 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.477025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerDied","Data":"146d09f3d8ea3265d4a4a85615621ce4445fccd0033d20331ac65d7a71eba682"}
Sep 17 17:57:12.516484 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.516789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pnv\" (UniqueName: \"kubernetes.io/projected/7c5fd24e-55a0-445a-9c31-0502336fa9fd-kube-api-access-v4pnv\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.516789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5fd24e-55a0-445a-9c31-0502336fa9fd-config-volume\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.516789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bzgr\" (UniqueName: \"kubernetes.io/projected/d3c40b9d-ccff-42de-9041-00d5cde9bf61-kube-api-access-5bzgr\") pod \"ingress-canary-6fklv\" (UID: \"d3c40b9d-ccff-42de-9041-00d5cde9bf61\") " pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.516789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3c40b9d-ccff-42de-9041-00d5cde9bf61-cert\") pod \"ingress-canary-6fklv\" (UID: \"d3c40b9d-ccff-42de-9041-00d5cde9bf61\") " pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.516789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5fd24e-55a0-445a-9c31-0502336fa9fd-tmp-dir\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.516983 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.516929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c5fd24e-55a0-445a-9c31-0502336fa9fd-tmp-dir\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.517030 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:12.517012    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:12.517128 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:12.517071    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:57:13.017054188 +0000 UTC m=+35.769794496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:12.517537 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.517518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c5fd24e-55a0-445a-9c31-0502336fa9fd-config-volume\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.521502 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.521485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3c40b9d-ccff-42de-9041-00d5cde9bf61-cert\") pod \"ingress-canary-6fklv\" (UID: \"d3c40b9d-ccff-42de-9041-00d5cde9bf61\") " pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.531491 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.531467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pnv\" (UniqueName: \"kubernetes.io/projected/7c5fd24e-55a0-445a-9c31-0502336fa9fd-kube-api-access-v4pnv\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:12.533667 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.533652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bzgr\" (UniqueName: \"kubernetes.io/projected/d3c40b9d-ccff-42de-9041-00d5cde9bf61-kube-api-access-5bzgr\") pod \"ingress-canary-6fklv\" (UID: \"d3c40b9d-ccff-42de-9041-00d5cde9bf61\") " pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.562412 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.562394    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:12.598773 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.597656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fklv"
Sep 17 17:57:12.906228 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:12.906174    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fklv"]
Sep 17 17:57:12.911375 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:12.911350    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c40b9d_ccff_42de_9041_00d5cde9bf61.slice/crio-5f9e24327a273160fca7a22f2d85d1904ee73ed434f8b8bc54444dea77f46ade WatchSource:0}: Error finding container 5f9e24327a273160fca7a22f2d85d1904ee73ed434f8b8bc54444dea77f46ade: Status 404 returned error can't find the container with id 5f9e24327a273160fca7a22f2d85d1904ee73ed434f8b8bc54444dea77f46ade
Sep 17 17:57:13.019652 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.019627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:13.019741 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.019662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:13.019741 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.019690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:13.019806 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:13.019762    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:57:13.019806 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:13.019763    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:13.019862 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:13.019812    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:45.019795343 +0000 UTC m=+67.772535659 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : secret "metrics-daemon-secret" not found
Sep 17 17:57:13.019862 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:13.019825    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:57:14.019819139 +0000 UTC m=+36.772559447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:13.021947 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.021931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/104f3713-9564-4733-90e1-cc0923af9610-original-pull-secret\") pod \"global-pull-secret-syncer-tmbzr\" (UID: \"104f3713-9564-4733-90e1-cc0923af9610\") " pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:13.120599 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.120581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:13.122676 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.122654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lbls\" (UniqueName: \"kubernetes.io/projected/04b43c83-4a08-4d2d-8bba-1f16853d7410-kube-api-access-4lbls\") pod \"network-check-target-tvgp2\" (UID: \"04b43c83-4a08-4d2d-8bba-1f16853d7410\") " pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:13.235253 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.235204    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tmbzr"
Sep 17 17:57:13.239851 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.239830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:13.483614 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.483405    2577 generic.go:356] "Generic (PLEG): container finished" podID="06618c28-7ec8-4f43-aae8-5eaff3e4d55b" containerID="de223c93bcbd57086bcf39ae483b869550632e53502105c9b738bdf808a14576" exitCode=0
Sep 17 17:57:13.483788 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.483447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerDied","Data":"de223c93bcbd57086bcf39ae483b869550632e53502105c9b738bdf808a14576"}
Sep 17 17:57:13.484986 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.484961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fklv" event={"ID":"d3c40b9d-ccff-42de-9041-00d5cde9bf61","Type":"ContainerStarted","Data":"5f9e24327a273160fca7a22f2d85d1904ee73ed434f8b8bc54444dea77f46ade"}
Sep 17 17:57:13.525703 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.525679    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tvgp2"]
Sep 17 17:57:13.529225 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:13.529196    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b43c83_4a08_4d2d_8bba_1f16853d7410.slice/crio-351067376ab4330fcfedc2967f7292c7e2e5e19ba83478b39f3e9f2d0ce42c93 WatchSource:0}: Error finding container 351067376ab4330fcfedc2967f7292c7e2e5e19ba83478b39f3e9f2d0ce42c93: Status 404 returned error can't find the container with id 351067376ab4330fcfedc2967f7292c7e2e5e19ba83478b39f3e9f2d0ce42c93
Sep 17 17:57:13.534211 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:13.534165    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tmbzr"]
Sep 17 17:57:14.025683 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.025646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:14.025837 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:14.025779    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:14.025889 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:14.025842    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:57:16.025820489 +0000 UTC m=+38.778560801 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:14.490011 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.489878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmbzr" event={"ID":"104f3713-9564-4733-90e1-cc0923af9610","Type":"ContainerStarted","Data":"b91db281253944a04660c3eba7e1ed57e625cd06931fca1a2d0a319c273c68ac"}
Sep 17 17:57:14.494526 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.494496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24ngd" event={"ID":"06618c28-7ec8-4f43-aae8-5eaff3e4d55b","Type":"ContainerStarted","Data":"f1b9ec10a850791327e984d259a0ea77e18d83806f30113d944e5714a0f497e2"}
Sep 17 17:57:14.496302 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.496251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvgp2" event={"ID":"04b43c83-4a08-4d2d-8bba-1f16853d7410","Type":"ContainerStarted","Data":"351067376ab4330fcfedc2967f7292c7e2e5e19ba83478b39f3e9f2d0ce42c93"}
Sep 17 17:57:14.722017 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.721981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:14.842787 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.842754    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:14.975201 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:14.975168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:15.379443 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:15.379406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:15.485174 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:15.485144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:15.588075 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:15.588042    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:16.042676 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:16.042449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:16.043090 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:16.042586    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:16.043090 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:16.042798    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:57:20.042784066 +0000 UTC m=+42.795524372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:16.383505 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:16.383470    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:16.500133 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:16.499920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:16.503045 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:16.503018    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fklv" event={"ID":"d3c40b9d-ccff-42de-9041-00d5cde9bf61","Type":"ContainerStarted","Data":"2ae3ccc26f9d8efbfdb25bd00ea990ec3c7e38b216ec7c10a1e109742278c55d"}
Sep 17 17:57:16.525743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:16.525704    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-24ngd" podStartSLOduration=10.538814742 podStartE2EDuration="37.52567686s" totalImagesPullingTime="26.986862118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:14.527965059 +0000 UTC m=+37.280705386" watchObservedRunningTime="2026-09-17 17:57:16.52567686 +0000 UTC m=+39.278417187"
Sep 17 17:57:17.702319 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:17.702271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:17.802013 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:17.801981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:19.512464 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:19.512432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tmbzr" event={"ID":"104f3713-9564-4733-90e1-cc0923af9610","Type":"ContainerStarted","Data":"085ce8510151162efbe56e2197851ea0147fc52a41c1f7d1f69ba804f04b7048"}
Sep 17 17:57:19.513861 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:19.513841    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tvgp2" event={"ID":"04b43c83-4a08-4d2d-8bba-1f16853d7410","Type":"ContainerStarted","Data":"a68f77c9e004e8499b109adcd8f1e14b24cdf0f11c0be970ce0ec11e7594bf14"}
Sep 17 17:57:19.513997 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:19.513955    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:19.532716 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:19.532677    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6fklv" podStartSLOduration=4.822530386 podStartE2EDuration="7.532664015s" totalImagesPullingTime="2.710133629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:16.52639186 +0000 UTC m=+39.279132194" watchObservedRunningTime="2026-09-17 17:57:19.532664015 +0000 UTC m=+42.285404336"
Sep 17 17:57:19.532800 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:19.532745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tmbzr" podStartSLOduration=35.445407129 podStartE2EDuration="40.532740151s" totalImagesPullingTime="5.087333022s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:19.532297747 +0000 UTC m=+42.285038074" watchObservedRunningTime="2026-09-17 17:57:19.532740151 +0000 UTC m=+42.285480487"
Sep 17 17:57:19.552535 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:19.552500    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tvgp2" podStartSLOduration=35.467224038 podStartE2EDuration="40.55248349s" totalImagesPullingTime="5.085259452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:19.551218072 +0000 UTC m=+42.303958400" watchObservedRunningTime="2026-09-17 17:57:19.55248349 +0000 UTC m=+42.305223822"
Sep 17 17:57:20.050695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:20.050676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:20.067674 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:20.067647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:20.067770 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:20.067755    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:20.067832 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:20.067815    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:57:28.067799854 +0000 UTC m=+50.820540178 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:21.989099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:21.989077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:22.092870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:22.092841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:27.676064 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:27.676034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:27.772645 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:27.772620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:28.116872 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:28.116848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:28.116977 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:28.116856    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:28.116977 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:28.116944    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:57:44.116926113 +0000 UTC m=+66.869666423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:31.467844 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:31.467815    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:31.564588 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:31.564567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:32.498991 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:32.498952    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:32.597635 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:32.597616    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:33.084396 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.084373    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"]
Sep 17 17:57:33.106412 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.106390    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"]
Sep 17 17:57:33.106520 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.106504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.118079 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.118062    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 17:57:33.118172 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.118060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 17:57:33.118707 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.118694    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-d4kxj\""
Sep 17 17:57:33.121627 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.121611    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 17:57:33.122790 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.122772    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:57:33.127458 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.127440    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-4l8gr"]
Sep 17 17:57:33.127556 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.127543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.133669 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.133646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 17:57:33.135154 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.135139    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 17:57:33.135205 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.135156    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 17:57:33.135205 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.135156    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-stgx7\""
Sep 17 17:57:33.135205 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.135181    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 17:57:33.147050 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.147030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"]
Sep 17 17:57:33.147148 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.147065    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"]
Sep 17 17:57:33.147148 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.147085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-4l8gr"]
Sep 17 17:57:33.147148 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.147127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.151934 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.151898    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ck8br\""
Sep 17 17:57:33.152029 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.151898    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 17:57:33.152264 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.152161    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 17:57:33.152264 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.152260    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 17:57:33.152508 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.152480    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 17:57:33.158743 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.158726    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 17:57:33.181668 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.181647    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-gbq8n"]
Sep 17 17:57:33.205094 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.205075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-gbq8n"]
Sep 17 17:57:33.205230 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.205142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.208009 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.207968    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 17:57:33.208009 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.207971    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 17:57:33.208167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.208101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 17:57:33.208267 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.208241    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-656dx\""
Sep 17 17:57:33.209135 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.209118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 17:57:33.212950 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.212934    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 17:57:33.238152 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.238129    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:33.246616 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-snapshots\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.246710 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.246710 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-config\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.246710 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-tmp\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.246710 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.246878 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246713    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-serving-cert\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.246878 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-serving-cert\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.246878 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nhd\" (UniqueName: \"kubernetes.io/projected/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-kube-api-access-k9nhd\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.246878 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtnqb\" (UniqueName: \"kubernetes.io/projected/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-kube-api-access-vtnqb\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.246878 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d39c881-ca4e-4128-98d4-702c46369144-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.247102 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8kxt\" (UniqueName: \"kubernetes.io/projected/0d39c881-ca4e-4128-98d4-702c46369144-kube-api-access-p8kxt\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.247102 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.246958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.281449 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.281426    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"]
Sep 17 17:57:33.304186 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.304168    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-854597f79f-mt6wd"]
Sep 17 17:57:33.304265 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.304244    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"
Sep 17 17:57:33.308508 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.308490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fzhsx\""
Sep 17 17:57:33.324383 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.324364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.327386 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.327370    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 17:57:33.327536 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.327514    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 17:57:33.327780 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.327765    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tjn7j\""
Sep 17 17:57:33.327871 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.327803    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 17:57:33.327944 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.327882    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"]
Sep 17 17:57:33.327944 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.327939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854597f79f-mt6wd"]
Sep 17 17:57:33.333307 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.333290    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 17:57:33.341886 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.341843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:33.347990 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.347975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zkdz\" (UniqueName: \"kubernetes.io/projected/54092044-dada-45e5-bd9c-87a374b0ec2c-kube-api-access-6zkdz\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.348056 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8kxt\" (UniqueName: \"kubernetes.io/projected/0d39c881-ca4e-4128-98d4-702c46369144-kube-api-access-p8kxt\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.348056 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348056 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54092044-dada-45e5-bd9c-87a374b0ec2c-trusted-ca\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.348157 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-snapshots\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348157 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348231 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-config\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.348231 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-tmp\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348231 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.348365 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348240    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54092044-dada-45e5-bd9c-87a374b0ec2c-serving-cert\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.348365 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-serving-cert\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348365 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-serving-cert\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.348504 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nhd\" (UniqueName: \"kubernetes.io/projected/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-kube-api-access-k9nhd\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.348504 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtnqb\" (UniqueName: \"kubernetes.io/projected/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-kube-api-access-vtnqb\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348504 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d39c881-ca4e-4128-98d4-702c46369144-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.348504 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/54092044-dada-45e5-bd9c-87a374b0ec2c-config\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.348691 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.348567    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:33.348691 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.348620    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls podName:0d39c881-ca4e-4128-98d4-702c46369144 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:33.848606966 +0000 UTC m=+56.601347273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-cbmzz" (UID: "0d39c881-ca4e-4128-98d4-702c46369144") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:33.348691 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-tmp\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348691 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348680    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348923 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-snapshots\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.348923 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348754    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-config\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.349026 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.348990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.349393 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.349374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0d39c881-ca4e-4128-98d4-702c46369144-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.352109 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.352080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-serving-cert\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.352185 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.352090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-serving-cert\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.364759 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.364731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nhd\" (UniqueName: \"kubernetes.io/projected/4118c6b4-71d1-4d1b-834c-a5c8601a1a82-kube-api-access-k9nhd\") pod \"service-ca-operator-57cdc4b768-p8b85\" (UID: \"4118c6b4-71d1-4d1b-834c-a5c8601a1a82\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.365264 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.365245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtnqb\" (UniqueName: \"kubernetes.io/projected/98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4-kube-api-access-vtnqb\") pod \"insights-operator-6f9c644dd9-4l8gr\" (UID: \"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4\") " pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.365829 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.365806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8kxt\" (UniqueName: \"kubernetes.io/projected/0d39c881-ca4e-4128-98d4-702c46369144-kube-api-access-p8kxt\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.414573 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.414553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"
Sep 17 17:57:33.449081 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-image-registry-private-configuration\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449127 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-certificates\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449127 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449110    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449207 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zkdz\" (UniqueName: \"kubernetes.io/projected/54092044-dada-45e5-bd9c-87a374b0ec2c-kube-api-access-6zkdz\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.449207 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-trusted-ca\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449265 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd8f8\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-kube-api-access-fd8f8\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449305 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-bound-sa-token\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449359 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449300    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-ca-trust-extracted\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449359 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54092044-dada-45e5-bd9c-87a374b0ec2c-serving-cert\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.449454 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlg4x\" (UniqueName: \"kubernetes.io/projected/3ea28118-979d-4284-a921-8baa8e2310c9-kube-api-access-dlg4x\") pod \"network-check-source-7cbc45fddc-6bppp\" (UID: \"3ea28118-979d-4284-a921-8baa8e2310c9\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"
Sep 17 17:57:33.449454 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-installation-pull-secrets\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.449454 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/54092044-dada-45e5-bd9c-87a374b0ec2c-config\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.449596 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.449517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54092044-dada-45e5-bd9c-87a374b0ec2c-trusted-ca\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.450122 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.450097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/54092044-dada-45e5-bd9c-87a374b0ec2c-config\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.450210 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.450196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54092044-dada-45e5-bd9c-87a374b0ec2c-trusted-ca\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.451650 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.451631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/54092044-dada-45e5-bd9c-87a374b0ec2c-serving-cert\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.454645 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.454626    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr"
Sep 17 17:57:33.458493 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.458473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zkdz\" (UniqueName: \"kubernetes.io/projected/54092044-dada-45e5-bd9c-87a374b0ec2c-kube-api-access-6zkdz\") pod \"console-operator-fd4bb46c-gbq8n\" (UID: \"54092044-dada-45e5-bd9c-87a374b0ec2c\") " pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.514279 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.514252    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:33.527163 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.527137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:33.550455 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlg4x\" (UniqueName: \"kubernetes.io/projected/3ea28118-979d-4284-a921-8baa8e2310c9-kube-api-access-dlg4x\") pod \"network-check-source-7cbc45fddc-6bppp\" (UID: \"3ea28118-979d-4284-a921-8baa8e2310c9\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"
Sep 17 17:57:33.550560 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-installation-pull-secrets\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550613 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-image-registry-private-configuration\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550613 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550585    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-certificates\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550613 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550757 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-trusted-ca\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550757 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd8f8\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-kube-api-access-fd8f8\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550757 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-bound-sa-token\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550757 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.550720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-ca-trust-extracted\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.550983 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.550765    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:57:33.550983 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.550787    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854597f79f-mt6wd: secret "image-registry-tls" not found
Sep 17 17:57:33.550983 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.550862    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls podName:834bb5e9-1fd0-43bb-be1a-acea5e64f6df nodeName:}" failed. No retries permitted until 2026-09-17 17:57:34.050839388 +0000 UTC m=+56.803579717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls") pod "image-registry-854597f79f-mt6wd" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df") : secret "image-registry-tls" not found
Sep 17 17:57:33.551256 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.551229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-ca-trust-extracted\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.551521 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.551354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-certificates\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.551853 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.551826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-trusted-ca\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.553052 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.553019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-image-registry-private-configuration\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.553564 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.553542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-installation-pull-secrets\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.564143 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.563839    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlg4x\" (UniqueName: \"kubernetes.io/projected/3ea28118-979d-4284-a921-8baa8e2310c9-kube-api-access-dlg4x\") pod \"network-check-source-7cbc45fddc-6bppp\" (UID: \"3ea28118-979d-4284-a921-8baa8e2310c9\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"
Sep 17 17:57:33.572267 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.571305    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd8f8\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-kube-api-access-fd8f8\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.573470 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.573336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-bound-sa-token\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:33.611690 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.611641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"
Sep 17 17:57:33.631394 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.631371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:33.717472 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.717450    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85"]
Sep 17 17:57:33.720040 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:33.720016    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4118c6b4_71d1_4d1b_834c_a5c8601a1a82.slice/crio-adcef12cbe88634d9654f81b2f49ac53ee16cd4d39adfd054ad7563a96e86239 WatchSource:0}: Error finding container adcef12cbe88634d9654f81b2f49ac53ee16cd4d39adfd054ad7563a96e86239: Status 404 returned error can't find the container with id adcef12cbe88634d9654f81b2f49ac53ee16cd4d39adfd054ad7563a96e86239
Sep 17 17:57:33.723114 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.723094    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:33.780116 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.780096    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-4l8gr"]
Sep 17 17:57:33.783146 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:33.783120    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98aa99ea_ad93_4ff3_ae88_ba6061bfbbd4.slice/crio-74078640183ca03786a03bf288bfd5bac767395e72de809b900bc37f478580f8 WatchSource:0}: Error finding container 74078640183ca03786a03bf288bfd5bac767395e72de809b900bc37f478580f8: Status 404 returned error can't find the container with id 74078640183ca03786a03bf288bfd5bac767395e72de809b900bc37f478580f8
Sep 17 17:57:33.803379 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.803355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-gbq8n"]
Sep 17 17:57:33.806125 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:33.806102    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54092044_dada_45e5_bd9c_87a374b0ec2c.slice/crio-d0da7ccdeb960bc5e1dc1849630b218b826d27266f0dbe5cc4c6c6ce0389a516 WatchSource:0}: Error finding container d0da7ccdeb960bc5e1dc1849630b218b826d27266f0dbe5cc4c6c6ce0389a516: Status 404 returned error can't find the container with id d0da7ccdeb960bc5e1dc1849630b218b826d27266f0dbe5cc4c6c6ce0389a516
Sep 17 17:57:33.853421 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.853402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:33.853557 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.853540    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:33.853616 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:33.853607    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls podName:0d39c881-ca4e-4128-98d4-702c46369144 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:34.853594003 +0000 UTC m=+57.606334309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-cbmzz" (UID: "0d39c881-ca4e-4128-98d4-702c46369144") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:33.878128 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:33.878029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp"]
Sep 17 17:57:33.880126 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:33.880101    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea28118_979d_4284_a921_8baa8e2310c9.slice/crio-192f2617978a1edceab99b3d2bb61c48f03a9b726d3deea9ca5f7c3b2b1f6568 WatchSource:0}: Error finding container 192f2617978a1edceab99b3d2bb61c48f03a9b726d3deea9ca5f7c3b2b1f6568: Status 404 returned error can't find the container with id 192f2617978a1edceab99b3d2bb61c48f03a9b726d3deea9ca5f7c3b2b1f6568
Sep 17 17:57:34.055303 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.055273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:34.055444 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:34.055387    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:57:34.055444 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:34.055399    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854597f79f-mt6wd: secret "image-registry-tls" not found
Sep 17 17:57:34.055559 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:34.055449    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls podName:834bb5e9-1fd0-43bb-be1a-acea5e64f6df nodeName:}" failed. No retries permitted until 2026-09-17 17:57:35.055436186 +0000 UTC m=+57.808176512 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls") pod "image-registry-854597f79f-mt6wd" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df") : secret "image-registry-tls" not found
Sep 17 17:57:34.548574 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.548507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr" event={"ID":"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4","Type":"ContainerStarted","Data":"74078640183ca03786a03bf288bfd5bac767395e72de809b900bc37f478580f8"}
Sep 17 17:57:34.550236 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.550192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85" event={"ID":"4118c6b4-71d1-4d1b-834c-a5c8601a1a82","Type":"ContainerStarted","Data":"adcef12cbe88634d9654f81b2f49ac53ee16cd4d39adfd054ad7563a96e86239"}
Sep 17 17:57:34.553928 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.553873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp" event={"ID":"3ea28118-979d-4284-a921-8baa8e2310c9","Type":"ContainerStarted","Data":"b62b4f256a1ef570075bb5600ba00cb902b1fd1a74a4e3f3e2a46acdcb478a1a"}
Sep 17 17:57:34.554255 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.554197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp" event={"ID":"3ea28118-979d-4284-a921-8baa8e2310c9","Type":"ContainerStarted","Data":"192f2617978a1edceab99b3d2bb61c48f03a9b726d3deea9ca5f7c3b2b1f6568"}
Sep 17 17:57:34.556489 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.556411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" event={"ID":"54092044-dada-45e5-bd9c-87a374b0ec2c","Type":"ContainerStarted","Data":"d0da7ccdeb960bc5e1dc1849630b218b826d27266f0dbe5cc4c6c6ce0389a516"}
Sep 17 17:57:34.579529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.579471    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-6bppp" podStartSLOduration=1.57945464 podStartE2EDuration="1.57945464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:34.578932371 +0000 UTC m=+57.331672700" watchObservedRunningTime="2026-09-17 17:57:34.57945464 +0000 UTC m=+57.332194969"
Sep 17 17:57:34.862746 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:34.862574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:34.862746 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:34.862699    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:34.863026 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:34.862770    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls podName:0d39c881-ca4e-4128-98d4-702c46369144 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:36.862751889 +0000 UTC m=+59.615492209 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-cbmzz" (UID: "0d39c881-ca4e-4128-98d4-702c46369144") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:35.064100 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:35.063966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:35.064100 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:35.064096    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:57:35.064318 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:35.064118    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854597f79f-mt6wd: secret "image-registry-tls" not found
Sep 17 17:57:35.064318 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:35.064273    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls podName:834bb5e9-1fd0-43bb-be1a-acea5e64f6df nodeName:}" failed. No retries permitted until 2026-09-17 17:57:37.064252798 +0000 UTC m=+59.816993120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls") pod "image-registry-854597f79f-mt6wd" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df") : secret "image-registry-tls" not found
Sep 17 17:57:35.424089 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:35.424054    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:35.530624 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:35.530592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:36.876718 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:36.876689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:36.877165 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:36.876841    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:36.877165 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:36.876931    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls podName:0d39c881-ca4e-4128-98d4-702c46369144 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:40.876894843 +0000 UTC m=+63.629635149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-cbmzz" (UID: "0d39c881-ca4e-4128-98d4-702c46369144") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:37.022985 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.022934    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:37.078110 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.078085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:37.078214 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:37.078202    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:57:37.078260 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:37.078216    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854597f79f-mt6wd: secret "image-registry-tls" not found
Sep 17 17:57:37.078260 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:37.078258    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls podName:834bb5e9-1fd0-43bb-be1a-acea5e64f6df nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.078246336 +0000 UTC m=+63.830986647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls") pod "image-registry-854597f79f-mt6wd" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df") : secret "image-registry-tls" not found
Sep 17 17:57:37.444382 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.444361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:37.567558 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.567532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85" event={"ID":"4118c6b4-71d1-4d1b-834c-a5c8601a1a82","Type":"ContainerStarted","Data":"000212cd79ab6f972a2750aa3a8790d410ce61f2fc76e286e6b2505693c15563"}
Sep 17 17:57:37.569388 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.569372    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/0.log"
Sep 17 17:57:37.569487 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.569408    2577 generic.go:356] "Generic (PLEG): container finished" podID="54092044-dada-45e5-bd9c-87a374b0ec2c" containerID="2e8da9106880fb920ed96705366be4d1cc912d2d662744c1a610b6c298f531df" exitCode=255
Sep 17 17:57:37.569540 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.569482    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" event={"ID":"54092044-dada-45e5-bd9c-87a374b0ec2c","Type":"ContainerDied","Data":"2e8da9106880fb920ed96705366be4d1cc912d2d662744c1a610b6c298f531df"}
Sep 17 17:57:37.569666 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.569649    2577 scope.go:117] "RemoveContainer" containerID="2e8da9106880fb920ed96705366be4d1cc912d2d662744c1a610b6c298f531df"
Sep 17 17:57:37.571770 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.571099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr" event={"ID":"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4","Type":"ContainerStarted","Data":"a7966830b8b1e59fe399af50f1f968f03a54fc2155bf94ea3fefce87d1b22192"}
Sep 17 17:57:37.575119 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.574994    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:37.589182 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.589148    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85" podStartSLOduration=1.6136534660000001 podStartE2EDuration="4.589135487s" totalImagesPullingTime="2.975482021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:37.587961095 +0000 UTC m=+60.340701427" watchObservedRunningTime="2026-09-17 17:57:37.589135487 +0000 UTC m=+60.341875874"
Sep 17 17:57:37.615533 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.615490    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr" podStartSLOduration=1.712901264 podStartE2EDuration="4.615477411s" totalImagesPullingTime="2.902576147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:37.615098537 +0000 UTC m=+60.367838858" watchObservedRunningTime="2026-09-17 17:57:37.615477411 +0000 UTC m=+60.368217739"
Sep 17 17:57:37.943917 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.943882    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gtp8l"]
Sep 17 17:57:37.945852 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.945810    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:37.952420 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.952399    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 17:57:37.952507 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.952438    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 17:57:37.952691 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.952678    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vp6pv\""
Sep 17 17:57:37.961544 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.961519    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:37.976633 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:37.976610    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gtp8l"]
Sep 17 17:57:38.086722 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.086695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ecbb2ca1-13db-4a89-96c0-96758a179e5e-crio-socket\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.086809 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.086735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecbb2ca1-13db-4a89-96c0-96758a179e5e-data-volume\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.086809 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.086794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pfqx\" (UniqueName: \"kubernetes.io/projected/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-api-access-4pfqx\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.086874 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.086815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.086874 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.086839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.123262 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.123239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:38.187680 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.187665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ecbb2ca1-13db-4a89-96c0-96758a179e5e-crio-socket\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.187752 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.187700    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecbb2ca1-13db-4a89-96c0-96758a179e5e-data-volume\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.187752 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.187742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pfqx\" (UniqueName: \"kubernetes.io/projected/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-api-access-4pfqx\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.187824 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.187768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.187824 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.187786    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ecbb2ca1-13db-4a89-96c0-96758a179e5e-crio-socket\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.187824 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.187792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.187937 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.187855    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:57:38.187937 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.187878    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:38.188000 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.187940    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:38.687924373 +0000 UTC m=+61.440664753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : configmap "kube-rbac-proxy" not found
Sep 17 17:57:38.188000 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.187954    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:38.687948358 +0000 UTC m=+61.440688664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:38.188069 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.188028    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ecbb2ca1-13db-4a89-96c0-96758a179e5e-data-volume\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.197456 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.197410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pfqx\" (UniqueName: \"kubernetes.io/projected/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-api-access-4pfqx\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.223161 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.223138    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:38.477296 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.477223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ww9br"
Sep 17 17:57:38.514449 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.514421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:38.575727 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.575708    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/1.log"
Sep 17 17:57:38.576132 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.576115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/0.log"
Sep 17 17:57:38.576258 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.576151    2577 generic.go:356] "Generic (PLEG): container finished" podID="54092044-dada-45e5-bd9c-87a374b0ec2c" containerID="8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0" exitCode=255
Sep 17 17:57:38.576258 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.576176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" event={"ID":"54092044-dada-45e5-bd9c-87a374b0ec2c","Type":"ContainerDied","Data":"8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0"}
Sep 17 17:57:38.576258 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.576222    2577 scope.go:117] "RemoveContainer" containerID="2e8da9106880fb920ed96705366be4d1cc912d2d662744c1a610b6c298f531df"
Sep 17 17:57:38.576395 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.576378    2577 scope.go:117] "RemoveContainer" containerID="8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0"
Sep 17 17:57:38.576596 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.576565    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-gbq8n_openshift-console-operator(54092044-dada-45e5-bd9c-87a374b0ec2c)\"" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podUID="54092044-dada-45e5-bd9c-87a374b0ec2c"
Sep 17 17:57:38.690875 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.690855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.690972 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.690955    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:57:38.691040 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.691024    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:39.69100614 +0000 UTC m=+62.443746464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : configmap "kube-rbac-proxy" not found
Sep 17 17:57:38.691300 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.691277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:38.691403 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.691357    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:38.691461 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:38.691407    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:39.691395774 +0000 UTC m=+62.444136080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:38.822049 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:38.822026    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:39.055271 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.055249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:39.484918 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.484879    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:39.581949 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.581930    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/1.log"
Sep 17 17:57:39.582242 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.582227    2577 scope.go:117] "RemoveContainer" containerID="8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0"
Sep 17 17:57:39.582382 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:39.582366    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-gbq8n_openshift-console-operator(54092044-dada-45e5-bd9c-87a374b0ec2c)\"" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podUID="54092044-dada-45e5-bd9c-87a374b0ec2c"
Sep 17 17:57:39.618938 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.618896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:39.698566 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.698547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:39.698673 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:39.698573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:39.698673 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:39.698670    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:57:39.698763 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:39.698674    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:39.698763 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:39.698724    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.698709393 +0000 UTC m=+64.451449712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : configmap "kube-rbac-proxy" not found
Sep 17 17:57:39.698763 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:39.698742    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:41.698732756 +0000 UTC m=+64.451473066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:40.379697 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.379669    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9nrd4"]
Sep 17 17:57:40.382302 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.382288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.386192 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.386176    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 17:57:40.386691 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.386672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 17:57:40.386773 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.386697    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 17:57:40.387407 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.387383    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8fhqq\""
Sep 17 17:57:40.387497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.387441    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 17:57:40.392597 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.392578    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9nrd4"]
Sep 17 17:57:40.403873 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.403854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2fa916a5-1126-46c8-a380-d1962d520185-signing-cabundle\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.403976 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.403896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2fa916a5-1126-46c8-a380-d1962d520185-signing-key\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.403976 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.403930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkddd\" (UniqueName: \"kubernetes.io/projected/2fa916a5-1126-46c8-a380-d1962d520185-kube-api-access-pkddd\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.450085 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.450061    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:40.504285 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.504264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2fa916a5-1126-46c8-a380-d1962d520185-signing-cabundle\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.504354 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.504300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2fa916a5-1126-46c8-a380-d1962d520185-signing-key\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.504354 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.504319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkddd\" (UniqueName: \"kubernetes.io/projected/2fa916a5-1126-46c8-a380-d1962d520185-kube-api-access-pkddd\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.504941 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.504877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2fa916a5-1126-46c8-a380-d1962d520185-signing-cabundle\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.506602 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.506584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2fa916a5-1126-46c8-a380-d1962d520185-signing-key\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.518528 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.518504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkddd\" (UniqueName: \"kubernetes.io/projected/2fa916a5-1126-46c8-a380-d1962d520185-kube-api-access-pkddd\") pod \"service-ca-55f6fc7b86-9nrd4\" (UID: \"2fa916a5-1126-46c8-a380-d1962d520185\") " pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.552827 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.552808    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:40.691142 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.691096    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4"
Sep 17 17:57:40.827745 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.827724    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tvbl4_7ed9af67-a459-4e78-8e14-d5e6a492f7a7/dns-node-resolver/0.log"
Sep 17 17:57:40.907295 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.907275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:40.907404 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:40.907379    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:40.907449 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:40.907428    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls podName:0d39c881-ca4e-4128-98d4-702c46369144 nodeName:}" failed. No retries permitted until 2026-09-17 17:57:48.907415287 +0000 UTC m=+71.660155606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-cbmzz" (UID: "0d39c881-ca4e-4128-98d4-702c46369144") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:40.967625 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:40.967574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-9nrd4"]
Sep 17 17:57:40.970723 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:40.970701    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa916a5_1126_46c8_a380_d1962d520185.slice/crio-776c963309980260b06f6e579e7f67a97abaf13788755a1174dcd6a49d9431ec WatchSource:0}: Error finding container 776c963309980260b06f6e579e7f67a97abaf13788755a1174dcd6a49d9431ec: Status 404 returned error can't find the container with id 776c963309980260b06f6e579e7f67a97abaf13788755a1174dcd6a49d9431ec
Sep 17 17:57:41.108762 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.108729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:41.108897 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.108850    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 17:57:41.108897 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.108866    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-854597f79f-mt6wd: secret "image-registry-tls" not found
Sep 17 17:57:41.109040 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.108944    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls podName:834bb5e9-1fd0-43bb-be1a-acea5e64f6df nodeName:}" failed. No retries permitted until 2026-09-17 17:57:49.108925998 +0000 UTC m=+71.861666326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls") pod "image-registry-854597f79f-mt6wd" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df") : secret "image-registry-tls" not found
Sep 17 17:57:41.590166 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.590140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4" event={"ID":"2fa916a5-1126-46c8-a380-d1962d520185","Type":"ContainerStarted","Data":"509ab521cb22239fc3af946f70a0ec17904dfa1911c22c82c7e7f8edd724ce16"}
Sep 17 17:57:41.590486 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.590180    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4" event={"ID":"2fa916a5-1126-46c8-a380-d1962d520185","Type":"ContainerStarted","Data":"776c963309980260b06f6e579e7f67a97abaf13788755a1174dcd6a49d9431ec"}
Sep 17 17:57:41.612108 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.612069    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-9nrd4" podStartSLOduration=1.612054896 podStartE2EDuration="1.612054896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:41.611196803 +0000 UTC m=+64.363937141" watchObservedRunningTime="2026-09-17 17:57:41.612054896 +0000 UTC m=+64.364795224"
Sep 17 17:57:41.621113 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.621098    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m25vn_a033a4bf-2f57-4cc8-8235-4aaa23f96261/node-ca/0.log"
Sep 17 17:57:41.713763 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.713741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:41.713860 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.713773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:41.713947 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.713865    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:41.713947 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.713926    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:57:41.713947 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.713935    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:45.713917531 +0000 UTC m=+68.466657850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:41.714068 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:41.713972    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:45.713958894 +0000 UTC m=+68.466699219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : configmap "kube-rbac-proxy" not found
Sep 17 17:57:41.782604 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:41.782581    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:42.080120 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:42.080077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:42.293369 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:42.293332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:42.430935 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:42.430860    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fklv_d3c40b9d-ccff-42de-9041-00d5cde9bf61/serve-healthcheck-canary/0.log"
Sep 17 17:57:42.449991 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:42.449941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:42.572966 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:42.572940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:42.773604 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:42.773551    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:43.514593 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:43.514568    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:43.514739 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:43.514607    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:57:43.515015 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:43.514998    2577 scope.go:117] "RemoveContainer" containerID="8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0"
Sep 17 17:57:43.515217 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:43.515191    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-gbq8n_openshift-console-operator(54092044-dada-45e5-bd9c-87a374b0ec2c)\"" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podUID="54092044-dada-45e5-bd9c-87a374b0ec2c"
Sep 17 17:57:43.561930 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:43.561894    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:43.973583 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:43.973558    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:44.133862 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:44.133843    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:57:44.134019 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:44.134001    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 17:57:44.134086 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:44.134075    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls podName:7c5fd24e-55a0-445a-9c31-0502336fa9fd nodeName:}" failed. No retries permitted until 2026-09-17 17:58:16.134058268 +0000 UTC m=+98.886798581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls") pod "dns-default-lqd7j" (UID: "7c5fd24e-55a0-445a-9c31-0502336fa9fd") : secret "dns-default-metrics-tls" not found
Sep 17 17:57:44.193842 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:44.193822    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:44.583413 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:44.583388    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:44.968229 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:44.968175    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:45.038685 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:45.038663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:57:45.039004 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:45.038761    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 17:57:45.039004 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:45.038815    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs podName:de9a5ba3-4824-48c9-9498-d6c8963cada3 nodeName:}" failed. No retries permitted until 2026-09-17 17:58:49.038803485 +0000 UTC m=+131.791543791 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs") pod "network-metrics-daemon-q6mtq" (UID: "de9a5ba3-4824-48c9-9498-d6c8963cada3") : secret "metrics-daemon-secret" not found
Sep 17 17:57:45.744101 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:45.744070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:45.744101 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:45.744103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:45.744347 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:45.744192    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 17:57:45.744347 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:45.744209    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:45.744347 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:45.744250    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:53.744237613 +0000 UTC m=+76.496977919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : configmap "kube-rbac-proxy" not found
Sep 17 17:57:45.744347 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:45.744262    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls podName:ecbb2ca1-13db-4a89-96c0-96758a179e5e nodeName:}" failed. No retries permitted until 2026-09-17 17:57:53.744256451 +0000 UTC m=+76.496996757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gtp8l" (UID: "ecbb2ca1-13db-4a89-96c0-96758a179e5e") : secret "insights-runtime-extractor-tls" not found
Sep 17 17:57:45.815115 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:45.815096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:45.905499 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:45.905481    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.004932 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.004864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.160177 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.160155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.385240 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.385218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.486890 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.486871    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.588250 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.588227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.662595 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.662548    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:46.968457 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:46.968411    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:47.395530 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:47.395507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:48.169362 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:48.169331    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:48.564233 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:48.564208    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:48.640109 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:48.640089    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:48.772762 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:48.772742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:48.970130 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:48.970083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:57:48.970213 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:48.970195    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:48.970254 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:48.970245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls podName:0d39c881-ca4e-4128-98d4-702c46369144 nodeName:}" failed. No retries permitted until 2026-09-17 17:58:04.970230266 +0000 UTC m=+87.722970580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-cbmzz" (UID: "0d39c881-ca4e-4128-98d4-702c46369144") : secret "cluster-monitoring-operator-tls" not found
Sep 17 17:57:48.974397 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:48.974380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:49.166814 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.166793    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:49.171030 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.171014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:49.173478 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.173462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"image-registry-854597f79f-mt6wd\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") " pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:49.235470 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.235427    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tjn7j\""
Sep 17 17:57:49.243853 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.243831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:49.538778 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.538751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-854597f79f-mt6wd"]
Sep 17 17:57:49.542331 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:49.542305    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834bb5e9_1fd0_43bb_be1a_acea5e64f6df.slice/crio-bfcf7f7a2f2930d39032ae513ca9e7e308cd876674dc6dd821cfcab1a4fc5c0a WatchSource:0}: Error finding container bfcf7f7a2f2930d39032ae513ca9e7e308cd876674dc6dd821cfcab1a4fc5c0a: Status 404 returned error can't find the container with id bfcf7f7a2f2930d39032ae513ca9e7e308cd876674dc6dd821cfcab1a4fc5c0a
Sep 17 17:57:49.616030 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:49.616007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" event={"ID":"834bb5e9-1fd0-43bb-be1a-acea5e64f6df","Type":"ContainerStarted","Data":"bfcf7f7a2f2930d39032ae513ca9e7e308cd876674dc6dd821cfcab1a4fc5c0a"}
Sep 17 17:57:50.174496 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.174467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.252830 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.252795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.518176 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.518121    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tvgp2"
Sep 17 17:57:50.571609 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.571579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.620983 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.620959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" event={"ID":"834bb5e9-1fd0-43bb-be1a-acea5e64f6df","Type":"ContainerStarted","Data":"d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328"}
Sep 17 17:57:50.621276 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.620998    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:57:50.643643 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.643601    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" podStartSLOduration=17.643588059 podStartE2EDuration="17.643588059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:50.642401436 +0000 UTC m=+73.395141763" watchObservedRunningTime="2026-09-17 17:57:50.643588059 +0000 UTC m=+73.396328385"
Sep 17 17:57:50.773272 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.773192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:50.963752 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:50.963731    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:51.171099 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:51.171079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:52.173822 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:52.173789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:52.373012 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:52.372972    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:52.588306 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:52.588270    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:52.769704 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:52.769683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:53.597020 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.596999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:53.697749 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.697728    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:53.809778 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.809756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:53.809871 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.809780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:53.810254 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.810239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ecbb2ca1-13db-4a89-96c0-96758a179e5e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:53.812056 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.812038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ecbb2ca1-13db-4a89-96c0-96758a179e5e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gtp8l\" (UID: \"ecbb2ca1-13db-4a89-96c0-96758a179e5e\") " pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:53.856801 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.856758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vp6pv\""
Sep 17 17:57:53.864845 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:53.864830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gtp8l"
Sep 17 17:57:54.141799 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:54.141649    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gtp8l"]
Sep 17 17:57:54.144311 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:57:54.144285    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbb2ca1_13db_4a89_96c0_96758a179e5e.slice/crio-1a216eb1c6fcda7eed97362fbbe299d9fe86e6838699a9102a8114ed5a93d5cb WatchSource:0}: Error finding container 1a216eb1c6fcda7eed97362fbbe299d9fe86e6838699a9102a8114ed5a93d5cb: Status 404 returned error can't find the container with id 1a216eb1c6fcda7eed97362fbbe299d9fe86e6838699a9102a8114ed5a93d5cb
Sep 17 17:57:54.275590 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:54.275562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:57:54.636299 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:54.636274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtp8l" event={"ID":"ecbb2ca1-13db-4a89-96c0-96758a179e5e","Type":"ContainerStarted","Data":"c7f1528f605674b84efd239df0b89f9850f4b8025dd8674a4945ed2ac979863e"}
Sep 17 17:57:54.636588 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:54.636330    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtp8l" event={"ID":"ecbb2ca1-13db-4a89-96c0-96758a179e5e","Type":"ContainerStarted","Data":"1a216eb1c6fcda7eed97362fbbe299d9fe86e6838699a9102a8114ed5a93d5cb"}
Sep 17 17:57:55.641877 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:55.641845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtp8l" event={"ID":"ecbb2ca1-13db-4a89-96c0-96758a179e5e","Type":"ContainerStarted","Data":"f6a5514f42803cac21761ca186331e924b3de05a1c43dc5772122656c93a6b4b"}
Sep 17 17:57:56.650161 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:56.650133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gtp8l" event={"ID":"ecbb2ca1-13db-4a89-96c0-96758a179e5e","Type":"ContainerStarted","Data":"2ef0b2977e15157916713d68f5a455c00237a19eec368e9a3783fbff17e818cf"}
Sep 17 17:57:56.674070 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:56.674029    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gtp8l" podStartSLOduration=17.932244077 podStartE2EDuration="19.67401553s" totalImagesPullingTime="1.741771453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 17:57:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:57:56.672961933 +0000 UTC m=+79.425702261" watchObservedRunningTime="2026-09-17 17:57:56.67401553 +0000 UTC m=+79.426755858"
Sep 17 17:57:58.320201 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.320181    2577 scope.go:117] "RemoveContainer" containerID="8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0"
Sep 17 17:57:58.657331 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.657285    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 17:57:58.657673 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.657659    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/1.log"
Sep 17 17:57:58.657711 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.657690    2577 generic.go:356] "Generic (PLEG): container finished" podID="54092044-dada-45e5-bd9c-87a374b0ec2c" containerID="51718cdfbae7fdb4eaa62024bdb92680ead79e6fe80e555efdebfc3afe294cab" exitCode=255
Sep 17 17:57:58.657756 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.657744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" event={"ID":"54092044-dada-45e5-bd9c-87a374b0ec2c","Type":"ContainerDied","Data":"51718cdfbae7fdb4eaa62024bdb92680ead79e6fe80e555efdebfc3afe294cab"}
Sep 17 17:57:58.657799 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.657789    2577 scope.go:117] "RemoveContainer" containerID="8bd4a7eaa1cf57d6a40e55821d6bfa40fa8ee524d56f6508c73680ca981120a0"
Sep 17 17:57:58.658046 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:58.658032    2577 scope.go:117] "RemoveContainer" containerID="51718cdfbae7fdb4eaa62024bdb92680ead79e6fe80e555efdebfc3afe294cab"
Sep 17 17:57:58.658204 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:57:58.658185    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-gbq8n_openshift-console-operator(54092044-dada-45e5-bd9c-87a374b0ec2c)\"" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podUID="54092044-dada-45e5-bd9c-87a374b0ec2c"
Sep 17 17:57:59.662227 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:57:59.662205    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 17:58:02.852778 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.852749    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854597f79f-mt6wd"]
Sep 17 17:58:02.925608 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.925582    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cb77949f7-62bth"]
Sep 17 17:58:02.928249 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.928233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.949835 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.949815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb77949f7-62bth"]
Sep 17 17:58:02.973383 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-registry-tls\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973471 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-bound-sa-token\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973471 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/164d59ff-24ca-4a95-81c1-51ccc590c511-trusted-ca\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973547 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzgjk\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-kube-api-access-wzgjk\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973585 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/164d59ff-24ca-4a95-81c1-51ccc590c511-installation-pull-secrets\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973621 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973609    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/164d59ff-24ca-4a95-81c1-51ccc590c511-registry-certificates\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973686 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/164d59ff-24ca-4a95-81c1-51ccc590c511-image-registry-private-configuration\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.973722 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.973705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/164d59ff-24ca-4a95-81c1-51ccc590c511-ca-trust-extracted\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:02.995482 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:02.995455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:03.074814 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/164d59ff-24ca-4a95-81c1-51ccc590c511-ca-trust-extracted\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.074933 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-registry-tls\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.074933 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-bound-sa-token\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.074933 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/164d59ff-24ca-4a95-81c1-51ccc590c511-trusted-ca\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.074933 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzgjk\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-kube-api-access-wzgjk\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.075146 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/164d59ff-24ca-4a95-81c1-51ccc590c511-installation-pull-secrets\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.075146 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.074995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/164d59ff-24ca-4a95-81c1-51ccc590c511-registry-certificates\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.075146 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.075026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/164d59ff-24ca-4a95-81c1-51ccc590c511-image-registry-private-configuration\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.075273 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.075212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/164d59ff-24ca-4a95-81c1-51ccc590c511-ca-trust-extracted\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.075816 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.075792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/164d59ff-24ca-4a95-81c1-51ccc590c511-registry-certificates\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.076056 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.076033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/164d59ff-24ca-4a95-81c1-51ccc590c511-trusted-ca\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.077353 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.077334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-registry-tls\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.077517 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.077497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/164d59ff-24ca-4a95-81c1-51ccc590c511-image-registry-private-configuration\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.077558 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.077539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/164d59ff-24ca-4a95-81c1-51ccc590c511-installation-pull-secrets\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.085219 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.085199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-bound-sa-token\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.093069 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.093053    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzgjk\" (UniqueName: \"kubernetes.io/projected/164d59ff-24ca-4a95-81c1-51ccc590c511-kube-api-access-wzgjk\") pod \"image-registry-7cb77949f7-62bth\" (UID: \"164d59ff-24ca-4a95-81c1-51ccc590c511\") " pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.114283 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.114238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:03.211537 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.211516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:03.236576 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.236540    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.514982 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.514814    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:58:03.514982 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.514957    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:58:03.515494 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.515471    2577 scope.go:117] "RemoveContainer" containerID="51718cdfbae7fdb4eaa62024bdb92680ead79e6fe80e555efdebfc3afe294cab"
Sep 17 17:58:03.515654 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:03.515630    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-gbq8n_openshift-console-operator(54092044-dada-45e5-bd9c-87a374b0ec2c)\"" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podUID="54092044-dada-45e5-bd9c-87a374b0ec2c"
Sep 17 17:58:03.516838 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.516815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cb77949f7-62bth"]
Sep 17 17:58:03.519708 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:03.519684    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164d59ff_24ca_4a95_81c1_51ccc590c511.slice/crio-11186ffbe5c47a96483c856eb7f8dd5d7398f2b3eed3a4d94454948bfbb2e420 WatchSource:0}: Error finding container 11186ffbe5c47a96483c856eb7f8dd5d7398f2b3eed3a4d94454948bfbb2e420: Status 404 returned error can't find the container with id 11186ffbe5c47a96483c856eb7f8dd5d7398f2b3eed3a4d94454948bfbb2e420
Sep 17 17:58:03.674770 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.674739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb77949f7-62bth" event={"ID":"164d59ff-24ca-4a95-81c1-51ccc590c511","Type":"ContainerStarted","Data":"f6fc1ce4f09231d03daacd9bbc3fe0d20f7312c11bfbb1853ec86cd99314018a"}
Sep 17 17:58:03.674950 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.674785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cb77949f7-62bth" event={"ID":"164d59ff-24ca-4a95-81c1-51ccc590c511","Type":"ContainerStarted","Data":"11186ffbe5c47a96483c856eb7f8dd5d7398f2b3eed3a4d94454948bfbb2e420"}
Sep 17 17:58:03.674950 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.674862    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:03.760882 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.760850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:03.921185 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:03.921150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:04.992996 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:04.992963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:58:04.995246 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:04.995227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0d39c881-ca4e-4128-98d4-702c46369144-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-cbmzz\" (UID: \"0d39c881-ca4e-4128-98d4-702c46369144\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:58:05.238146 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:05.238123    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-stgx7\""
Sep 17 17:58:05.245468 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:05.245435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"
Sep 17 17:58:05.525077 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:05.524995    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cb77949f7-62bth" podStartSLOduration=3.524975553 podStartE2EDuration="3.524975553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:03.733023158 +0000 UTC m=+86.485763485" watchObservedRunningTime="2026-09-17 17:58:05.524975553 +0000 UTC m=+88.277715893"
Sep 17 17:58:05.526172 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:05.526151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz"]
Sep 17 17:58:05.529067 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:05.529045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d39c881_ca4e_4128_98d4_702c46369144.slice/crio-07f5e6e0dbba3472ffbc64583423095504e6b5d900184043dcddeed61cebebd5 WatchSource:0}: Error finding container 07f5e6e0dbba3472ffbc64583423095504e6b5d900184043dcddeed61cebebd5: Status 404 returned error can't find the container with id 07f5e6e0dbba3472ffbc64583423095504e6b5d900184043dcddeed61cebebd5
Sep 17 17:58:05.681868 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:05.681845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz" event={"ID":"0d39c881-ca4e-4128-98d4-702c46369144","Type":"ContainerStarted","Data":"07f5e6e0dbba3472ffbc64583423095504e6b5d900184043dcddeed61cebebd5"}
Sep 17 17:58:07.689733 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:07.689697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz" event={"ID":"0d39c881-ca4e-4128-98d4-702c46369144","Type":"ContainerStarted","Data":"a6573a20cebfcfad17e10e258993a8a0f76da30b427f7aa0a9661dfb649df80e"}
Sep 17 17:58:07.754661 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:07.754617    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:07.790144 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:07.790102    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-cbmzz" podStartSLOduration=33.116728984 podStartE2EDuration="34.79008823s" totalImagesPullingTime="1.673359246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:07.787450665 +0000 UTC m=+90.540190995" watchObservedRunningTime="2026-09-17 17:58:07.79008823 +0000 UTC m=+90.542828557"
Sep 17 17:58:08.003623 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:08.003555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:08.122080 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:08.122048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:08.795257 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:08.795237    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:11.119401 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.119366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:11.207259 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.207235    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"]
Sep 17 17:58:11.210109 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.210094    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.215450 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.215423    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 17:58:11.216102 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.216082    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8gzd4\""
Sep 17 17:58:11.216507 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.216489    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 17:58:11.216607 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.216494    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 17:58:11.237913 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.237887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"]
Sep 17 17:58:11.265722 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.265697    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:11.337211 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.337194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53206f4d-6da1-4fc0-81cc-3d03efa3787b-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.337307 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.337221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.337307 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.337238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s47gv\" (UniqueName: \"kubernetes.io/projected/53206f4d-6da1-4fc0-81cc-3d03efa3787b-kube-api-access-s47gv\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.337307 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.337279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.437740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.437695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53206f4d-6da1-4fc0-81cc-3d03efa3787b-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.437740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.437721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.437740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.437737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s47gv\" (UniqueName: \"kubernetes.io/projected/53206f4d-6da1-4fc0-81cc-3d03efa3787b-kube-api-access-s47gv\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.438061 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.437758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.438061 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:11.437870    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 17 17:58:11.438061 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:11.437942    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-tls podName:53206f4d-6da1-4fc0-81cc-3d03efa3787b nodeName:}" failed. No retries permitted until 2026-09-17 17:58:11.937925226 +0000 UTC m=+94.690665535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-sfssp" (UID: "53206f4d-6da1-4fc0-81cc-3d03efa3787b") : secret "prometheus-operator-tls" not found
Sep 17 17:58:11.438317 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.438300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53206f4d-6da1-4fc0-81cc-3d03efa3787b-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.440177 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.440158    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.457731 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.457708    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s47gv\" (UniqueName: \"kubernetes.io/projected/53206f4d-6da1-4fc0-81cc-3d03efa3787b-kube-api-access-s47gv\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.671615 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.671592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:11.942177 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.942155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:11.944265 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:11.944241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53206f4d-6da1-4fc0-81cc-3d03efa3787b-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-sfssp\" (UID: \"53206f4d-6da1-4fc0-81cc-3d03efa3787b\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:12.118683 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:12.118665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"
Sep 17 17:58:12.401539 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:12.401509    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp"]
Sep 17 17:58:12.405213 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:12.405193    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53206f4d_6da1_4fc0_81cc_3d03efa3787b.slice/crio-a169c184f59bbf1a91d34fc15f11c365857041c18875d044158ed54f56d5647a WatchSource:0}: Error finding container a169c184f59bbf1a91d34fc15f11c365857041c18875d044158ed54f56d5647a: Status 404 returned error can't find the container with id a169c184f59bbf1a91d34fc15f11c365857041c18875d044158ed54f56d5647a
Sep 17 17:58:12.705366 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:12.705305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp" event={"ID":"53206f4d-6da1-4fc0-81cc-3d03efa3787b","Type":"ContainerStarted","Data":"a169c184f59bbf1a91d34fc15f11c365857041c18875d044158ed54f56d5647a"}
Sep 17 17:58:12.857932 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:12.857887    2577 patch_prober.go:28] interesting pod/image-registry-854597f79f-mt6wd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 17:58:12.858020 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:12.857964    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" podUID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 17:58:13.710497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:13.710465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp" event={"ID":"53206f4d-6da1-4fc0-81cc-3d03efa3787b","Type":"ContainerStarted","Data":"ac80bb76aef0a4e9238a5ef2333699d45df88fce0862cf2eb6a60287edcacaf2"}
Sep 17 17:58:13.710830 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:13.710525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp" event={"ID":"53206f4d-6da1-4fc0-81cc-3d03efa3787b","Type":"ContainerStarted","Data":"4a70f8bba7fc7cc3bb7489c7ce6096b6d7f650f4cc9b0e8e2f116d264a3809c3"}
Sep 17 17:58:13.734799 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:13.734750    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-sfssp" podStartSLOduration=1.562571917 podStartE2EDuration="2.734734306s" totalImagesPullingTime="1.172162389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:13.734301823 +0000 UTC m=+96.487042151" watchObservedRunningTime="2026-09-17 17:58:13.734734306 +0000 UTC m=+96.487474632"
Sep 17 17:58:13.905782 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:13.905717    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.320471 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.320437    2577 scope.go:117] "RemoveContainer" containerID="51718cdfbae7fdb4eaa62024bdb92680ead79e6fe80e555efdebfc3afe294cab"
Sep 17 17:58:15.320932 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:15.320616    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-gbq8n_openshift-console-operator(54092044-dada-45e5-bd9c-87a374b0ec2c)\"" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podUID="54092044-dada-45e5-bd9c-87a374b0ec2c"
Sep 17 17:58:15.399569 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.399541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.514376 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.514352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.708611 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.708547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.815653 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.815625    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-65c6t"]
Sep 17 17:58:15.818023 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.818008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.821470 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.821448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pk69j\""
Sep 17 17:58:15.821590 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.821567    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 17:58:15.821736 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.821717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 17:58:15.822534 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.822459    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 17:58:15.872686 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-root\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.872789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.872789 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-textfile\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.872897 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.872897 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crjqb\" (UniqueName: \"kubernetes.io/projected/5d480734-a1c1-48ae-9691-ce55db689a2e-kube-api-access-crjqb\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.872897 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-tls\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.873076 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872927    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-wtmp\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.873076 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-sys\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.873076 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.872976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d480734-a1c1-48ae-9691-ce55db689a2e-metrics-client-ca\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.876187 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.876169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.974186 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974133    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-textfile\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974186 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974327 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crjqb\" (UniqueName: \"kubernetes.io/projected/5d480734-a1c1-48ae-9691-ce55db689a2e-kube-api-access-crjqb\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974327 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-tls\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974327 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-wtmp\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974327 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-sys\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974327 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d480734-a1c1-48ae-9691-ce55db689a2e-metrics-client-ca\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974568 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-root\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974568 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974381    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-sys\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974568 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974568 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-wtmp\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974568 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974494    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5d480734-a1c1-48ae-9691-ce55db689a2e-root\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974870 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-textfile\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.974983 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d480734-a1c1-48ae-9691-ce55db689a2e-metrics-client-ca\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.975043 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.974996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.977122 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.977096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.977269 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.977250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5d480734-a1c1-48ae-9691-ce55db689a2e-node-exporter-tls\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:15.980425 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.980404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:15.986847 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:15.986829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crjqb\" (UniqueName: \"kubernetes.io/projected/5d480734-a1c1-48ae-9691-ce55db689a2e-kube-api-access-crjqb\") pod \"node-exporter-65c6t\" (UID: \"5d480734-a1c1-48ae-9691-ce55db689a2e\") " pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:16.129388 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.129369    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-65c6t"
Sep 17 17:58:16.141114 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:16.141092    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d480734_a1c1_48ae_9691_ce55db689a2e.slice/crio-c09c0726422dbea6d6c3adf583b31dd5d09c0b82ee332f6ff8ae1ae3aead828f WatchSource:0}: Error finding container c09c0726422dbea6d6c3adf583b31dd5d09c0b82ee332f6ff8ae1ae3aead828f: Status 404 returned error can't find the container with id c09c0726422dbea6d6c3adf583b31dd5d09c0b82ee332f6ff8ae1ae3aead828f
Sep 17 17:58:16.145708 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.145676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:16.175616 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.175587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:58:16.177809 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.177785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c5fd24e-55a0-445a-9c31-0502336fa9fd-metrics-tls\") pod \"dns-default-lqd7j\" (UID: \"7c5fd24e-55a0-445a-9c31-0502336fa9fd\") " pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:58:16.186130 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.186112    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gqrn8\""
Sep 17 17:58:16.194459 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.194444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:58:16.242745 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.242692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:16.363145 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.363117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:16.470676 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.470646    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lqd7j"]
Sep 17 17:58:16.473264 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:16.473238    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5fd24e_55a0_445a_9c31_0502336fa9fd.slice/crio-1ab3f60f677aeb472118a4cd5165e29da95e6cede28cef9afcedcbc322d7b5c6 WatchSource:0}: Error finding container 1ab3f60f677aeb472118a4cd5165e29da95e6cede28cef9afcedcbc322d7b5c6: Status 404 returned error can't find the container with id 1ab3f60f677aeb472118a4cd5165e29da95e6cede28cef9afcedcbc322d7b5c6
Sep 17 17:58:16.713206 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.713168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:16.722238 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.722214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqd7j" event={"ID":"7c5fd24e-55a0-445a-9c31-0502336fa9fd","Type":"ContainerStarted","Data":"1ab3f60f677aeb472118a4cd5165e29da95e6cede28cef9afcedcbc322d7b5c6"}
Sep 17 17:58:16.723626 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.723603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65c6t" event={"ID":"5d480734-a1c1-48ae-9691-ce55db689a2e","Type":"ContainerStarted","Data":"c09c0726422dbea6d6c3adf583b31dd5d09c0b82ee332f6ff8ae1ae3aead828f"}
Sep 17 17:58:16.853061 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:16.853025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:17.008032 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:17.007945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:17.215559 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:17.215536    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:17.729451 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:17.729375    2577 generic.go:356] "Generic (PLEG): container finished" podID="5d480734-a1c1-48ae-9691-ce55db689a2e" containerID="8301b737ae5f0a87d2143d148e7e96d3429922aa59a4d3fde53abf9b93b5fd64" exitCode=0
Sep 17 17:58:17.729451 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:17.729439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65c6t" event={"ID":"5d480734-a1c1-48ae-9691-ce55db689a2e","Type":"ContainerDied","Data":"8301b737ae5f0a87d2143d148e7e96d3429922aa59a4d3fde53abf9b93b5fd64"}
Sep 17 17:58:18.735882 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.735809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65c6t" event={"ID":"5d480734-a1c1-48ae-9691-ce55db689a2e","Type":"ContainerStarted","Data":"5682ab629c0fb9789696f1811187149e90c2d3241c8245dc4172fb4ec1a3d665"}
Sep 17 17:58:18.735882 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.735867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-65c6t" event={"ID":"5d480734-a1c1-48ae-9691-ce55db689a2e","Type":"ContainerStarted","Data":"cfa64b6cf72956ccbc533cb1a82a6839618365777af7700afaf1468f6441beeb"}
Sep 17 17:58:18.737445 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.737421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqd7j" event={"ID":"7c5fd24e-55a0-445a-9c31-0502336fa9fd","Type":"ContainerStarted","Data":"3ada6b3d3c619b213ad693bfc8ed84d30626d61b8dda6ab623c1667935bb84fe"}
Sep 17 17:58:18.737551 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.737466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lqd7j" event={"ID":"7c5fd24e-55a0-445a-9c31-0502336fa9fd","Type":"ContainerStarted","Data":"716d08f1c9d6aaf03233563120e8a5cb5bfff9c6dbe53ac76550351a30875a98"}
Sep 17 17:58:18.737596 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.737547    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:58:18.782954 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.782888    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-65c6t" podStartSLOduration=2.69142309 podStartE2EDuration="3.782876165s" totalImagesPullingTime="1.014725655s" totalInitContainerRuntime="76.72742ms" isStatefulPod=true podCreationTimestamp="2026-09-17 17:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:18.781734122 +0000 UTC m=+101.534474450" watchObservedRunningTime="2026-09-17 17:58:18.782876165 +0000 UTC m=+101.535616493"
Sep 17 17:58:18.869802 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.869762    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lqd7j" podStartSLOduration=65.012014968 podStartE2EDuration="1m6.869749751s" totalImagesPullingTime="1.857734783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:18.869520283 +0000 UTC m=+101.622260622" watchObservedRunningTime="2026-09-17 17:58:18.869749751 +0000 UTC m=+101.622490112"
Sep 17 17:58:18.981933 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:18.981889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:19.087950 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:19.087928    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:19.407835 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:19.407779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:19.546933 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:19.546894    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:20.268031 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.268004    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:20.280469 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.280446    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bbcd4674c-4zh24"]
Sep 17 17:58:20.282669 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.282655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.285168 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.285148    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 17:58:20.287351 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.287332    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 17:58:20.287638 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.287623    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 17:58:20.288346 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.288323    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dhh6a275j6enu\""
Sep 17 17:58:20.288473 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.288348    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 17:58:20.288473 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.288408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-s6zv5\""
Sep 17 17:58:20.299579 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.299558    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bbcd4674c-4zh24"]
Sep 17 17:58:20.409517 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srf64\" (UniqueName: \"kubernetes.io/projected/99eb04ac-7e42-424c-b2b2-d11d6615630b-kube-api-access-srf64\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.409634 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-secret-metrics-server-tls\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.409634 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/99eb04ac-7e42-424c-b2b2-d11d6615630b-audit-log\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.409634 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/99eb04ac-7e42-424c-b2b2-d11d6615630b-metrics-server-audit-profiles\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.409634 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-client-ca-bundle\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.409763 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99eb04ac-7e42-424c-b2b2-d11d6615630b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.409763 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.409719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-secret-metrics-server-client-certs\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.420051 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.420024    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:20.460813 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.460783    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"]
Sep 17 17:58:20.463243 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.463228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:20.468492 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.468474    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 17:58:20.469896 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.469880    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tw4sr\""
Sep 17 17:58:20.479852 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.479833    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"]
Sep 17 17:58:20.510290 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99eb04ac-7e42-424c-b2b2-d11d6615630b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510376 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-secret-metrics-server-client-certs\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510376 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srf64\" (UniqueName: \"kubernetes.io/projected/99eb04ac-7e42-424c-b2b2-d11d6615630b-kube-api-access-srf64\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510376 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-secret-metrics-server-tls\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510525 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/99eb04ac-7e42-424c-b2b2-d11d6615630b-audit-log\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510525 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/99eb04ac-7e42-424c-b2b2-d11d6615630b-metrics-server-audit-profiles\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510525 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-client-ca-bundle\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.510925 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.510860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/99eb04ac-7e42-424c-b2b2-d11d6615630b-audit-log\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.511420 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.511396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/99eb04ac-7e42-424c-b2b2-d11d6615630b-metrics-server-audit-profiles\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.511606 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.511579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99eb04ac-7e42-424c-b2b2-d11d6615630b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.512875 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.512857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-secret-metrics-server-client-certs\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.513371 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.513354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-secret-metrics-server-tls\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.513518 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.513499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/99eb04ac-7e42-424c-b2b2-d11d6615630b-client-ca-bundle\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.522990 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.522938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srf64\" (UniqueName: \"kubernetes.io/projected/99eb04ac-7e42-424c-b2b2-d11d6615630b-kube-api-access-srf64\") pod \"metrics-server-7bbcd4674c-4zh24\" (UID: \"99eb04ac-7e42-424c-b2b2-d11d6615630b\") " pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.549800 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.549759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:20.591535 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.591514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:20.611167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.611143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f84054da-483a-44a2-bdb1-0e5ff05677de-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:20.611255 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.611231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nshks\" (UniqueName: \"kubernetes.io/projected/f84054da-483a-44a2-bdb1-0e5ff05677de-kube-api-access-nshks\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:20.711796 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.711767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f84054da-483a-44a2-bdb1-0e5ff05677de-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:20.711944 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.711807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nshks\" (UniqueName: \"kubernetes.io/projected/f84054da-483a-44a2-bdb1-0e5ff05677de-kube-api-access-nshks\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:20.712001 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:20.711942    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 17 17:58:20.712047 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:20.712004    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f84054da-483a-44a2-bdb1-0e5ff05677de-monitoring-plugin-cert podName:f84054da-483a-44a2-bdb1-0e5ff05677de nodeName:}" failed. No retries permitted until 2026-09-17 17:58:21.211989133 +0000 UTC m=+103.964729439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f84054da-483a-44a2-bdb1-0e5ff05677de-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-9pkdr" (UID: "f84054da-483a-44a2-bdb1-0e5ff05677de") : secret "monitoring-plugin-cert" not found
Sep 17 17:58:20.726470 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.726449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nshks\" (UniqueName: \"kubernetes.io/projected/f84054da-483a-44a2-bdb1-0e5ff05677de-kube-api-access-nshks\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:20.870704 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:20.870684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bbcd4674c-4zh24"]
Sep 17 17:58:20.872977 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:20.872954    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eb04ac_7e42_424c_b2b2_d11d6615630b.slice/crio-fb6c018667aa59bef4d6c356bbbb7b48525ff991dec48b4b1c678de6b8aeb486 WatchSource:0}: Error finding container fb6c018667aa59bef4d6c356bbbb7b48525ff991dec48b4b1c678de6b8aeb486: Status 404 returned error can't find the container with id fb6c018667aa59bef4d6c356bbbb7b48525ff991dec48b4b1c678de6b8aeb486
Sep 17 17:58:21.021359 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.021331    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:21.215392 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.215347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f84054da-483a-44a2-bdb1-0e5ff05677de-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:21.217713 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.217692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f84054da-483a-44a2-bdb1-0e5ff05677de-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-9pkdr\" (UID: \"f84054da-483a-44a2-bdb1-0e5ff05677de\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:21.371739 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.371721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:21.661019 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.660989    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"]
Sep 17 17:58:21.665434 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:21.665409    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf84054da_483a_44a2_bdb1_0e5ff05677de.slice/crio-b67be6e290b34dac51561dc5819fc3e2c83cfa9f38b649f12b6eaabdec82e800 WatchSource:0}: Error finding container b67be6e290b34dac51561dc5819fc3e2c83cfa9f38b649f12b6eaabdec82e800: Status 404 returned error can't find the container with id b67be6e290b34dac51561dc5819fc3e2c83cfa9f38b649f12b6eaabdec82e800
Sep 17 17:58:21.751569 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.751539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr" event={"ID":"f84054da-483a-44a2-bdb1-0e5ff05677de","Type":"ContainerStarted","Data":"b67be6e290b34dac51561dc5819fc3e2c83cfa9f38b649f12b6eaabdec82e800"}
Sep 17 17:58:21.752673 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:21.752643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24" event={"ID":"99eb04ac-7e42-424c-b2b2-d11d6615630b","Type":"ContainerStarted","Data":"fb6c018667aa59bef4d6c356bbbb7b48525ff991dec48b4b1c678de6b8aeb486"}
Sep 17 17:58:22.393509 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:22.393469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:22.752305 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:22.752229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:22.858728 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:22.858694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:22.860000 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:22.859978    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:58:23.455864 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.455829    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:23.557800 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.557773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:23.761356 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.761290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr" event={"ID":"f84054da-483a-44a2-bdb1-0e5ff05677de","Type":"ContainerStarted","Data":"586755c3eea121b053071e6b70d549723e627e30d6c0e87e46f988f597837d62"}
Sep 17 17:58:23.761480 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.761380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:23.762958 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.762933    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24" event={"ID":"99eb04ac-7e42-424c-b2b2-d11d6615630b","Type":"ContainerStarted","Data":"dc9f13e63a527d27724e3686d9e26b9d6785b717fd596b3cc2309e1e543d6570"}
Sep 17 17:58:23.765869 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.765852    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr"
Sep 17 17:58:23.785329 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.785285    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-9pkdr" podStartSLOduration=2.451128801 podStartE2EDuration="3.785273266s" totalImagesPullingTime="1.334144465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:23.785059294 +0000 UTC m=+106.537799622" watchObservedRunningTime="2026-09-17 17:58:23.785273266 +0000 UTC m=+106.538013592"
Sep 17 17:58:23.828258 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:23.828220    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24" podStartSLOduration=1.7261785889999999 podStartE2EDuration="3.828207444s" totalImagesPullingTime="2.102028855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:23.827601859 +0000 UTC m=+106.580342165" watchObservedRunningTime="2026-09-17 17:58:23.828207444 +0000 UTC m=+106.580947827"
Sep 17 17:58:24.682357 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:24.682335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cb77949f7-62bth"
Sep 17 17:58:25.030601 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:25.030544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:25.128595 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:25.128573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:26.321369 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:26.321343    2577 scope.go:117] "RemoveContainer" containerID="51718cdfbae7fdb4eaa62024bdb92680ead79e6fe80e555efdebfc3afe294cab"
Sep 17 17:58:26.777041 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:26.776961    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 17:58:26.777198 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:26.777042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" event={"ID":"54092044-dada-45e5-bd9c-87a374b0ec2c","Type":"ContainerStarted","Data":"47d27bf4e6524fe49768b372de7a045bc710b2353ffdbabdf394875c592442e2"}
Sep 17 17:58:26.777449 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:26.777419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:58:27.299886 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.299834    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n"
Sep 17 17:58:27.338757 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.338709    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-gbq8n" podStartSLOduration=51.452016668 podStartE2EDuration="54.338693507s" totalImagesPullingTime="2.886676839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:26.807856529 +0000 UTC m=+109.560596856" watchObservedRunningTime="2026-09-17 17:58:27.338693507 +0000 UTC m=+110.091433834"
Sep 17 17:58:27.593294 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.593215    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-w54ns"]
Sep 17 17:58:27.595376 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.595347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:27.599366 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.599344    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 17:58:27.599566 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.599543    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 17:58:27.599644 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.599633    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rvw92\""
Sep 17 17:58:27.630152 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.630128    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-w54ns"]
Sep 17 17:58:27.660206 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.660169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:27.671531 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.671514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcph9\" (UniqueName: \"kubernetes.io/projected/54c6ffdb-2319-45b4-9f0f-c9125886434b-kube-api-access-rcph9\") pod \"downloads-6594f4c75-w54ns\" (UID: \"54c6ffdb-2319-45b4-9f0f-c9125886434b\") " pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:27.768125 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.768103    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:27.772290 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.772272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcph9\" (UniqueName: \"kubernetes.io/projected/54c6ffdb-2319-45b4-9f0f-c9125886434b-kube-api-access-rcph9\") pod \"downloads-6594f4c75-w54ns\" (UID: \"54c6ffdb-2319-45b4-9f0f-c9125886434b\") " pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:27.783176 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.783151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcph9\" (UniqueName: \"kubernetes.io/projected/54c6ffdb-2319-45b4-9f0f-c9125886434b-kube-api-access-rcph9\") pod \"downloads-6594f4c75-w54ns\" (UID: \"54c6ffdb-2319-45b4-9f0f-c9125886434b\") " pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:27.865768 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.865713    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:27.870976 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.870955    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" podUID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" containerName="registry" containerID="cri-o://d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328" gracePeriod=30
Sep 17 17:58:27.904314 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:27.904284    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:28.105146 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.105126    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:58:28.175834 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175670    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-trusted-ca\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.175834 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-ca-trust-extracted\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.175834 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-certificates\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.175834 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-installation-pull-secrets\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.176149 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175858    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.176149 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175897    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-image-registry-private-configuration\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.176149 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd8f8\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-kube-api-access-fd8f8\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.176149 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.175983    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-bound-sa-token\") pod \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\" (UID: \"834bb5e9-1fd0-43bb-be1a-acea5e64f6df\") "
Sep 17 17:58:28.176331 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.176280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:28.176581 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.176546    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:58:28.177632 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.177610    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-w54ns"]
Sep 17 17:58:28.178830 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.178800    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:28.178980 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.178952    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:58:28.179088 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.178953    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:28.179088 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.179030    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:58:28.179428 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.179408    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-kube-api-access-fd8f8" (OuterVolumeSpecName: "kube-api-access-fd8f8") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "kube-api-access-fd8f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:58:28.180088 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:28.180057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c6ffdb_2319_45b4_9f0f_c9125886434b.slice/crio-91674260a8a9006e5f7907393eb2ab10230879fe3362c1745b853e71f2e003f7 WatchSource:0}: Error finding container 91674260a8a9006e5f7907393eb2ab10230879fe3362c1745b853e71f2e003f7: Status 404 returned error can't find the container with id 91674260a8a9006e5f7907393eb2ab10230879fe3362c1745b853e71f2e003f7
Sep 17 17:58:28.185028 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.185007    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "834bb5e9-1fd0-43bb-be1a-acea5e64f6df" (UID: "834bb5e9-1fd0-43bb-be1a-acea5e64f6df"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 17:58:28.209378 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.209357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:28.276800 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276782    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-ca-trust-extracted\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276800 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276799    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-certificates\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276927 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276810    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-installation-pull-secrets\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276927 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276821    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-registry-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276927 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276829    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-image-registry-private-configuration\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276927 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276838    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd8f8\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-kube-api-access-fd8f8\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276927 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276846    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-bound-sa-token\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.276927 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.276853    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/834bb5e9-1fd0-43bb-be1a-acea5e64f6df-trusted-ca\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:58:28.356263 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.356224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:28.743265 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.743239    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lqd7j"
Sep 17 17:58:28.786298 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.786266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-w54ns" event={"ID":"54c6ffdb-2319-45b4-9f0f-c9125886434b","Type":"ContainerStarted","Data":"91674260a8a9006e5f7907393eb2ab10230879fe3362c1745b853e71f2e003f7"}
Sep 17 17:58:28.787809 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.787785    2577 generic.go:356] "Generic (PLEG): container finished" podID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" containerID="d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328" exitCode=0
Sep 17 17:58:28.787928 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.787831    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-854597f79f-mt6wd"
Sep 17 17:58:28.787928 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.787882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" event={"ID":"834bb5e9-1fd0-43bb-be1a-acea5e64f6df","Type":"ContainerDied","Data":"d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328"}
Sep 17 17:58:28.788051 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.787942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-854597f79f-mt6wd" event={"ID":"834bb5e9-1fd0-43bb-be1a-acea5e64f6df","Type":"ContainerDied","Data":"bfcf7f7a2f2930d39032ae513ca9e7e308cd876674dc6dd821cfcab1a4fc5c0a"}
Sep 17 17:58:28.788051 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.787970    2577 scope.go:117] "RemoveContainer" containerID="d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328"
Sep 17 17:58:28.798388 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.798364    2577 scope.go:117] "RemoveContainer" containerID="d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328"
Sep 17 17:58:28.798787 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:58:28.798767    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328\": container with ID starting with d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328 not found: ID does not exist" containerID="d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328"
Sep 17 17:58:28.798865 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.798797    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328"} err="failed to get container status \"d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328\": rpc error: code = NotFound desc = could not find container \"d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328\": container with ID starting with d40e24f24d25c7fbc0a1baeb83f03112faccffa7a1230ee2a59593688ffb0328 not found: ID does not exist"
Sep 17 17:58:28.885533 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.885503    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-854597f79f-mt6wd"]
Sep 17 17:58:28.905807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:28.905781    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-854597f79f-mt6wd"]
Sep 17 17:58:29.267499 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:29.267465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:29.326697 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:29.326667    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" path="/var/lib/kubelet/pods/834bb5e9-1fd0-43bb-be1a-acea5e64f6df/volumes"
Sep 17 17:58:29.423258 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:29.423225    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:29.567119 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:29.567092    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:29.704018 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:29.703986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:29.934132 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:29.934000    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:31.485185 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:31.485148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:31.584475 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:31.584443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:35.099287 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:35.099253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:35.198263 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:35.198229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:35.419538 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:35.419452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:35.528538 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:35.528508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:37.689639 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:37.689605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:38.678593 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:38.678554    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:38.996736 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:38.996654    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:39.044775 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.044745    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9f8cfc9b5-lxlz5"]
Sep 17 17:58:39.045075 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.045053    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" containerName="registry"
Sep 17 17:58:39.045075 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.045073    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" containerName="registry"
Sep 17 17:58:39.045262 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.045127    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="834bb5e9-1fd0-43bb-be1a-acea5e64f6df" containerName="registry"
Sep 17 17:58:39.047400 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.047379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.062027 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.061988    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 17:58:39.062127 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.062044    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 17:58:39.062261 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.062246    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 17:58:39.062424 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.062407    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 17:58:39.062702 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.062686    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 17:58:39.063014 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.062998    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2829\""
Sep 17 17:58:39.089981 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.089958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f8cfc9b5-lxlz5"]
Sep 17 17:58:39.129104 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.129047    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:39.172823 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.172796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-serving-cert\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.172961 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.172827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-oauth-serving-cert\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.172961 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.172922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-oauth-config\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.173086 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.172967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjh2s\" (UniqueName: \"kubernetes.io/projected/59df95c7-f8d0-42aa-9993-47a7e97bee0d-kube-api-access-vjh2s\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.173086 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.172982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-config\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.173086 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.173065    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-service-ca\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.273592 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.273425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-oauth-config\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.273592 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.273484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjh2s\" (UniqueName: \"kubernetes.io/projected/59df95c7-f8d0-42aa-9993-47a7e97bee0d-kube-api-access-vjh2s\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.273592 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.273511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-config\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.273592 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.273555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-service-ca\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.273592 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.273584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-serving-cert\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.273817 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.273607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-oauth-serving-cert\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.278300 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.278273    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 17:58:39.278403 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.278364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 17:58:39.278483 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.278274    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 17:58:39.278679 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.278665    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 17:58:39.279953 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.279936    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 17:58:39.284630 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.284604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-service-ca\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.284727 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.284691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-oauth-serving-cert\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.284818 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.284799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-config\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.286544 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.286521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-oauth-config\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.287067 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.287047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-serving-cert\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.292529 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.292503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjh2s\" (UniqueName: \"kubernetes.io/projected/59df95c7-f8d0-42aa-9993-47a7e97bee0d-kube-api-access-vjh2s\") pod \"console-9f8cfc9b5-lxlz5\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") " pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:39.359204 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.359178    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2829\""
Sep 17 17:58:39.367380 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:39.367356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:40.592323 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:40.592281    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:40.592694 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:40.592355    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:58:40.760856 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:40.760822    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:40.871167 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:40.871091    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:41.513819 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:41.513789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:41.634344 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:41.634315    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.280154 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.280081    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9f8cfc9b5-lxlz5"]
Sep 17 17:58:44.284386 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:44.284358    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59df95c7_f8d0_42aa_9993_47a7e97bee0d.slice/crio-62cb35b01163d23a746d429cbf8340a42f3f190537f53080528bf59d65549aa5 WatchSource:0}: Error finding container 62cb35b01163d23a746d429cbf8340a42f3f190537f53080528bf59d65549aa5: Status 404 returned error can't find the container with id 62cb35b01163d23a746d429cbf8340a42f3f190537f53080528bf59d65549aa5
Sep 17 17:58:44.753284 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.753241    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.859973 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.859926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f8cfc9b5-lxlz5" event={"ID":"59df95c7-f8d0-42aa-9993-47a7e97bee0d","Type":"ContainerStarted","Data":"62cb35b01163d23a746d429cbf8340a42f3f190537f53080528bf59d65549aa5"}
Sep 17 17:58:44.863771 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.863664    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-w54ns" event={"ID":"54c6ffdb-2319-45b4-9f0f-c9125886434b","Type":"ContainerStarted","Data":"ae3a1e4d70f5a27bb2e89f3c2be2b298e5ca4810f1128478aa5a171415c143b8"}
Sep 17 17:58:44.864255 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.864232    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:44.866803 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.866719    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:44.880555 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.880500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-w54ns"
Sep 17 17:58:44.891220 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:44.890757    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-w54ns" podStartSLOduration=1.977634051 podStartE2EDuration="17.890737484s" totalImagesPullingTime="15.913103433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:44.888661644 +0000 UTC m=+127.641401975" watchObservedRunningTime="2026-09-17 17:58:44.890737484 +0000 UTC m=+127.643477812"
Sep 17 17:58:45.741178 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:45.741096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:49.074818 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.074780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:58:49.077739 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.077691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de9a5ba3-4824-48c9-9498-d6c8963cada3-metrics-certs\") pod \"network-metrics-daemon-q6mtq\" (UID: \"de9a5ba3-4824-48c9-9498-d6c8963cada3\") " pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:58:49.233807 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.233769    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j7pjs\""
Sep 17 17:58:49.240623 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.240596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q6mtq"
Sep 17 17:58:49.459554 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.459483    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fc5574cf-7d4n4"]
Sep 17 17:58:49.483489 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.483392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fc5574cf-7d4n4"]
Sep 17 17:58:49.484392 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.483745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.495031 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.494316    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 17:58:49.579557 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-service-ca\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.579740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-serving-cert\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.579740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579686    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hngl\" (UniqueName: \"kubernetes.io/projected/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-kube-api-access-7hngl\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.579740 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-oauth-serving-cert\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.579896 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-oauth-config\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.579896 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-config\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.579896 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.579839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-trusted-ca-bundle\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680570 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-service-ca\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-serving-cert\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hngl\" (UniqueName: \"kubernetes.io/projected/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-kube-api-access-7hngl\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-oauth-serving-cert\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-oauth-config\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-config\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.680695 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.680679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-trusted-ca-bundle\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.681662 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.681635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-config\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.681950 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.681891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-oauth-serving-cert\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.682065 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.681953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-service-ca\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.682209 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.682191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-trusted-ca-bundle\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.686082 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.686059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-oauth-config\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.686462 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.686437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-serving-cert\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.692398 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.692376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hngl\" (UniqueName: \"kubernetes.io/projected/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-kube-api-access-7hngl\") pod \"console-7fc5574cf-7d4n4\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") " pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.797953 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.797923    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:49.896978 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:49.896950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q6mtq"]
Sep 17 17:58:49.916886 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:49.916860    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9a5ba3_4824_48c9_9498_d6c8963cada3.slice/crio-ddc4541409fea74958d7f155c7392f362119694ee5eac4e0392c08c5fe4eda78 WatchSource:0}: Error finding container ddc4541409fea74958d7f155c7392f362119694ee5eac4e0392c08c5fe4eda78: Status 404 returned error can't find the container with id ddc4541409fea74958d7f155c7392f362119694ee5eac4e0392c08c5fe4eda78
Sep 17 17:58:50.226458 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:50.226330    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fc5574cf-7d4n4"]
Sep 17 17:58:50.228943 ip-10-0-133-113 kubenswrapper[2577]: W0917 17:58:50.228889    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1aa507_3ccb_4838_ac75_9ab18fa6d9c0.slice/crio-6a615797c5756b68422373c3b0fbfd77a3e3b96617a850101983050804928311 WatchSource:0}: Error finding container 6a615797c5756b68422373c3b0fbfd77a3e3b96617a850101983050804928311: Status 404 returned error can't find the container with id 6a615797c5756b68422373c3b0fbfd77a3e3b96617a850101983050804928311
Sep 17 17:58:50.894130 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:50.894063    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6mtq" event={"ID":"de9a5ba3-4824-48c9-9498-d6c8963cada3","Type":"ContainerStarted","Data":"ddc4541409fea74958d7f155c7392f362119694ee5eac4e0392c08c5fe4eda78"}
Sep 17 17:58:50.896166 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:50.896132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f8cfc9b5-lxlz5" event={"ID":"59df95c7-f8d0-42aa-9993-47a7e97bee0d","Type":"ContainerStarted","Data":"2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45"}
Sep 17 17:58:50.898441 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:50.898353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc5574cf-7d4n4" event={"ID":"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0","Type":"ContainerStarted","Data":"cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2"}
Sep 17 17:58:50.898441 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:50.898395    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc5574cf-7d4n4" event={"ID":"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0","Type":"ContainerStarted","Data":"6a615797c5756b68422373c3b0fbfd77a3e3b96617a850101983050804928311"}
Sep 17 17:58:50.928856 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:50.928791    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9f8cfc9b5-lxlz5" podStartSLOduration=6.264766533 podStartE2EDuration="11.928773427s" totalImagesPullingTime="5.664006894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:50.927946198 +0000 UTC m=+133.680686526" watchObservedRunningTime="2026-09-17 17:58:50.928773427 +0000 UTC m=+133.681513755"
Sep 17 17:58:51.905763 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:51.904945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6mtq" event={"ID":"de9a5ba3-4824-48c9-9498-d6c8963cada3","Type":"ContainerStarted","Data":"27edde3a8264d3e3edef0c2ab22b0badfdbc2637ea40d0d276bbca941b6bc148"}
Sep 17 17:58:52.911714 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:52.911680    2577 generic.go:356] "Generic (PLEG): container finished" podID="98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4" containerID="a7966830b8b1e59fe399af50f1f968f03a54fc2155bf94ea3fefce87d1b22192" exitCode=0
Sep 17 17:58:52.912152 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:52.911759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr" event={"ID":"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4","Type":"ContainerDied","Data":"a7966830b8b1e59fe399af50f1f968f03a54fc2155bf94ea3fefce87d1b22192"}
Sep 17 17:58:52.912193 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:52.912156    2577 scope.go:117] "RemoveContainer" containerID="a7966830b8b1e59fe399af50f1f968f03a54fc2155bf94ea3fefce87d1b22192"
Sep 17 17:58:52.914206 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:52.914173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q6mtq" event={"ID":"de9a5ba3-4824-48c9-9498-d6c8963cada3","Type":"ContainerStarted","Data":"82240cf38b1c1daf80f0576e659d9782067cecb0f1b21723f67c638d414d82a1"}
Sep 17 17:58:52.947712 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:52.947662    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fc5574cf-7d4n4" podStartSLOduration=3.947648004 podStartE2EDuration="3.947648004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:58:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:50.973516429 +0000 UTC m=+133.726256756" watchObservedRunningTime="2026-09-17 17:58:52.947648004 +0000 UTC m=+135.700388329"
Sep 17 17:58:52.990231 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:52.990183    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q6mtq" podStartSLOduration=132.328511917 podStartE2EDuration="2m13.990166146s" totalImagesPullingTime="1.661654229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 17:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 17:58:52.989060374 +0000 UTC m=+135.741800703" watchObservedRunningTime="2026-09-17 17:58:52.990166146 +0000 UTC m=+135.742906475"
Sep 17 17:58:53.175388 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:53.175308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:53.295118 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:53.295080    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:53.924425 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:53.924386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-4l8gr" event={"ID":"98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4","Type":"ContainerStarted","Data":"5e01c090eab4f1565c02f2ff96afc3e46f09c81b28b7c939f52c57313a2cca0d"}
Sep 17 17:58:56.580851 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:56.580810    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:56.723481 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:56.723437    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:57.906886 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:57.906855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:58.088731 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:58.088702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:58.993545 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:58.993513    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:59.101166 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.101133    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:58:59.367950 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.367926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:59.368088 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.367966    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:59.372405 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.372387    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:59.798802 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.798762    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:59.799004 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.798851    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:59.803784 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.803754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:58:59.949415 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.949384    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:58:59.949834 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:58:59.949816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 17:59:00.068842 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:00.068771    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f8cfc9b5-lxlz5"]
Sep 17 17:59:00.217866 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:00.217836    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:00.335060 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:00.334992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:00.435406 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:00.435383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:00.597497 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:00.597445    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:59:00.601105 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:00.601086    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bbcd4674c-4zh24"
Sep 17 17:59:01.019340 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:01.019275    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:01.135286 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:01.135260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:02.957025 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:02.956958    2577 generic.go:356] "Generic (PLEG): container finished" podID="4118c6b4-71d1-4d1b-834c-a5c8601a1a82" containerID="000212cd79ab6f972a2750aa3a8790d410ce61f2fc76e286e6b2505693c15563" exitCode=0
Sep 17 17:59:02.957025 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:02.957007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85" event={"ID":"4118c6b4-71d1-4d1b-834c-a5c8601a1a82","Type":"ContainerDied","Data":"000212cd79ab6f972a2750aa3a8790d410ce61f2fc76e286e6b2505693c15563"}
Sep 17 17:59:02.957425 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:02.957238    2577 scope.go:117] "RemoveContainer" containerID="000212cd79ab6f972a2750aa3a8790d410ce61f2fc76e286e6b2505693c15563"
Sep 17 17:59:03.962670 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:03.962637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-p8b85" event={"ID":"4118c6b4-71d1-4d1b-834c-a5c8601a1a82","Type":"ContainerStarted","Data":"41ec12ccca16118446cd634bd9cd482cadf13fc1b4d5bf7abdbbbeea49c997b8"}
Sep 17 17:59:11.510940 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:11.510890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:11.609005 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:11.608976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:26.970349 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:26.970249    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9f8cfc9b5-lxlz5" podUID="59df95c7-f8d0-42aa-9993-47a7e97bee0d" containerName="console" containerID="cri-o://2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45" gracePeriod=15
Sep 17 17:59:27.243132 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.243082    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:59:27.365665 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.365634    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-oauth-serving-cert\") pod \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") "
Sep 17 17:59:27.365781 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.365681    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjh2s\" (UniqueName: \"kubernetes.io/projected/59df95c7-f8d0-42aa-9993-47a7e97bee0d-kube-api-access-vjh2s\") pod \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") "
Sep 17 17:59:27.365781 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.365722    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-config\") pod \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") "
Sep 17 17:59:27.365781 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.365758    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-oauth-config\") pod \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") "
Sep 17 17:59:27.365958 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.365789    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-serving-cert\") pod \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") "
Sep 17 17:59:27.365958 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.365829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-service-ca\") pod \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\" (UID: \"59df95c7-f8d0-42aa-9993-47a7e97bee0d\") "
Sep 17 17:59:27.366091 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.366065    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "59df95c7-f8d0-42aa-9993-47a7e97bee0d" (UID: "59df95c7-f8d0-42aa-9993-47a7e97bee0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:27.366243 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.366217    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-config" (OuterVolumeSpecName: "console-config") pod "59df95c7-f8d0-42aa-9993-47a7e97bee0d" (UID: "59df95c7-f8d0-42aa-9993-47a7e97bee0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:27.366356 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.366309    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "59df95c7-f8d0-42aa-9993-47a7e97bee0d" (UID: "59df95c7-f8d0-42aa-9993-47a7e97bee0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 17:59:27.368106 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.368080    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59df95c7-f8d0-42aa-9993-47a7e97bee0d-kube-api-access-vjh2s" (OuterVolumeSpecName: "kube-api-access-vjh2s") pod "59df95c7-f8d0-42aa-9993-47a7e97bee0d" (UID: "59df95c7-f8d0-42aa-9993-47a7e97bee0d"). InnerVolumeSpecName "kube-api-access-vjh2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 17:59:27.368185 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.368116    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "59df95c7-f8d0-42aa-9993-47a7e97bee0d" (UID: "59df95c7-f8d0-42aa-9993-47a7e97bee0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:27.368185 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.368136    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "59df95c7-f8d0-42aa-9993-47a7e97bee0d" (UID: "59df95c7-f8d0-42aa-9993-47a7e97bee0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 17:59:27.467421 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.467392    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjh2s\" (UniqueName: \"kubernetes.io/projected/59df95c7-f8d0-42aa-9993-47a7e97bee0d-kube-api-access-vjh2s\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:59:27.467421 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.467421    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:59:27.467565 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.467434    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-oauth-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:59:27.467565 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.467446    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/59df95c7-f8d0-42aa-9993-47a7e97bee0d-console-serving-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:59:27.467565 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.467461    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-service-ca\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:59:27.467565 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:27.467479    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/59df95c7-f8d0-42aa-9993-47a7e97bee0d-oauth-serving-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 17:59:28.051268 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.051236    2577 generic.go:356] "Generic (PLEG): container finished" podID="59df95c7-f8d0-42aa-9993-47a7e97bee0d" containerID="2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45" exitCode=0
Sep 17 17:59:28.051662 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.051277    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9f8cfc9b5-lxlz5"
Sep 17 17:59:28.051662 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.051290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f8cfc9b5-lxlz5" event={"ID":"59df95c7-f8d0-42aa-9993-47a7e97bee0d","Type":"ContainerDied","Data":"2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45"}
Sep 17 17:59:28.051662 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.051337    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9f8cfc9b5-lxlz5" event={"ID":"59df95c7-f8d0-42aa-9993-47a7e97bee0d","Type":"ContainerDied","Data":"62cb35b01163d23a746d429cbf8340a42f3f190537f53080528bf59d65549aa5"}
Sep 17 17:59:28.051662 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.051367    2577 scope.go:117] "RemoveContainer" containerID="2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45"
Sep 17 17:59:28.060042 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.059981    2577 scope.go:117] "RemoveContainer" containerID="2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45"
Sep 17 17:59:28.060268 ip-10-0-133-113 kubenswrapper[2577]: E0917 17:59:28.060253    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45\": container with ID starting with 2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45 not found: ID does not exist" containerID="2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45"
Sep 17 17:59:28.060317 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.060275    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45"} err="failed to get container status \"2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45\": rpc error: code = NotFound desc = could not find container \"2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45\": container with ID starting with 2239bdfd1f7b81415df3437c51f817e7ab0b1a7f83934de7cbaa5a28b48a6c45 not found: ID does not exist"
Sep 17 17:59:28.076854 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.076828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9f8cfc9b5-lxlz5"]
Sep 17 17:59:28.083787 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:28.083770    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9f8cfc9b5-lxlz5"]
Sep 17 17:59:29.324153 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:29.324116    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59df95c7-f8d0-42aa-9993-47a7e97bee0d" path="/var/lib/kubelet/pods/59df95c7-f8d0-42aa-9993-47a7e97bee0d/volumes"
Sep 17 17:59:32.265501 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:32.265469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:32.477834 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:32.477807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:44.113212 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:44.113189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:44.218223 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:44.218193    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:44.286988 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:44.286923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:54.098792 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:54.098755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:56.565226 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:56.565185    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 17:59:56.682367 ip-10-0-133-113 kubenswrapper[2577]: I0917 17:59:56.682322    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:19.094109 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.094077    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c5b6f89b4-dctzg"]
Sep 17 18:00:19.094495 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.094351    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59df95c7-f8d0-42aa-9993-47a7e97bee0d" containerName="console"
Sep 17 18:00:19.094495 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.094363    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59df95c7-f8d0-42aa-9993-47a7e97bee0d" containerName="console"
Sep 17 18:00:19.094495 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.094421    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59df95c7-f8d0-42aa-9993-47a7e97bee0d" containerName="console"
Sep 17 18:00:19.096318 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.096297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.108876 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.108852    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5b6f89b4-dctzg"]
Sep 17 18:00:19.117502 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-serving-cert\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.117635 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2n4x\" (UniqueName: \"kubernetes.io/projected/03c3c65a-2843-47e1-b4db-d89e417a65f1-kube-api-access-g2n4x\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.117635 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-service-ca\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.117635 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-oauth-config\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.117805 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-oauth-serving-cert\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.117805 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-config\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.117805 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.117738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-trusted-ca-bundle\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.171107 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.171082    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:19.219442 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-serving-cert\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.219555 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2n4x\" (UniqueName: \"kubernetes.io/projected/03c3c65a-2843-47e1-b4db-d89e417a65f1-kube-api-access-g2n4x\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.219555 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-service-ca\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.219673 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-oauth-config\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.219673 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-oauth-serving-cert\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.219673 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-config\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.219813 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.219730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-trusted-ca-bundle\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.222071 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.222046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-trusted-ca-bundle\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.224708 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.224674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-config\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.224807 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.224746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-oauth-serving-cert\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.225050 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.224842    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-service-ca\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.225050 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.225027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-serving-cert\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.226547 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.226527    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-oauth-config\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.233454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.233435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2n4x\" (UniqueName: \"kubernetes.io/projected/03c3c65a-2843-47e1-b4db-d89e417a65f1-kube-api-access-g2n4x\") pod \"console-7c5b6f89b4-dctzg\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") " pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.234698 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.234676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:19.296280 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.296257    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:19.405623 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.405573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:19.674000 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.673936    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5b6f89b4-dctzg"]
Sep 17 18:00:19.677334 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:00:19.677309    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c3c65a_2843_47e1_b4db_d89e417a65f1.slice/crio-dd291a6e7daa15592a3848d97ce10acb2577074b4284314ddbfe74cceefbcb01 WatchSource:0}: Error finding container dd291a6e7daa15592a3848d97ce10acb2577074b4284314ddbfe74cceefbcb01: Status 404 returned error can't find the container with id dd291a6e7daa15592a3848d97ce10acb2577074b4284314ddbfe74cceefbcb01
Sep 17 18:00:19.887994 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.887961    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:19.953231 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:19.953170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:20.242470 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:20.242404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5b6f89b4-dctzg" event={"ID":"03c3c65a-2843-47e1-b4db-d89e417a65f1","Type":"ContainerStarted","Data":"78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca"}
Sep 17 18:00:20.242470 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:20.242446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5b6f89b4-dctzg" event={"ID":"03c3c65a-2843-47e1-b4db-d89e417a65f1","Type":"ContainerStarted","Data":"dd291a6e7daa15592a3848d97ce10acb2577074b4284314ddbfe74cceefbcb01"}
Sep 17 18:00:20.261385 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:20.261346    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c5b6f89b4-dctzg" podStartSLOduration=1.2613339909999999 podStartE2EDuration="1.261333991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:00:20.26034078 +0000 UTC m=+223.013081108" watchObservedRunningTime="2026-09-17 18:00:20.261333991 +0000 UTC m=+223.014074318"
Sep 17 18:00:29.406706 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:29.406679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:29.407192 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:29.406724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:29.411046 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:29.411025    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:30.280510 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:30.280486    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:00:30.371840 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:30.371810    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fc5574cf-7d4n4"]
Sep 17 18:00:30.533645 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:30.533541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:30.631013 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:30.630983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:30.746877 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:30.746850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:54.739113 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:54.739013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:54.840310 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:54.840283    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:54.895107 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:54.895081    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:00:55.391280 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.391253    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7fc5574cf-7d4n4" podUID="ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" containerName="console" containerID="cri-o://cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2" gracePeriod=15
Sep 17 18:00:55.632973 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.632952    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 18:00:55.699648 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.699585    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"]
Sep 17 18:00:55.699874 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.699863    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" containerName="console"
Sep 17 18:00:55.699939 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.699876    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" containerName="console"
Sep 17 18:00:55.699939 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.699934    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" containerName="console"
Sep 17 18:00:55.701831 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.701816    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.705137 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.705116    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 17 18:00:55.705378 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.705363    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d5wn9\""
Sep 17 18:00:55.705430 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.705365    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 17 18:00:55.713078 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.713059    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"]
Sep 17 18:00:55.754086 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hngl\" (UniqueName: \"kubernetes.io/projected/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-kube-api-access-7hngl\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754104    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-trusted-ca-bundle\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754136    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-serving-cert\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754169    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-oauth-config\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754224    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-service-ca\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754246    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-config\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754282    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-oauth-serving-cert\") pod \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\" (UID: \"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0\") "
Sep 17 18:00:55.754750 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.754750 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.754750 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qhb8\" (UniqueName: \"kubernetes.io/projected/cac7ca99-fe94-4b11-a5f8-242123277eb3-kube-api-access-5qhb8\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.754750 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754560    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:00:55.754750 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.754651    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-trusted-ca-bundle\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.755048 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.755027    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-config" (OuterVolumeSpecName: "console-config") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:00:55.755214 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.755145    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:00:55.755214 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.755153    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:00:55.756454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.756431    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-kube-api-access-7hngl" (OuterVolumeSpecName: "kube-api-access-7hngl") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "kube-api-access-7hngl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:00:55.756454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.756436    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:00:55.756629 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.756608    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" (UID: "ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:00:55.855504 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.855504 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qhb8\" (UniqueName: \"kubernetes.io/projected/cac7ca99-fe94-4b11-a5f8-242123277eb3-kube-api-access-5qhb8\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855558    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855596    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hngl\" (UniqueName: \"kubernetes.io/projected/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-kube-api-access-7hngl\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855605    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-serving-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855613    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-oauth-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855622    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-service-ca\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855631    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-console-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.855647 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855642    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0-oauth-serving-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:00:55.855962 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-bundle\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.855962 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.855824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-util\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:55.868993 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:55.868972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qhb8\" (UniqueName: \"kubernetes.io/projected/cac7ca99-fe94-4b11-a5f8-242123277eb3-kube-api-access-5qhb8\") pod \"1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") " pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:56.010691 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.010630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:00:56.279311 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.279245    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"]
Sep 17 18:00:56.281877 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:00:56.281853    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac7ca99_fe94_4b11_a5f8_242123277eb3.slice/crio-e67ebe7ecd3529e3294c2ad24434251d138314aa5cc95a4964030b51e0aeae1a WatchSource:0}: Error finding container e67ebe7ecd3529e3294c2ad24434251d138314aa5cc95a4964030b51e0aeae1a: Status 404 returned error can't find the container with id e67ebe7ecd3529e3294c2ad24434251d138314aa5cc95a4964030b51e0aeae1a
Sep 17 18:00:56.361545 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.361517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh" event={"ID":"cac7ca99-fe94-4b11-a5f8-242123277eb3","Type":"ContainerStarted","Data":"e67ebe7ecd3529e3294c2ad24434251d138314aa5cc95a4964030b51e0aeae1a"}
Sep 17 18:00:56.362707 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.362682    2577 generic.go:356] "Generic (PLEG): container finished" podID="ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" containerID="cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2" exitCode=0
Sep 17 18:00:56.362787 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.362745    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fc5574cf-7d4n4"
Sep 17 18:00:56.362835 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.362743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc5574cf-7d4n4" event={"ID":"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0","Type":"ContainerDied","Data":"cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2"}
Sep 17 18:00:56.362874 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.362855    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fc5574cf-7d4n4" event={"ID":"ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0","Type":"ContainerDied","Data":"6a615797c5756b68422373c3b0fbfd77a3e3b96617a850101983050804928311"}
Sep 17 18:00:56.362932 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.362879    2577 scope.go:117] "RemoveContainer" containerID="cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2"
Sep 17 18:00:56.371417 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.371403    2577 scope.go:117] "RemoveContainer" containerID="cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2"
Sep 17 18:00:56.371650 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:00:56.371632    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2\": container with ID starting with cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2 not found: ID does not exist" containerID="cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2"
Sep 17 18:00:56.371705 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.371660    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2"} err="failed to get container status \"cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2\": rpc error: code = NotFound desc = could not find container \"cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2\": container with ID starting with cfca69e60be0c6263f1c43ac44504091f204f5dcb61d976b29f6cefc9d9806d2 not found: ID does not exist"
Sep 17 18:00:56.383759 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.383740    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fc5574cf-7d4n4"]
Sep 17 18:00:56.387551 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:56.387531    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fc5574cf-7d4n4"]
Sep 17 18:00:57.325279 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:00:57.325245    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0" path="/var/lib/kubelet/pods/ba1aa507-3ccb-4838-ac75-9ab18fa6d9c0/volumes"
Sep 17 18:01:03.396426 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:03.396397    2577 generic.go:356] "Generic (PLEG): container finished" podID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerID="97a498d9737c44bf1567db711007d023e2a19a949300230338070b63db45d4bc" exitCode=0
Sep 17 18:01:03.396749 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:03.396483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh" event={"ID":"cac7ca99-fe94-4b11-a5f8-242123277eb3","Type":"ContainerDied","Data":"97a498d9737c44bf1567db711007d023e2a19a949300230338070b63db45d4bc"}
Sep 17 18:01:06.408525 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:06.408497    2577 generic.go:356] "Generic (PLEG): container finished" podID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerID="93f8d4ca341bb6647278be04edbd835218cdfa208c6ed4afcbada1ee3aa86fb4" exitCode=0
Sep 17 18:01:06.408809 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:06.408552    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh" event={"ID":"cac7ca99-fe94-4b11-a5f8-242123277eb3","Type":"ContainerDied","Data":"93f8d4ca341bb6647278be04edbd835218cdfa208c6ed4afcbada1ee3aa86fb4"}
Sep 17 18:01:13.441964 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:13.441931    2577 generic.go:356] "Generic (PLEG): container finished" podID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerID="778c2f3363ed0cbb943adeb1b0cf85b63687b43267855aa2787b734f1e817ecb" exitCode=0
Sep 17 18:01:13.442315 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:13.442012    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh" event={"ID":"cac7ca99-fe94-4b11-a5f8-242123277eb3","Type":"ContainerDied","Data":"778c2f3363ed0cbb943adeb1b0cf85b63687b43267855aa2787b734f1e817ecb"}
Sep 17 18:01:14.566670 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.566649    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:01:14.707764 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.707708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-util\") pod \"cac7ca99-fe94-4b11-a5f8-242123277eb3\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") "
Sep 17 18:01:14.707764 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.707741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-bundle\") pod \"cac7ca99-fe94-4b11-a5f8-242123277eb3\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") "
Sep 17 18:01:14.707985 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.707769    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qhb8\" (UniqueName: \"kubernetes.io/projected/cac7ca99-fe94-4b11-a5f8-242123277eb3-kube-api-access-5qhb8\") pod \"cac7ca99-fe94-4b11-a5f8-242123277eb3\" (UID: \"cac7ca99-fe94-4b11-a5f8-242123277eb3\") "
Sep 17 18:01:14.708475 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.708451    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-bundle" (OuterVolumeSpecName: "bundle") pod "cac7ca99-fe94-4b11-a5f8-242123277eb3" (UID: "cac7ca99-fe94-4b11-a5f8-242123277eb3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:01:14.710080 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.710057    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cac7ca99-fe94-4b11-a5f8-242123277eb3-kube-api-access-5qhb8" (OuterVolumeSpecName: "kube-api-access-5qhb8") pod "cac7ca99-fe94-4b11-a5f8-242123277eb3" (UID: "cac7ca99-fe94-4b11-a5f8-242123277eb3"). InnerVolumeSpecName "kube-api-access-5qhb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:01:14.712012 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.711986    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-util" (OuterVolumeSpecName: "util") pod "cac7ca99-fe94-4b11-a5f8-242123277eb3" (UID: "cac7ca99-fe94-4b11-a5f8-242123277eb3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 18:01:14.808872 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.808844    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-util\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:01:14.808969 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.808888    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cac7ca99-fe94-4b11-a5f8-242123277eb3-bundle\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:01:14.808969 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:14.808897    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qhb8\" (UniqueName: \"kubernetes.io/projected/cac7ca99-fe94-4b11-a5f8-242123277eb3-kube-api-access-5qhb8\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:01:15.451897 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:15.451867    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh" event={"ID":"cac7ca99-fe94-4b11-a5f8-242123277eb3","Type":"ContainerDied","Data":"e67ebe7ecd3529e3294c2ad24434251d138314aa5cc95a4964030b51e0aeae1a"}
Sep 17 18:01:15.452011 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:15.451922    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/1acd376c2f780381bc434f5f1985f786a96c8309f7a005b52ed03f0c1atzggh"
Sep 17 18:01:15.452011 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:15.451942    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e67ebe7ecd3529e3294c2ad24434251d138314aa5cc95a4964030b51e0aeae1a"
Sep 17 18:01:16.934624 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:16.934590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:17.026955 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:17.026928    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:18.734434 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734407    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"]
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734659    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="util"
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734669    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="util"
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734684    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="pull"
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734688    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="pull"
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734695    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="extract"
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734700    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="extract"
Sep 17 18:01:18.734822 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.734748    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cac7ca99-fe94-4b11-a5f8-242123277eb3" containerName="extract"
Sep 17 18:01:18.771662 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.771641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"]
Sep 17 18:01:18.771793 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.771721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:18.776325 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.776303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Sep 17 18:01:18.776665 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.776649    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Sep 17 18:01:18.777323 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.777306    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Sep 17 18:01:18.777592 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.777575    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-hz8tz\""
Sep 17 18:01:18.838196 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.838164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/123f38b7-0e1e-4844-b248-a16ca3ac705c-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-cjdbq\" (UID: \"123f38b7-0e1e-4844-b248-a16ca3ac705c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:18.838308 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.838205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxb7s\" (UniqueName: \"kubernetes.io/projected/123f38b7-0e1e-4844-b248-a16ca3ac705c-kube-api-access-pxb7s\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-cjdbq\" (UID: \"123f38b7-0e1e-4844-b248-a16ca3ac705c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:18.938971 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.938947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxb7s\" (UniqueName: \"kubernetes.io/projected/123f38b7-0e1e-4844-b248-a16ca3ac705c-kube-api-access-pxb7s\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-cjdbq\" (UID: \"123f38b7-0e1e-4844-b248-a16ca3ac705c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:18.939079 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.939060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/123f38b7-0e1e-4844-b248-a16ca3ac705c-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-cjdbq\" (UID: \"123f38b7-0e1e-4844-b248-a16ca3ac705c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:18.941391 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.941375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/123f38b7-0e1e-4844-b248-a16ca3ac705c-certificates\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-cjdbq\" (UID: \"123f38b7-0e1e-4844-b248-a16ca3ac705c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:18.947834 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:18.947809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxb7s\" (UniqueName: \"kubernetes.io/projected/123f38b7-0e1e-4844-b248-a16ca3ac705c-kube-api-access-pxb7s\") pod \"custom-metrics-autoscaler-operator-566c9cd69c-cjdbq\" (UID: \"123f38b7-0e1e-4844-b248-a16ca3ac705c\") " pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:19.081161 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:19.081137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:19.371864 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:01:19.371821    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123f38b7_0e1e_4844_b248_a16ca3ac705c.slice/crio-84c351ed572eb8d126beea9ccc9271f903a930e076f4d223c507e1acb2c37b24 WatchSource:0}: Error finding container 84c351ed572eb8d126beea9ccc9271f903a930e076f4d223c507e1acb2c37b24: Status 404 returned error can't find the container with id 84c351ed572eb8d126beea9ccc9271f903a930e076f4d223c507e1acb2c37b24
Sep 17 18:01:19.374885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:19.374858    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"]
Sep 17 18:01:19.467441 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:19.467415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq" event={"ID":"123f38b7-0e1e-4844-b248-a16ca3ac705c","Type":"ContainerStarted","Data":"84c351ed572eb8d126beea9ccc9271f903a930e076f4d223c507e1acb2c37b24"}
Sep 17 18:01:39.270834 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:39.270805    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:01:39.274212 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:39.274192    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:01:39.280169 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:39.280147    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:01:39.282954 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:39.282934    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 18:01:39.284098 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:39.284081    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:01:44.561641 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:44.561568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq" event={"ID":"123f38b7-0e1e-4844-b248-a16ca3ac705c","Type":"ContainerStarted","Data":"a84bffd4b14b7da513afb248a3b7a1c391e07e906dd34bc9204f61472d11a82a"}
Sep 17 18:01:44.562002 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:44.561659    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:01:44.584342 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:44.584287    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq" podStartSLOduration=1.656057407 podStartE2EDuration="26.584268172s" totalImagesPullingTime="24.928210765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:01:44.58106551 +0000 UTC m=+307.333805837" watchObservedRunningTime="2026-09-17 18:01:44.584268172 +0000 UTC m=+307.337008503"
Sep 17 18:01:44.752121 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:44.752098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.053026 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.052999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.067724 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.067691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-579c8958f7-5vh8f"]
Sep 17 18:01:45.070027 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.070013    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.073722 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.073692    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Sep 17 18:01:45.073843 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.073755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8z42h\""
Sep 17 18:01:45.075073 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.075058    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Sep 17 18:01:45.089939 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.089916    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-5vh8f"]
Sep 17 18:01:45.208915 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.208877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-certificates\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.209026 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.208924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-cabundle0\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.209026 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.208957    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2d4r\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-kube-api-access-n2d4r\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.259220 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.259199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.310320 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.310263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-certificates\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.310320 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.310291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-cabundle0\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.310477 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.310319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2d4r\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-kube-api-access-n2d4r\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.310477 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:01:45.310417    2577 secret.go:281] references non-existent secret key: ca.crt
Sep 17 18:01:45.310477 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:01:45.310434    2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Sep 17 18:01:45.310477 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:01:45.310443    2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-579c8958f7-5vh8f: references non-existent secret key: ca.crt
Sep 17 18:01:45.310666 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:01:45.310494    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-certificates podName:8e948e4b-36b9-4c4a-ab32-0a27da65f97b nodeName:}" failed. No retries permitted until 2026-09-17 18:01:45.810479267 +0000 UTC m=+308.563219587 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-certificates") pod "keda-operator-579c8958f7-5vh8f" (UID: "8e948e4b-36b9-4c4a-ab32-0a27da65f97b") : references non-existent secret key: ca.crt
Sep 17 18:01:45.311066 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.311047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-cabundle0\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.320177 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.320155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2d4r\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-kube-api-access-n2d4r\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.363087 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.363066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.486678 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.486653    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"]
Sep 17 18:01:45.488854 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.488841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.493383 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.493364    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Sep 17 18:01:45.507614 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.507593    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"]
Sep 17 18:01:45.552213 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.552179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.613607 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.613554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/4d5e59c2-2d23-4f32-91a0-c673a927eeec-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.613889 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.613607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5fhz\" (UniqueName: \"kubernetes.io/projected/4d5e59c2-2d23-4f32-91a0-c673a927eeec-kube-api-access-c5fhz\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.613889 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.613666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4d5e59c2-2d23-4f32-91a0-c673a927eeec-certificates\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.710401 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.710374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.714098 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.714079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5fhz\" (UniqueName: \"kubernetes.io/projected/4d5e59c2-2d23-4f32-91a0-c673a927eeec-kube-api-access-c5fhz\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.714194 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.714137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4d5e59c2-2d23-4f32-91a0-c673a927eeec-certificates\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.714252 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.714193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/4d5e59c2-2d23-4f32-91a0-c673a927eeec-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.714579 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.714560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/4d5e59c2-2d23-4f32-91a0-c673a927eeec-temp-vol\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.717157 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.717138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4d5e59c2-2d23-4f32-91a0-c673a927eeec-certificates\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.730728 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.730708    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5fhz\" (UniqueName: \"kubernetes.io/projected/4d5e59c2-2d23-4f32-91a0-c673a927eeec-kube-api-access-c5fhz\") pod \"keda-metrics-apiserver-77857b7b98-gs8gq\" (UID: \"4d5e59c2-2d23-4f32-91a0-c673a927eeec\") " pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.798577 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.798544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:01:45.805166 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.805135    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:45.815645 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.815617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-certificates\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.818761 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.818739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8e948e4b-36b9-4c4a-ab32-0a27da65f97b-certificates\") pod \"keda-operator-579c8958f7-5vh8f\" (UID: \"8e948e4b-36b9-4c4a-ab32-0a27da65f97b\") " pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:45.980309 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:45.980225    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:46.085219 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.085173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"]
Sep 17 18:01:46.089709 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.089680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:46.091250 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:01:46.091226    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5e59c2_2d23_4f32_91a0_c673a927eeec.slice/crio-123d1edb1a6f2c498783a5b9baed9081f97007ee5dfaf4b6b2c6f6b4f213f864 WatchSource:0}: Error finding container 123d1edb1a6f2c498783a5b9baed9081f97007ee5dfaf4b6b2c6f6b4f213f864: Status 404 returned error can't find the container with id 123d1edb1a6f2c498783a5b9baed9081f97007ee5dfaf4b6b2c6f6b4f213f864
Sep 17 18:01:46.092552 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.092535    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 18:01:46.267358 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.267239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-579c8958f7-5vh8f"]
Sep 17 18:01:46.271233 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:01:46.271208    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e948e4b_36b9_4c4a_ab32_0a27da65f97b.slice/crio-aec067f5804c6a0762cf116252ffb4e765d63e9063719a648490846d1e86bcf1 WatchSource:0}: Error finding container aec067f5804c6a0762cf116252ffb4e765d63e9063719a648490846d1e86bcf1: Status 404 returned error can't find the container with id aec067f5804c6a0762cf116252ffb4e765d63e9063719a648490846d1e86bcf1
Sep 17 18:01:46.300733 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.300702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:46.396917 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.396873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:46.499859 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.499830    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:46.570780 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.570749    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-5vh8f" event={"ID":"8e948e4b-36b9-4c4a-ab32-0a27da65f97b","Type":"ContainerStarted","Data":"aec067f5804c6a0762cf116252ffb4e765d63e9063719a648490846d1e86bcf1"}
Sep 17 18:01:46.571873 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.571853    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq" event={"ID":"4d5e59c2-2d23-4f32-91a0-c673a927eeec","Type":"ContainerStarted","Data":"123d1edb1a6f2c498783a5b9baed9081f97007ee5dfaf4b6b2c6f6b4f213f864"}
Sep 17 18:01:46.598410 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:46.598389    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:01:49.587135 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:49.587096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-579c8958f7-5vh8f" event={"ID":"8e948e4b-36b9-4c4a-ab32-0a27da65f97b","Type":"ContainerStarted","Data":"bbf67e7f88fade89344157d9e5010cd87c22c086f39c6fd95b7fc33f6d3b91e5"}
Sep 17 18:01:49.587539 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:49.587275    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:01:49.609680 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:49.609591    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-579c8958f7-5vh8f" podStartSLOduration=1.535425047 podStartE2EDuration="4.609577137s" totalImagesPullingTime="3.07415209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:01:49.609214637 +0000 UTC m=+312.361954965" watchObservedRunningTime="2026-09-17 18:01:49.609577137 +0000 UTC m=+312.362317464"
Sep 17 18:01:50.592565 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:50.592532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq" event={"ID":"4d5e59c2-2d23-4f32-91a0-c673a927eeec","Type":"ContainerStarted","Data":"fe5c99f5b8c26c4b923b1cf28e9b2abac1e37153eff0f2ed94463738893f8f66"}
Sep 17 18:01:50.618772 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:50.618683    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq" podStartSLOduration=1.349272082 podStartE2EDuration="5.618664621s" totalImagesPullingTime="4.269392539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:01:50.617319574 +0000 UTC m=+313.370059903" watchObservedRunningTime="2026-09-17 18:01:50.618664621 +0000 UTC m=+313.371404950"
Sep 17 18:01:51.596616 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:01:51.596576    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:02:02.605925 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:02:02.605887    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-77857b7b98-gs8gq"
Sep 17 18:02:05.567764 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:02:05.567733    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-566c9cd69c-cjdbq"
Sep 17 18:02:10.594499 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:02:10.594464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-579c8958f7-5vh8f"
Sep 17 18:02:37.001489 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:02:37.001415    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:02:38.465033 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:02:38.464991    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:02.426978 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:02.426946    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:02.630632 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:02.630598    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:08.767732 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.767695    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:08.850149 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.850121    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-h5thv"]
Sep 17 18:03:08.852201 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.852180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:08.855321 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.855303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-s8j8b\""
Sep 17 18:03:08.856360 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.856339    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Sep 17 18:03:08.856474 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.856377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Sep 17 18:03:08.856474 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.856424    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Sep 17 18:03:08.857142 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.857126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:08.862355 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.862333    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"]
Sep 17 18:03:08.864666 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.864649    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:08.866382 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.866362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-h5thv"]
Sep 17 18:03:08.867233 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.867213    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Sep 17 18:03:08.867346 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.867287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-mh8cw\""
Sep 17 18:03:08.876759 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.876736    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"]
Sep 17 18:03:08.892746 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.892723    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59180624-f11e-44f4-9fba-0327ff8e89d2-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:08.892844 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.892802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hk7\" (UniqueName: \"kubernetes.io/projected/59180624-f11e-44f4-9fba-0327ff8e89d2-kube-api-access-59hk7\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:08.892844 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.892832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h5lm\" (UniqueName: \"kubernetes.io/projected/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-kube-api-access-2h5lm\") pod \"kserve-controller-manager-5bf6d75b64-h5thv\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") " pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:08.892951 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.892865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-cert\") pod \"kserve-controller-manager-5bf6d75b64-h5thv\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") " pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:08.968669 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.968646    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:08.993942 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.993896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hk7\" (UniqueName: \"kubernetes.io/projected/59180624-f11e-44f4-9fba-0327ff8e89d2-kube-api-access-59hk7\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:08.994029 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.993948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h5lm\" (UniqueName: \"kubernetes.io/projected/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-kube-api-access-2h5lm\") pod \"kserve-controller-manager-5bf6d75b64-h5thv\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") " pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:08.994029 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.993995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-cert\") pod \"kserve-controller-manager-5bf6d75b64-h5thv\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") " pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:08.994112 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.994082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59180624-f11e-44f4-9fba-0327ff8e89d2-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:08.994193 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:03:08.994180    2577 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 17 18:03:08.994254 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:03:08.994245    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59180624-f11e-44f4-9fba-0327ff8e89d2-cert podName:59180624-f11e-44f4-9fba-0327ff8e89d2 nodeName:}" failed. No retries permitted until 2026-09-17 18:03:09.494228251 +0000 UTC m=+392.246968563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/59180624-f11e-44f4-9fba-0327ff8e89d2-cert") pod "llmisvc-controller-manager-645f9c8fd6-n6jpt" (UID: "59180624-f11e-44f4-9fba-0327ff8e89d2") : secret "llmisvc-webhook-server-cert" not found
Sep 17 18:03:08.996472 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:08.996449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-cert\") pod \"kserve-controller-manager-5bf6d75b64-h5thv\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") " pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:09.005202 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.005181    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hk7\" (UniqueName: \"kubernetes.io/projected/59180624-f11e-44f4-9fba-0327ff8e89d2-kube-api-access-59hk7\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:09.006179 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.006164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h5lm\" (UniqueName: \"kubernetes.io/projected/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-kube-api-access-2h5lm\") pod \"kserve-controller-manager-5bf6d75b64-h5thv\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") " pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:09.073806 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.073778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:09.164186 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.164167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:09.447454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.447385    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-h5thv"]
Sep 17 18:03:09.450207 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:03:09.450184    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8c38dc_de4c_4eee_9bc5_f16f07acec3c.slice/crio-e93cbdf836b5a4e027f04bdead946ea5378af214cd0246bf4a3e9341eb7b8a0a WatchSource:0}: Error finding container e93cbdf836b5a4e027f04bdead946ea5378af214cd0246bf4a3e9341eb7b8a0a: Status 404 returned error can't find the container with id e93cbdf836b5a4e027f04bdead946ea5378af214cd0246bf4a3e9341eb7b8a0a
Sep 17 18:03:09.499223 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.499198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59180624-f11e-44f4-9fba-0327ff8e89d2-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:09.501553 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.501535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59180624-f11e-44f4-9fba-0327ff8e89d2-cert\") pod \"llmisvc-controller-manager-645f9c8fd6-n6jpt\" (UID: \"59180624-f11e-44f4-9fba-0327ff8e89d2\") " pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:09.553559 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.553537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:09.677352 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.677329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:09.775325 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.775274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:09.781517 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.781495    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:09.874097 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.874066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:09.922550 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:09.922515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv" event={"ID":"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c","Type":"ContainerStarted","Data":"e93cbdf836b5a4e027f04bdead946ea5378af214cd0246bf4a3e9341eb7b8a0a"}
Sep 17 18:03:10.051015 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:10.050992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"]
Sep 17 18:03:10.053814 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:03:10.053781    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod59180624_f11e_44f4_9fba_0327ff8e89d2.slice/crio-00b0e9f4315acc2a21ed09b4be515619c89e2801fbab22e44b62e88c99bf58a9 WatchSource:0}: Error finding container 00b0e9f4315acc2a21ed09b4be515619c89e2801fbab22e44b62e88c99bf58a9: Status 404 returned error can't find the container with id 00b0e9f4315acc2a21ed09b4be515619c89e2801fbab22e44b62e88c99bf58a9
Sep 17 18:03:10.931376 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:10.931298    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt" event={"ID":"59180624-f11e-44f4-9fba-0327ff8e89d2","Type":"ContainerStarted","Data":"00b0e9f4315acc2a21ed09b4be515619c89e2801fbab22e44b62e88c99bf58a9"}
Sep 17 18:03:13.945576 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:13.945528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt" event={"ID":"59180624-f11e-44f4-9fba-0327ff8e89d2","Type":"ContainerStarted","Data":"8886c7b2c73a6703a38b20fc87b8dc77abb70b0888d0bbc73b7e9bad0dedf9ff"}
Sep 17 18:03:13.946022 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:13.945598    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:13.947143 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:13.947117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv" event={"ID":"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c","Type":"ContainerStarted","Data":"65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85"}
Sep 17 18:03:13.947268 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:13.947251    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:13.962502 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:13.962455    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt" podStartSLOduration=3.085425952 podStartE2EDuration="5.962439825s" totalImagesPullingTime="2.877013873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:03:13.962384907 +0000 UTC m=+396.715125235" watchObservedRunningTime="2026-09-17 18:03:13.962439825 +0000 UTC m=+396.715180154"
Sep 17 18:03:13.980553 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:13.980513    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv" podStartSLOduration=2.502594448 podStartE2EDuration="5.980501356s" totalImagesPullingTime="3.477906908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:03:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:03:13.97889135 +0000 UTC m=+396.731631676" watchObservedRunningTime="2026-09-17 18:03:13.980501356 +0000 UTC m=+396.733241684"
Sep 17 18:03:34.741102 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:34.741073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:34.889866 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:34.889839    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:43.246570 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.246539    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79b49468d-jpbx9"]
Sep 17 18:03:43.249797 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.249778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.263032 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.263010    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b49468d-jpbx9"]
Sep 17 18:03:43.311549 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.311516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:43.343131 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpmrb\" (UniqueName: \"kubernetes.io/projected/75ccb779-e6a3-494d-9869-15e372a58a4f-kube-api-access-bpmrb\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.343244 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75ccb779-e6a3-494d-9869-15e372a58a4f-console-oauth-config\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.343244 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-console-config\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.343244 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-service-ca\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.343244 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-trusted-ca-bundle\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.343437 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-oauth-serving-cert\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.343437 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.343349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75ccb779-e6a3-494d-9869-15e372a58a4f-console-serving-cert\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444193 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-oauth-serving-cert\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444300 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75ccb779-e6a3-494d-9869-15e372a58a4f-console-serving-cert\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444300 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpmrb\" (UniqueName: \"kubernetes.io/projected/75ccb779-e6a3-494d-9869-15e372a58a4f-kube-api-access-bpmrb\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444300 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75ccb779-e6a3-494d-9869-15e372a58a4f-console-oauth-config\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-console-config\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-service-ca\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-trusted-ca-bundle\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.444995 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444969    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-console-config\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.445079 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.444970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-oauth-serving-cert\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.445326 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.445302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-service-ca\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.445505 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.445485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75ccb779-e6a3-494d-9869-15e372a58a4f-trusted-ca-bundle\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.446798 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.446774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/75ccb779-e6a3-494d-9869-15e372a58a4f-console-oauth-config\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.446927 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.446890    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/75ccb779-e6a3-494d-9869-15e372a58a4f-console-serving-cert\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.453177 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.453154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpmrb\" (UniqueName: \"kubernetes.io/projected/75ccb779-e6a3-494d-9869-15e372a58a4f-kube-api-access-bpmrb\") pod \"console-79b49468d-jpbx9\" (UID: \"75ccb779-e6a3-494d-9869-15e372a58a4f\") " pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.560331 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.560316    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:43.838394 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:43.838355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b49468d-jpbx9"]
Sep 17 18:03:43.840450 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:03:43.840427    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ccb779_e6a3_494d_9869_15e372a58a4f.slice/crio-20da9e6888808fa3e3ecf7898def32dfd0181a5631794a19c5137e823b81d558 WatchSource:0}: Error finding container 20da9e6888808fa3e3ecf7898def32dfd0181a5631794a19c5137e823b81d558: Status 404 returned error can't find the container with id 20da9e6888808fa3e3ecf7898def32dfd0181a5631794a19c5137e823b81d558
Sep 17 18:03:44.068070 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.068032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b49468d-jpbx9" event={"ID":"75ccb779-e6a3-494d-9869-15e372a58a4f","Type":"ContainerStarted","Data":"4e94c9ea07713db14810777192fa0328d77b619a1a53969bd2f0dcd35db897b5"}
Sep 17 18:03:44.068238 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.068082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b49468d-jpbx9" event={"ID":"75ccb779-e6a3-494d-9869-15e372a58a4f","Type":"ContainerStarted","Data":"20da9e6888808fa3e3ecf7898def32dfd0181a5631794a19c5137e823b81d558"}
Sep 17 18:03:44.096291 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.096200    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79b49468d-jpbx9" podStartSLOduration=1.096185502 podStartE2EDuration="1.096185502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:03:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:03:44.094609815 +0000 UTC m=+426.847350142" watchObservedRunningTime="2026-09-17 18:03:44.096185502 +0000 UTC m=+426.848925856"
Sep 17 18:03:44.433946 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.433863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:44.502478 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.502453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:44.953190 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.953170    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-645f9c8fd6-n6jpt"
Sep 17 18:03:44.956082 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:44.956063    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:53.380184 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.380113    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-h5thv"]
Sep 17 18:03:53.380626 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.380310    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv" podUID="ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" containerName="manager" containerID="cri-o://65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85" gracePeriod=10
Sep 17 18:03:53.404088 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.404066    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-vsqcr"]
Sep 17 18:03:53.407173 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.407156    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.417097 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.417077    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-vsqcr"]
Sep 17 18:03:53.515102 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.515079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb896b1f-332e-4ed8-a6e4-05c08d391a0a-cert\") pod \"kserve-controller-manager-5bf6d75b64-vsqcr\" (UID: \"fb896b1f-332e-4ed8-a6e4-05c08d391a0a\") " pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.515225 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.515125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9vb\" (UniqueName: \"kubernetes.io/projected/fb896b1f-332e-4ed8-a6e4-05c08d391a0a-kube-api-access-db9vb\") pod \"kserve-controller-manager-5bf6d75b64-vsqcr\" (UID: \"fb896b1f-332e-4ed8-a6e4-05c08d391a0a\") " pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.560504 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.560479    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:53.560613 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.560540    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:53.565631 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.565608    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:53.615650 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.615617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb896b1f-332e-4ed8-a6e4-05c08d391a0a-cert\") pod \"kserve-controller-manager-5bf6d75b64-vsqcr\" (UID: \"fb896b1f-332e-4ed8-a6e4-05c08d391a0a\") " pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.615744 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.615661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9vb\" (UniqueName: \"kubernetes.io/projected/fb896b1f-332e-4ed8-a6e4-05c08d391a0a-kube-api-access-db9vb\") pod \"kserve-controller-manager-5bf6d75b64-vsqcr\" (UID: \"fb896b1f-332e-4ed8-a6e4-05c08d391a0a\") " pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.617830 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.617806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb896b1f-332e-4ed8-a6e4-05c08d391a0a-cert\") pod \"kserve-controller-manager-5bf6d75b64-vsqcr\" (UID: \"fb896b1f-332e-4ed8-a6e4-05c08d391a0a\") " pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.618712 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.618699    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:53.624890 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.624870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9vb\" (UniqueName: \"kubernetes.io/projected/fb896b1f-332e-4ed8-a6e4-05c08d391a0a-kube-api-access-db9vb\") pod \"kserve-controller-manager-5bf6d75b64-vsqcr\" (UID: \"fb896b1f-332e-4ed8-a6e4-05c08d391a0a\") " pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.716554 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.716496    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h5lm\" (UniqueName: \"kubernetes.io/projected/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-kube-api-access-2h5lm\") pod \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") "
Sep 17 18:03:53.716554 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.716546    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-cert\") pod \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\" (UID: \"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c\") "
Sep 17 18:03:53.718644 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.718622    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-kube-api-access-2h5lm" (OuterVolumeSpecName: "kube-api-access-2h5lm") pod "ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" (UID: "ca8c38dc-de4c-4eee-9bc5-f16f07acec3c"). InnerVolumeSpecName "kube-api-access-2h5lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:03:53.718740 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.718658    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-cert" (OuterVolumeSpecName: "cert") pod "ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" (UID: "ca8c38dc-de4c-4eee-9bc5-f16f07acec3c"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:03:53.757486 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.757460    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:53.817434 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.817410    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h5lm\" (UniqueName: \"kubernetes.io/projected/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-kube-api-access-2h5lm\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:03:53.817434 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:53.817434    2577 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:03:54.028534 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.028512    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-vsqcr"]
Sep 17 18:03:54.030276 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:03:54.030254    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb896b1f_332e_4ed8_a6e4_05c08d391a0a.slice/crio-73bfbfc547c7b67a76991103f08b7753a1781e89a38b0f5d181b374c4a40cd90 WatchSource:0}: Error finding container 73bfbfc547c7b67a76991103f08b7753a1781e89a38b0f5d181b374c4a40cd90: Status 404 returned error can't find the container with id 73bfbfc547c7b67a76991103f08b7753a1781e89a38b0f5d181b374c4a40cd90
Sep 17 18:03:54.111416 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.111392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr" event={"ID":"fb896b1f-332e-4ed8-a6e4-05c08d391a0a","Type":"ContainerStarted","Data":"73bfbfc547c7b67a76991103f08b7753a1781e89a38b0f5d181b374c4a40cd90"}
Sep 17 18:03:54.112608 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.112586    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" containerID="65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85" exitCode=0
Sep 17 18:03:54.112685 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.112629    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv"
Sep 17 18:03:54.112685 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.112674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv" event={"ID":"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c","Type":"ContainerDied","Data":"65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85"}
Sep 17 18:03:54.112758 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.112716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bf6d75b64-h5thv" event={"ID":"ca8c38dc-de4c-4eee-9bc5-f16f07acec3c","Type":"ContainerDied","Data":"e93cbdf836b5a4e027f04bdead946ea5378af214cd0246bf4a3e9341eb7b8a0a"}
Sep 17 18:03:54.112758 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.112743    2577 scope.go:117] "RemoveContainer" containerID="65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85"
Sep 17 18:03:54.116652 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.116633    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79b49468d-jpbx9"
Sep 17 18:03:54.121146 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.121129    2577 scope.go:117] "RemoveContainer" containerID="65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85"
Sep 17 18:03:54.121412 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:03:54.121389    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85\": container with ID starting with 65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85 not found: ID does not exist" containerID="65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85"
Sep 17 18:03:54.121515 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.121416    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85"} err="failed to get container status \"65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85\": rpc error: code = NotFound desc = could not find container \"65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85\": container with ID starting with 65b011ab8d2bb5667b8e4414d650dcdbe06043e47a45f4b67bf3b84adbd2ed85 not found: ID does not exist"
Sep 17 18:03:54.160312 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.160287    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-h5thv"]
Sep 17 18:03:54.168773 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.168753    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-5bf6d75b64-h5thv"]
Sep 17 18:03:54.182444 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.182423    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5b6f89b4-dctzg"]
Sep 17 18:03:54.391025 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.390998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:54.506703 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:54.506673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:03:55.119577 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:55.119549    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr" event={"ID":"fb896b1f-332e-4ed8-a6e4-05c08d391a0a","Type":"ContainerStarted","Data":"5a94371692546db5fcc04a8c4456fc2777d0fbe5bbbe49261a71785774a0916d"}
Sep 17 18:03:55.119730 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:55.119629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:03:55.148276 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:55.148230    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr" podStartSLOduration=1.7817384550000002 podStartE2EDuration="2.148218013s" totalImagesPullingTime="366.479558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:03:55.147973279 +0000 UTC m=+437.900713620" watchObservedRunningTime="2026-09-17 18:03:55.148218013 +0000 UTC m=+437.900958340"
Sep 17 18:03:55.325695 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:55.325672    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" path="/var/lib/kubelet/pods/ca8c38dc-de4c-4eee-9bc5-f16f07acec3c/volumes"
Sep 17 18:03:59.473137 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:03:59.473095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:19.202512 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.202467    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c5b6f89b4-dctzg" podUID="03c3c65a-2843-47e1-b4db-d89e417a65f1" containerName="console" containerID="cri-o://78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca" gracePeriod=15
Sep 17 18:04:19.453018 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.452965    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:04:19.591702 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591672    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-oauth-config\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.591702 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591708    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-config\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.591885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-trusted-ca-bundle\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.591885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2n4x\" (UniqueName: \"kubernetes.io/projected/03c3c65a-2843-47e1-b4db-d89e417a65f1-kube-api-access-g2n4x\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.591885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591791    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-oauth-serving-cert\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.591885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-service-ca\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.591885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.591844    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-serving-cert\") pod \"03c3c65a-2843-47e1-b4db-d89e417a65f1\" (UID: \"03c3c65a-2843-47e1-b4db-d89e417a65f1\") "
Sep 17 18:04:19.592191 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.592165    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-config" (OuterVolumeSpecName: "console-config") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:04:19.592253 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.592220    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:04:19.592309 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.592260    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:04:19.592309 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.592276    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:04:19.594024 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.594003    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:04:19.594472 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.594451    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:04:19.594519 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.594484    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03c3c65a-2843-47e1-b4db-d89e417a65f1-kube-api-access-g2n4x" (OuterVolumeSpecName: "kube-api-access-g2n4x") pod "03c3c65a-2843-47e1-b4db-d89e417a65f1" (UID: "03c3c65a-2843-47e1-b4db-d89e417a65f1"). InnerVolumeSpecName "kube-api-access-g2n4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:04:19.693159 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693131    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-serving-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:19.693159 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693154    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-oauth-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:19.693302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693168    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-console-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:19.693302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693180    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-trusted-ca-bundle\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:19.693302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693193    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2n4x\" (UniqueName: \"kubernetes.io/projected/03c3c65a-2843-47e1-b4db-d89e417a65f1-kube-api-access-g2n4x\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:19.693302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693204    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-oauth-serving-cert\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:19.693302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:19.693216    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03c3c65a-2843-47e1-b4db-d89e417a65f1-service-ca\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:04:20.222131 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.222103    2577 generic.go:356] "Generic (PLEG): container finished" podID="03c3c65a-2843-47e1-b4db-d89e417a65f1" containerID="78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca" exitCode=0
Sep 17 18:04:20.222446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.222141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5b6f89b4-dctzg" event={"ID":"03c3c65a-2843-47e1-b4db-d89e417a65f1","Type":"ContainerDied","Data":"78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca"}
Sep 17 18:04:20.222446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.222147    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5b6f89b4-dctzg"
Sep 17 18:04:20.222446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.222172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5b6f89b4-dctzg" event={"ID":"03c3c65a-2843-47e1-b4db-d89e417a65f1","Type":"ContainerDied","Data":"dd291a6e7daa15592a3848d97ce10acb2577074b4284314ddbfe74cceefbcb01"}
Sep 17 18:04:20.222446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.222191    2577 scope.go:117] "RemoveContainer" containerID="78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca"
Sep 17 18:04:20.230412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.230391    2577 scope.go:117] "RemoveContainer" containerID="78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca"
Sep 17 18:04:20.230642 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:04:20.230626    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca\": container with ID starting with 78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca not found: ID does not exist" containerID="78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca"
Sep 17 18:04:20.230685 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.230649    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca"} err="failed to get container status \"78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca\": rpc error: code = NotFound desc = could not find container \"78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca\": container with ID starting with 78af8611bf11014563d76ae18372a9c55e838769d71eb5ad476cb26d534931ca not found: ID does not exist"
Sep 17 18:04:20.244858 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.244835    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5b6f89b4-dctzg"]
Sep 17 18:04:20.250874 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:20.250856    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c5b6f89b4-dctzg"]
Sep 17 18:04:21.324826 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:21.324799    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03c3c65a-2843-47e1-b4db-d89e417a65f1" path="/var/lib/kubelet/pods/03c3c65a-2843-47e1-b4db-d89e417a65f1/volumes"
Sep 17 18:04:26.127969 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:26.127942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-5bf6d75b64-vsqcr"
Sep 17 18:04:27.398628 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.398568    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:27.461256 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.461221    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-7b966d7984-j9rgz"]
Sep 17 18:04:27.461662 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.461642    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" containerName="manager"
Sep 17 18:04:27.461814 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.461801    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" containerName="manager"
Sep 17 18:04:27.461953 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.461936    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03c3c65a-2843-47e1-b4db-d89e417a65f1" containerName="console"
Sep 17 18:04:27.461953 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.461954    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="03c3c65a-2843-47e1-b4db-d89e417a65f1" containerName="console"
Sep 17 18:04:27.462092 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.462066    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca8c38dc-de4c-4eee-9bc5-f16f07acec3c" containerName="manager"
Sep 17 18:04:27.462092 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.462080    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="03c3c65a-2843-47e1-b4db-d89e417a65f1" containerName="console"
Sep 17 18:04:27.464741 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.464722    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.468000 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.467977    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\""
Sep 17 18:04:27.468112 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.468021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-metrics-tls\""
Sep 17 18:04:27.468112 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.468107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-pvzkh\""
Sep 17 18:04:27.479940 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.479885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-j9rgz"]
Sep 17 18:04:27.502027 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.502007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:27.644337 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.644311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmgj\" (UniqueName: \"kubernetes.io/projected/60e06181-3e6d-4555-af7c-8d39eaa02203-kube-api-access-hdmgj\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.644443 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.644351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-metrics-certs\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.644443 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.644417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-cert\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.655974 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.655896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:27.745615 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.745592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-cert\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.745729 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.745660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmgj\" (UniqueName: \"kubernetes.io/projected/60e06181-3e6d-4555-af7c-8d39eaa02203-kube-api-access-hdmgj\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.745729 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.745686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-metrics-certs\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.745729 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:04:27.745689    2577 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 17 18:04:27.745891 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:04:27.745747    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-cert podName:60e06181-3e6d-4555-af7c-8d39eaa02203 nodeName:}" failed. No retries permitted until 2026-09-17 18:04:28.245733688 +0000 UTC m=+470.998474011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-cert") pod "odh-model-controller-7b966d7984-j9rgz" (UID: "60e06181-3e6d-4555-af7c-8d39eaa02203") : secret "odh-model-controller-webhook-cert" not found
Sep 17 18:04:27.748247 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.748224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-metrics-certs\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.754915 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.754881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:27.755867 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.755849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmgj\" (UniqueName: \"kubernetes.io/projected/60e06181-3e6d-4555-af7c-8d39eaa02203-kube-api-access-hdmgj\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:27.973768 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:27.973718    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:28.250407 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:28.250359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-cert\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:28.252522 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:28.252499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60e06181-3e6d-4555-af7c-8d39eaa02203-cert\") pod \"odh-model-controller-7b966d7984-j9rgz\" (UID: \"60e06181-3e6d-4555-af7c-8d39eaa02203\") " pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:28.376421 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:28.376401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:28.653452 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:28.653431    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-7b966d7984-j9rgz"]
Sep 17 18:04:28.655870 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:04:28.655849    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e06181_3e6d_4555_af7c_8d39eaa02203.slice/crio-2069422dc02bc3927d3a9c7083140a63f74bfe586963be2eb6b7a60700af5fc0 WatchSource:0}: Error finding container 2069422dc02bc3927d3a9c7083140a63f74bfe586963be2eb6b7a60700af5fc0: Status 404 returned error can't find the container with id 2069422dc02bc3927d3a9c7083140a63f74bfe586963be2eb6b7a60700af5fc0
Sep 17 18:04:28.911633 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:28.911579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:29.009323 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:29.009299    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:04:29.266740 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:29.266679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-j9rgz" event={"ID":"60e06181-3e6d-4555-af7c-8d39eaa02203","Type":"ContainerStarted","Data":"2069422dc02bc3927d3a9c7083140a63f74bfe586963be2eb6b7a60700af5fc0"}
Sep 17 18:04:32.282378 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:32.282338    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-7b966d7984-j9rgz" event={"ID":"60e06181-3e6d-4555-af7c-8d39eaa02203","Type":"ContainerStarted","Data":"04c7444fde05dc0e164b44c5bfdbef5267ce420fcb044abbe9a5865bd8400d8a"}
Sep 17 18:04:32.282721 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:32.282433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:04:32.301650 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:32.301609    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-7b966d7984-j9rgz" podStartSLOduration=2.452247888 podStartE2EDuration="5.301596172s" totalImagesPullingTime="2.849348284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:04:32.300312524 +0000 UTC m=+475.053052869" watchObservedRunningTime="2026-09-17 18:04:32.301596172 +0000 UTC m=+475.054336547"
Sep 17 18:04:43.290131 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:04:43.290099    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-7b966d7984-j9rgz"
Sep 17 18:05:34.560959 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:05:34.560883    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:05:38.673041 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:05:38.673012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:03.911515 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:03.911487    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:04.013579 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:04.013552    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:15.793577 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:15.793526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:15.915412 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:15.915373    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.108595 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.108510    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.276267 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.276236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.380656 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.380539    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.435470 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.435442    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"]
Sep 17 18:06:16.437967 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.437940    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.441180 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.441140    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Sep 17 18:06:16.441818 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.441797    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-70b74-predictor-serving-cert\""
Sep 17 18:06:16.441952 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.441836    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Sep 17 18:06:16.441952 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.441836    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-70b74-kube-rbac-proxy-sar-config\""
Sep 17 18:06:16.442183 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.442167    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-hn8w8\""
Sep 17 18:06:16.452387 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.452365    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"]
Sep 17 18:06:16.471028 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.471005    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.502224 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.502198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8chjp\" (UniqueName: \"kubernetes.io/projected/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-api-access-8chjp\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.502350 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.502239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.502350 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.502271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba63c5a9-edbd-424f-a725-ada3e0782153-proxy-tls\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.556739 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.556715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.603639 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.603611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba63c5a9-edbd-424f-a725-ada3e0782153-proxy-tls\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.603761 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.603713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8chjp\" (UniqueName: \"kubernetes.io/projected/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-api-access-8chjp\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.603761 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.603754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.604452 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.604426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.606277 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.606255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba63c5a9-edbd-424f-a725-ada3e0782153-proxy-tls\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.612494 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.612473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8chjp\" (UniqueName: \"kubernetes.io/projected/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-api-access-8chjp\") pod \"error-404-isvc-70b74-predictor-68dbc46586-btrs2\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") " pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.703290 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.703223    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:16.748761 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.748733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:16.939010 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:16.938949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:17.031353 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:17.031333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"]
Sep 17 18:06:17.033849 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:06:17.033825    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba63c5a9_edbd_424f_a725_ada3e0782153.slice/crio-510c8a009f344ec00810313b63ffdea788d09cf3162f6a087c023e7d82c5dd92 WatchSource:0}: Error finding container 510c8a009f344ec00810313b63ffdea788d09cf3162f6a087c023e7d82c5dd92: Status 404 returned error can't find the container with id 510c8a009f344ec00810313b63ffdea788d09cf3162f6a087c023e7d82c5dd92
Sep 17 18:06:17.717250 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:17.717169    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" event={"ID":"ba63c5a9-edbd-424f-a725-ada3e0782153","Type":"ContainerStarted","Data":"510c8a009f344ec00810313b63ffdea788d09cf3162f6a087c023e7d82c5dd92"}
Sep 17 18:06:28.781551 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:28.781522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" event={"ID":"ba63c5a9-edbd-424f-a725-ada3e0782153","Type":"ContainerStarted","Data":"1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c"}
Sep 17 18:06:31.798458 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:31.798423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" event={"ID":"ba63c5a9-edbd-424f-a725-ada3e0782153","Type":"ContainerStarted","Data":"3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9"}
Sep 17 18:06:31.798790 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:31.798543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:31.826161 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:31.826121    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podStartSLOduration=1.5561592069999999 podStartE2EDuration="15.826109052s" totalImagesPullingTime="14.269949845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:06:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:06:31.825372851 +0000 UTC m=+594.578113179" watchObservedRunningTime="2026-09-17 18:06:31.826109052 +0000 UTC m=+594.578849379"
Sep 17 18:06:32.802691 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:32.802659    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:32.803978 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:32.803946    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Sep 17 18:06:33.806757 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:33.806710    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Sep 17 18:06:38.811588 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:38.811561    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:06:38.812094 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:38.812068    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Sep 17 18:06:39.300829 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:39.300806    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:06:39.301800 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:39.301781    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:06:39.310560 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:39.310542    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:06:39.311362 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:39.311342    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:06:48.812681 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:48.812643    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Sep 17 18:06:50.932780 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:50.932700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:06:58.812985 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:06:58.812936    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Sep 17 18:07:08.812778 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:08.812738    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Sep 17 18:07:18.812702 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:18.812675    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:07:35.747344 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:35.747311    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:36.338987 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:36.338954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:49.905774 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:49.905742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:50.096115 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.096085    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"]
Sep 17 18:07:50.096380 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.096352    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kube-rbac-proxy" containerID="cri-o://3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9" gracePeriod=30
Sep 17 18:07:50.096528 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.096334    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container" containerID="cri-o://1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c" gracePeriod=30
Sep 17 18:07:50.245912 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.245876    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"]
Sep 17 18:07:50.248218 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.248200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.250779 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.250758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0c0cc-predictor-serving-cert\""
Sep 17 18:07:50.250886 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.250759    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-0c0cc-kube-rbac-proxy-sar-config\""
Sep 17 18:07:50.258691 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.258673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"]
Sep 17 18:07:50.316067 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.316041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbwm\" (UniqueName: \"kubernetes.io/projected/fc843b63-9526-4a17-8dad-76b356842474-kube-api-access-xzbwm\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.316215 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.316100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc843b63-9526-4a17-8dad-76b356842474-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.316215 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.316127    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.416857 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.416831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbwm\" (UniqueName: \"kubernetes.io/projected/fc843b63-9526-4a17-8dad-76b356842474-kube-api-access-xzbwm\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.417006 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.416872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc843b63-9526-4a17-8dad-76b356842474-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.417006 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.416896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.417111 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:07:50.417017    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-serving-cert: secret "error-404-isvc-0c0cc-predictor-serving-cert" not found
Sep 17 18:07:50.417111 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:07:50.417072    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls podName:fc843b63-9526-4a17-8dad-76b356842474 nodeName:}" failed. No retries permitted until 2026-09-17 18:07:50.917054401 +0000 UTC m=+673.669794726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls") pod "error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" (UID: "fc843b63-9526-4a17-8dad-76b356842474") : secret "error-404-isvc-0c0cc-predictor-serving-cert" not found
Sep 17 18:07:50.417472 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.417454    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc843b63-9526-4a17-8dad-76b356842474-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.428109 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.428085    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbwm\" (UniqueName: \"kubernetes.io/projected/fc843b63-9526-4a17-8dad-76b356842474-kube-api-access-xzbwm\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.921125 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.921091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:50.923543 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:50.923523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls\") pod \"error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") " pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:51.139271 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:51.139239    2577 generic.go:356] "Generic (PLEG): container finished" podID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerID="3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9" exitCode=2
Sep 17 18:07:51.139407 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:51.139307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" event={"ID":"ba63c5a9-edbd-424f-a725-ada3e0782153","Type":"ContainerDied","Data":"3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9"}
Sep 17 18:07:51.160426 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:51.160407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:51.375706 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:51.375680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:07:51.431161 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:51.431134    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"]
Sep 17 18:07:51.434244 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:07:51.434223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc843b63_9526_4a17_8dad_76b356842474.slice/crio-dce057498cb622bd03ddb4a4d16b1c4f0ca2b974a9cfebfbf9d43486305a8f5a WatchSource:0}: Error finding container dce057498cb622bd03ddb4a4d16b1c4f0ca2b974a9cfebfbf9d43486305a8f5a: Status 404 returned error can't find the container with id dce057498cb622bd03ddb4a4d16b1c4f0ca2b974a9cfebfbf9d43486305a8f5a
Sep 17 18:07:52.145918 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.145870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" event={"ID":"fc843b63-9526-4a17-8dad-76b356842474","Type":"ContainerStarted","Data":"f21bcdf1741187779e82b8f5faf41ddf64863ddaf91523be15d5e4d2a5441540"}
Sep 17 18:07:52.146327 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.145964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" event={"ID":"fc843b63-9526-4a17-8dad-76b356842474","Type":"ContainerStarted","Data":"8fc50182e4e938a6676ad14373014e9ab0f05284c95d5e1a879a87efacd5d048"}
Sep 17 18:07:52.146327 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.146068    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:52.146327 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.146091    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:52.146327 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.146115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" event={"ID":"fc843b63-9526-4a17-8dad-76b356842474","Type":"ContainerStarted","Data":"dce057498cb622bd03ddb4a4d16b1c4f0ca2b974a9cfebfbf9d43486305a8f5a"}
Sep 17 18:07:52.147618 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.147590    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Sep 17 18:07:52.166832 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.166788    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podStartSLOduration=2.166774199 podStartE2EDuration="2.166774199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:07:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:07:52.165203302 +0000 UTC m=+674.917943631" watchObservedRunningTime="2026-09-17 18:07:52.166774199 +0000 UTC m=+674.919514526"
Sep 17 18:07:52.851146 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.851122    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:07:52.938417 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.938362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba63c5a9-edbd-424f-a725-ada3e0782153-proxy-tls\") pod \"ba63c5a9-edbd-424f-a725-ada3e0782153\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") "
Sep 17 18:07:52.938417 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.938396    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-rbac-proxy-sar-config\") pod \"ba63c5a9-edbd-424f-a725-ada3e0782153\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") "
Sep 17 18:07:52.938562 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.938450    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8chjp\" (UniqueName: \"kubernetes.io/projected/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-api-access-8chjp\") pod \"ba63c5a9-edbd-424f-a725-ada3e0782153\" (UID: \"ba63c5a9-edbd-424f-a725-ada3e0782153\") "
Sep 17 18:07:52.938743 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.938720    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "ba63c5a9-edbd-424f-a725-ada3e0782153" (UID: "ba63c5a9-edbd-424f-a725-ada3e0782153"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:07:52.940622 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.940602    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba63c5a9-edbd-424f-a725-ada3e0782153-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ba63c5a9-edbd-424f-a725-ada3e0782153" (UID: "ba63c5a9-edbd-424f-a725-ada3e0782153"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:07:52.940730 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:52.940712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-api-access-8chjp" (OuterVolumeSpecName: "kube-api-access-8chjp") pod "ba63c5a9-edbd-424f-a725-ada3e0782153" (UID: "ba63c5a9-edbd-424f-a725-ada3e0782153"). InnerVolumeSpecName "kube-api-access-8chjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:07:53.039107 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.039084    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba63c5a9-edbd-424f-a725-ada3e0782153-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:07:53.039107 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.039103    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:07:53.039233 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.039112    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8chjp\" (UniqueName: \"kubernetes.io/projected/ba63c5a9-edbd-424f-a725-ada3e0782153-kube-api-access-8chjp\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:07:53.152206 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.152180    2577 generic.go:356] "Generic (PLEG): container finished" podID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerID="1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c" exitCode=0
Sep 17 18:07:53.152533 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.152229    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"
Sep 17 18:07:53.152533 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.152257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" event={"ID":"ba63c5a9-edbd-424f-a725-ada3e0782153","Type":"ContainerDied","Data":"1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c"}
Sep 17 18:07:53.152533 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.152312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2" event={"ID":"ba63c5a9-edbd-424f-a725-ada3e0782153","Type":"ContainerDied","Data":"510c8a009f344ec00810313b63ffdea788d09cf3162f6a087c023e7d82c5dd92"}
Sep 17 18:07:53.152533 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.152337    2577 scope.go:117] "RemoveContainer" containerID="3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9"
Sep 17 18:07:53.152723 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.152673    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Sep 17 18:07:53.161823 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.161806    2577 scope.go:117] "RemoveContainer" containerID="1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c"
Sep 17 18:07:53.169195 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.169179    2577 scope.go:117] "RemoveContainer" containerID="3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9"
Sep 17 18:07:53.169447 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:07:53.169430    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9\": container with ID starting with 3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9 not found: ID does not exist" containerID="3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9"
Sep 17 18:07:53.169511 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.169455    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9"} err="failed to get container status \"3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9\": rpc error: code = NotFound desc = could not find container \"3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9\": container with ID starting with 3cf8925356bda64c499c4c7332b0553cbcd06c9a676acf76dd2b663517d2dbe9 not found: ID does not exist"
Sep 17 18:07:53.169511 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.169470    2577 scope.go:117] "RemoveContainer" containerID="1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c"
Sep 17 18:07:53.169714 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:07:53.169692    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c\": container with ID starting with 1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c not found: ID does not exist" containerID="1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c"
Sep 17 18:07:53.169753 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.169721    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c"} err="failed to get container status \"1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c\": rpc error: code = NotFound desc = could not find container \"1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c\": container with ID starting with 1be746feac1651cbd31eb7fbb0af4a9135f68528efcf3ea34539b941e8dfb66c not found: ID does not exist"
Sep 17 18:07:53.177019 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.177000    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"]
Sep 17 18:07:53.181748 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.181722    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-70b74-predictor-68dbc46586-btrs2"]
Sep 17 18:07:53.325161 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:53.325142    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" path="/var/lib/kubelet/pods/ba63c5a9-edbd-424f-a725-ada3e0782153/volumes"
Sep 17 18:07:58.156560 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:58.156534    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:07:58.156956 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:07:58.156929    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Sep 17 18:08:08.156977 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:08.156936    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Sep 17 18:08:17.317600 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:17.317566    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:18.157098 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:18.157056    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Sep 17 18:08:18.526286 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:18.526223    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:18.593803 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:18.593776    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:28.157380 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:28.157306    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Sep 17 18:08:35.866849 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:35.866813    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:36.348391 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:36.348365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:38.158658 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:38.158624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:08:46.499126 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.499093    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:46.607435 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.607401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:46.682883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.682854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:46.769833 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.769750    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:46.850281 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.850245    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:46.859492 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.859468    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"]
Sep 17 18:08:46.860005 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.859990    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container"
Sep 17 18:08:46.860051 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.860008    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container"
Sep 17 18:08:46.860051 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.860022    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kube-rbac-proxy"
Sep 17 18:08:46.860051 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.860030    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kube-rbac-proxy"
Sep 17 18:08:46.860139 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.860100    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kserve-container"
Sep 17 18:08:46.860139 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.860110    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba63c5a9-edbd-424f-a725-ada3e0782153" containerName="kube-rbac-proxy"
Sep 17 18:08:46.863143 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.863122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:46.865531 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.865508    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-4a77e-predictor-serving-cert\""
Sep 17 18:08:46.865873 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.865855    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-4a77e-kube-rbac-proxy-sar-config\""
Sep 17 18:08:46.874416 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:46.874396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"]
Sep 17 18:08:47.010435 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.010414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8sxj\" (UniqueName: \"kubernetes.io/projected/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-api-access-p8sxj\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.010560 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.010459    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.010560 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.010477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.111754 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.111722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.111869 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.111764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.111869 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.111835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8sxj\" (UniqueName: \"kubernetes.io/projected/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-api-access-p8sxj\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.111869 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:08:47.111854    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-serving-cert: secret "error-404-isvc-4a77e-predictor-serving-cert" not found
Sep 17 18:08:47.112056 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:08:47.111939    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls podName:0b73cbc3-6f10-4ef1-986c-1d2f538bfef5 nodeName:}" failed. No retries permitted until 2026-09-17 18:08:47.611898789 +0000 UTC m=+730.364639096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls") pod "error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" (UID: "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5") : secret "error-404-isvc-4a77e-predictor-serving-cert" not found
Sep 17 18:08:47.112386 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.112368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.125038 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.125009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8sxj\" (UniqueName: \"kubernetes.io/projected/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-api-access-p8sxj\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.392969 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.392918    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:47.461725 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.461704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:47.615778 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.615756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.618165 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.618134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls\") pod \"error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") " pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:47.776644 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:47.776596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:48.046658 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.046637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"]
Sep 17 18:08:48.048975 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:08:48.048946    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b73cbc3_6f10_4ef1_986c_1d2f538bfef5.slice/crio-6e963980bcf0d5606c6c0a8a4a0b72744435b8796887de19175c67a8145a70be WatchSource:0}: Error finding container 6e963980bcf0d5606c6c0a8a4a0b72744435b8796887de19175c67a8145a70be: Status 404 returned error can't find the container with id 6e963980bcf0d5606c6c0a8a4a0b72744435b8796887de19175c67a8145a70be
Sep 17 18:08:48.388853 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.388769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" event={"ID":"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5","Type":"ContainerStarted","Data":"d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90"}
Sep 17 18:08:48.388853 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.388838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" event={"ID":"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5","Type":"ContainerStarted","Data":"b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a"}
Sep 17 18:08:48.389067 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.388875    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" event={"ID":"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5","Type":"ContainerStarted","Data":"6e963980bcf0d5606c6c0a8a4a0b72744435b8796887de19175c67a8145a70be"}
Sep 17 18:08:48.389067 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.388923    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:48.389067 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.388951    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:48.389993 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.389966    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:08:48.406815 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:48.406773    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podStartSLOduration=2.406760066 podStartE2EDuration="2.406760066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:08:48.405335046 +0000 UTC m=+731.158075364" watchObservedRunningTime="2026-09-17 18:08:48.406760066 +0000 UTC m=+731.159500394"
Sep 17 18:08:49.395180 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:49.395148    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:08:50.140153 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:50.140127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:50.368115 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:50.368089    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:08:54.400079 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:54.400054    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:08:54.400475 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:08:54.400450    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:09:04.401322 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:09:04.401285    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:09:14.400925 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:09:14.400863    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:09:24.400852 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:09:24.400814    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:09:34.401051 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:09:34.401017    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:09:46.743045 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:09:46.743012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:09:46.842037 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:09:46.842003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:10:16.139770 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:10:16.139730    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:11:16.020083 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:11:16.020043    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:11:39.329782 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:11:39.329707    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:11:39.332376 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:11:39.332357    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:11:39.338500 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:11:39.338482    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:11:39.340715 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:11:39.340700    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:11:43.738203 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:11:43.738168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:13:27.409697 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:13:27.409664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:16:22.919600 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:16:22.919556    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:16:39.358360 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:16:39.358332    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:16:39.362138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:16:39.362114    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:16:39.368023 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:16:39.368004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:16:39.371666 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:16:39.371647    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:17:04.681483 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.681447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:04.797711 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.797629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:04.801725 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.801700    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"]
Sep 17 18:17:04.801948 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.801893    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container" containerID="cri-o://8fc50182e4e938a6676ad14373014e9ab0f05284c95d5e1a879a87efacd5d048" gracePeriod=30
Sep 17 18:17:04.802046 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.801962    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kube-rbac-proxy" containerID="cri-o://f21bcdf1741187779e82b8f5faf41ddf64863ddaf91523be15d5e4d2a5441540" gracePeriod=30
Sep 17 18:17:04.898048 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.898018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:04.972129 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.972050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:04.979145 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.979120    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"]
Sep 17 18:17:04.982574 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.982555    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:04.984858 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.984839    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b0976-kube-rbac-proxy-sar-config\""
Sep 17 18:17:04.984981 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.984840    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b0976-predictor-serving-cert\""
Sep 17 18:17:04.991884 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:04.991866    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"]
Sep 17 18:17:05.013796 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.013764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pxdj\" (UniqueName: \"kubernetes.io/projected/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-api-access-5pxdj\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.013927 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.013815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.013927 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.013834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.034881 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.034854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:05.115192 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.115162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pxdj\" (UniqueName: \"kubernetes.io/projected/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-api-access-5pxdj\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.115306 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.115228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.115306 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.115256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.115427 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:17:05.115331    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-b0976-predictor-serving-cert: secret "error-404-isvc-b0976-predictor-serving-cert" not found
Sep 17 18:17:05.115427 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:17:05.115389    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls podName:e6a9c759-12f5-492c-a6cb-e621dd9e8930 nodeName:}" failed. No retries permitted until 2026-09-17 18:17:05.615372455 +0000 UTC m=+1228.368112776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls") pod "error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" (UID: "e6a9c759-12f5-492c-a6cb-e621dd9e8930") : secret "error-404-isvc-b0976-predictor-serving-cert" not found
Sep 17 18:17:05.115972 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.115951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.123405 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.123384    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pxdj\" (UniqueName: \"kubernetes.io/projected/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-api-access-5pxdj\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.135875 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.135852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:05.456615 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.456578    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:17:05.597741 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.597715    2577 generic.go:356] "Generic (PLEG): container finished" podID="fc843b63-9526-4a17-8dad-76b356842474" containerID="f21bcdf1741187779e82b8f5faf41ddf64863ddaf91523be15d5e4d2a5441540" exitCode=2
Sep 17 18:17:05.597870 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.597788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" event={"ID":"fc843b63-9526-4a17-8dad-76b356842474","Type":"ContainerDied","Data":"f21bcdf1741187779e82b8f5faf41ddf64863ddaf91523be15d5e4d2a5441540"}
Sep 17 18:17:05.619251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.619230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.621677 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.621657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls\") pod \"error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") " pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:05.895322 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:05.895300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:06.176801 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.176775    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"]
Sep 17 18:17:06.178856 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:17:06.178827    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a9c759_12f5_492c_a6cb_e621dd9e8930.slice/crio-5d09270c6a3fe12074370eb875feec7d58d1a119a8ff108a3d329b6183f439b6 WatchSource:0}: Error finding container 5d09270c6a3fe12074370eb875feec7d58d1a119a8ff108a3d329b6183f439b6: Status 404 returned error can't find the container with id 5d09270c6a3fe12074370eb875feec7d58d1a119a8ff108a3d329b6183f439b6
Sep 17 18:17:06.605416 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.605382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" event={"ID":"e6a9c759-12f5-492c-a6cb-e621dd9e8930","Type":"ContainerStarted","Data":"22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1"}
Sep 17 18:17:06.605595 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.605467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" event={"ID":"e6a9c759-12f5-492c-a6cb-e621dd9e8930","Type":"ContainerStarted","Data":"6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a"}
Sep 17 18:17:06.605595 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.605491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" event={"ID":"e6a9c759-12f5-492c-a6cb-e621dd9e8930","Type":"ContainerStarted","Data":"5d09270c6a3fe12074370eb875feec7d58d1a119a8ff108a3d329b6183f439b6"}
Sep 17 18:17:06.605595 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.605523    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:06.605595 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.605550    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:06.606935 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.606889    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Sep 17 18:17:06.624941 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:06.624878    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podStartSLOduration=2.624865582 podStartE2EDuration="2.624865582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:17:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:17:06.623977606 +0000 UTC m=+1229.376717934" watchObservedRunningTime="2026-09-17 18:17:06.624865582 +0000 UTC m=+1229.377605910"
Sep 17 18:17:07.612515 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.612483    2577 generic.go:356] "Generic (PLEG): container finished" podID="fc843b63-9526-4a17-8dad-76b356842474" containerID="8fc50182e4e938a6676ad14373014e9ab0f05284c95d5e1a879a87efacd5d048" exitCode=0
Sep 17 18:17:07.612834 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.612527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" event={"ID":"fc843b63-9526-4a17-8dad-76b356842474","Type":"ContainerDied","Data":"8fc50182e4e938a6676ad14373014e9ab0f05284c95d5e1a879a87efacd5d048"}
Sep 17 18:17:07.612888 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.612866    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Sep 17 18:17:07.847607 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.847576    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:17:07.938146 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.938092    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzbwm\" (UniqueName: \"kubernetes.io/projected/fc843b63-9526-4a17-8dad-76b356842474-kube-api-access-xzbwm\") pod \"fc843b63-9526-4a17-8dad-76b356842474\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") "
Sep 17 18:17:07.938146 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.938121    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc843b63-9526-4a17-8dad-76b356842474-kube-rbac-proxy-sar-config\") pod \"fc843b63-9526-4a17-8dad-76b356842474\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") "
Sep 17 18:17:07.938319 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.938167    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls\") pod \"fc843b63-9526-4a17-8dad-76b356842474\" (UID: \"fc843b63-9526-4a17-8dad-76b356842474\") "
Sep 17 18:17:07.938480 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.938456    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc843b63-9526-4a17-8dad-76b356842474-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "fc843b63-9526-4a17-8dad-76b356842474" (UID: "fc843b63-9526-4a17-8dad-76b356842474"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:17:07.940248 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.940224    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc843b63-9526-4a17-8dad-76b356842474-kube-api-access-xzbwm" (OuterVolumeSpecName: "kube-api-access-xzbwm") pod "fc843b63-9526-4a17-8dad-76b356842474" (UID: "fc843b63-9526-4a17-8dad-76b356842474"). InnerVolumeSpecName "kube-api-access-xzbwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:17:07.940336 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:07.940258    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fc843b63-9526-4a17-8dad-76b356842474" (UID: "fc843b63-9526-4a17-8dad-76b356842474"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:17:08.038885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.038862    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzbwm\" (UniqueName: \"kubernetes.io/projected/fc843b63-9526-4a17-8dad-76b356842474-kube-api-access-xzbwm\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:17:08.038885 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.038882    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/fc843b63-9526-4a17-8dad-76b356842474-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:17:08.039021 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.038892    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fc843b63-9526-4a17-8dad-76b356842474-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:17:08.618799 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.618772    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"
Sep 17 18:17:08.619166 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.618802    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6" event={"ID":"fc843b63-9526-4a17-8dad-76b356842474","Type":"ContainerDied","Data":"dce057498cb622bd03ddb4a4d16b1c4f0ca2b974a9cfebfbf9d43486305a8f5a"}
Sep 17 18:17:08.619166 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.618863    2577 scope.go:117] "RemoveContainer" containerID="f21bcdf1741187779e82b8f5faf41ddf64863ddaf91523be15d5e4d2a5441540"
Sep 17 18:17:08.627680 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.627665    2577 scope.go:117] "RemoveContainer" containerID="8fc50182e4e938a6676ad14373014e9ab0f05284c95d5e1a879a87efacd5d048"
Sep 17 18:17:08.641353 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.641333    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"]
Sep 17 18:17:08.646606 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:08.646585    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-0c0cc-predictor-55555bf8bd-d9fb6"]
Sep 17 18:17:09.326028 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:09.326000    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc843b63-9526-4a17-8dad-76b356842474" path="/var/lib/kubelet/pods/fc843b63-9526-4a17-8dad-76b356842474/volumes"
Sep 17 18:17:12.616989 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:12.616957    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:17:12.617439 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:12.617389    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Sep 17 18:17:22.618418 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:22.618339    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Sep 17 18:17:32.617387 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:32.617348    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Sep 17 18:17:42.617973 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:42.617936    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Sep 17 18:17:52.618045 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:17:52.618018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:18:01.376482 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.376449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:01.469429 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.469385    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:01.469614 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.469573    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"]
Sep 17 18:18:01.469858 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.469827    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" containerID="cri-o://b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a" gracePeriod=30
Sep 17 18:18:01.470012 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.469893    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kube-rbac-proxy" containerID="cri-o://d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90" gracePeriod=30
Sep 17 18:18:01.528582 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.528458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:01.628600 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.628531    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:01.643208 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643187    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"]
Sep 17 18:18:01.643549 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643536    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kube-rbac-proxy"
Sep 17 18:18:01.643596 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643553    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kube-rbac-proxy"
Sep 17 18:18:01.643596 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643568    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container"
Sep 17 18:18:01.643596 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643574    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container"
Sep 17 18:18:01.643691 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643661    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kube-rbac-proxy"
Sep 17 18:18:01.643691 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.643673    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc843b63-9526-4a17-8dad-76b356842474" containerName="kserve-container"
Sep 17 18:18:01.646811 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.646797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.649027 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.649006    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-fb34c-kube-rbac-proxy-sar-config\""
Sep 17 18:18:01.649282 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.649257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-fb34c-predictor-serving-cert\""
Sep 17 18:18:01.657212 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.657188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"]
Sep 17 18:18:01.705991 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.705964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:01.708634 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.708606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.708733 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.708647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbb6d\" (UniqueName: \"kubernetes.io/projected/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-api-access-tbb6d\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.708733 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.708696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.809756 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.809716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.809867 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.809772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbb6d\" (UniqueName: \"kubernetes.io/projected/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-api-access-tbb6d\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.809867 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.809798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.810013 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:01.809962    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-serving-cert: secret "error-404-isvc-fb34c-predictor-serving-cert" not found
Sep 17 18:18:01.810064 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:01.810014    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls podName:3707b25a-b382-4f65-bc24-5d97d035ad62 nodeName:}" failed. No retries permitted until 2026-09-17 18:18:02.309999662 +0000 UTC m=+1285.062739981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls") pod "error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" (UID: "3707b25a-b382-4f65-bc24-5d97d035ad62") : secret "error-404-isvc-fb34c-predictor-serving-cert" not found
Sep 17 18:18:01.810421 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.810401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.822035 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.822016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbb6d\" (UniqueName: \"kubernetes.io/projected/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-api-access-tbb6d\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:01.846971 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.846947    2577 generic.go:356] "Generic (PLEG): container finished" podID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerID="d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90" exitCode=2
Sep 17 18:18:01.847133 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.847020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" event={"ID":"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5","Type":"ContainerDied","Data":"d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90"}
Sep 17 18:18:01.856107 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:01.856078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:02.096502 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:02.096469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:02.312618 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:02.312583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:02.315065 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:02.315043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls\") pod \"error-404-isvc-fb34c-predictor-67b8546c54-4wjz5\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") " pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:02.558403 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:02.558376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:02.830012 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:02.829939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"]
Sep 17 18:18:02.832875 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:18:02.832848    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3707b25a_b382_4f65_bc24_5d97d035ad62.slice/crio-cac4862384874f4f3aa6c0243debaa965bbb0b3a56a72f24466ddb3fb91f735e WatchSource:0}: Error finding container cac4862384874f4f3aa6c0243debaa965bbb0b3a56a72f24466ddb3fb91f735e: Status 404 returned error can't find the container with id cac4862384874f4f3aa6c0243debaa965bbb0b3a56a72f24466ddb3fb91f735e
Sep 17 18:18:02.853353 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:02.853324    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" event={"ID":"3707b25a-b382-4f65-bc24-5d97d035ad62","Type":"ContainerStarted","Data":"cac4862384874f4f3aa6c0243debaa965bbb0b3a56a72f24466ddb3fb91f735e"}
Sep 17 18:18:03.859922 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:03.859876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" event={"ID":"3707b25a-b382-4f65-bc24-5d97d035ad62","Type":"ContainerStarted","Data":"7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544"}
Sep 17 18:18:03.860276 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:03.859944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" event={"ID":"3707b25a-b382-4f65-bc24-5d97d035ad62","Type":"ContainerStarted","Data":"10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932"}
Sep 17 18:18:03.860276 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:03.860056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:03.878151 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:03.878099    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podStartSLOduration=2.878085396 podStartE2EDuration="2.878085396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:18:03.876268181 +0000 UTC m=+1286.629008533" watchObservedRunningTime="2026-09-17 18:18:03.878085396 +0000 UTC m=+1286.630825722"
Sep 17 18:18:04.395911 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.395870    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused"
Sep 17 18:18:04.401368 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.401326    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Sep 17 18:18:04.523458 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.523438    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:18:04.630883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.630822    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8sxj\" (UniqueName: \"kubernetes.io/projected/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-api-access-p8sxj\") pod \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") "
Sep 17 18:18:04.630883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.630876    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls\") pod \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") "
Sep 17 18:18:04.631093 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.630999    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-rbac-proxy-sar-config\") pod \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\" (UID: \"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5\") "
Sep 17 18:18:04.631349 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.631325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" (UID: "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:18:04.632995 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.632967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" (UID: "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:18:04.633092 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.633059    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-api-access-p8sxj" (OuterVolumeSpecName: "kube-api-access-p8sxj") pod "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" (UID: "0b73cbc3-6f10-4ef1-986c-1d2f538bfef5"). InnerVolumeSpecName "kube-api-access-p8sxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:18:04.731896 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.731875    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:18:04.731896 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.731893    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8sxj\" (UniqueName: \"kubernetes.io/projected/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-kube-api-access-p8sxj\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:18:04.732053 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.731922    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:18:04.867627 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.867595    2577 generic.go:356] "Generic (PLEG): container finished" podID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerID="b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a" exitCode=0
Sep 17 18:18:04.868030 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.867634    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"
Sep 17 18:18:04.868030 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.867654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" event={"ID":"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5","Type":"ContainerDied","Data":"b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a"}
Sep 17 18:18:04.868030 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.867721    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh" event={"ID":"0b73cbc3-6f10-4ef1-986c-1d2f538bfef5","Type":"ContainerDied","Data":"6e963980bcf0d5606c6c0a8a4a0b72744435b8796887de19175c67a8145a70be"}
Sep 17 18:18:04.868030 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.867758    2577 scope.go:117] "RemoveContainer" containerID="d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90"
Sep 17 18:18:04.868253 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.868170    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:04.869183 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.869157    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 17 18:18:04.877302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.877278    2577 scope.go:117] "RemoveContainer" containerID="b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a"
Sep 17 18:18:04.882132 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.882076    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:04.885257 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.885240    2577 scope.go:117] "RemoveContainer" containerID="d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90"
Sep 17 18:18:04.885521 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:04.885501    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90\": container with ID starting with d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90 not found: ID does not exist" containerID="d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90"
Sep 17 18:18:04.885568 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.885530    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90"} err="failed to get container status \"d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90\": rpc error: code = NotFound desc = could not find container \"d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90\": container with ID starting with d677e7b6e3cfe1a67b29549a916e5fa18911abb00c162ab20942e76de219ea90 not found: ID does not exist"
Sep 17 18:18:04.885568 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.885547    2577 scope.go:117] "RemoveContainer" containerID="b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a"
Sep 17 18:18:04.885774 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:04.885755    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a\": container with ID starting with b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a not found: ID does not exist" containerID="b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a"
Sep 17 18:18:04.885816 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.885783    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a"} err="failed to get container status \"b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a\": rpc error: code = NotFound desc = could not find container \"b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a\": container with ID starting with b52bac13fbe1af451d776df66366e04ee67d1a4efbdfd7eef139210a4e0da50a not found: ID does not exist"
Sep 17 18:18:04.891807 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.891788    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"]
Sep 17 18:18:04.899669 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:04.899651    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-4a77e-predictor-66c6b8db58-dcpsh"]
Sep 17 18:18:05.182701 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:05.182636    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:05.325281 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:05.325257    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" path="/var/lib/kubelet/pods/0b73cbc3-6f10-4ef1-986c-1d2f538bfef5/volumes"
Sep 17 18:18:05.873073 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:05.873039    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 17 18:18:10.877603 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:10.877572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:10.878101 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:10.878072    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 17 18:18:14.961353 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:14.961274    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.063469 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.063430    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.073378 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.073350    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"]
Sep 17 18:18:15.073649 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.073602    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container" containerID="cri-o://6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a" gracePeriod=30
Sep 17 18:18:15.073762 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.073672    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kube-rbac-proxy" containerID="cri-o://22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1" gracePeriod=30
Sep 17 18:18:15.154096 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.154065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.224955 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.224843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.253039 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253016    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"]
Sep 17 18:18:15.253332 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253321    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container"
Sep 17 18:18:15.253374 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253334    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container"
Sep 17 18:18:15.253374 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253351    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kube-rbac-proxy"
Sep 17 18:18:15.253374 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253356    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kube-rbac-proxy"
Sep 17 18:18:15.253488 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253416    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kube-rbac-proxy"
Sep 17 18:18:15.253488 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.253424    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b73cbc3-6f10-4ef1-986c-1d2f538bfef5" containerName="kserve-container"
Sep 17 18:18:15.256522 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.256505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.258952 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.258931    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-2aa9e-kube-rbac-proxy-sar-config\""
Sep 17 18:18:15.259066 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.258948    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-2aa9e-predictor-serving-cert\""
Sep 17 18:18:15.265673 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.265643    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"]
Sep 17 18:18:15.294510 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.294480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.358853 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.358817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.403271 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.403250    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.403392 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.403306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.403392 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.403371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrqdz\" (UniqueName: \"kubernetes.io/projected/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-api-access-xrqdz\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.504648 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.504587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.504744 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.504660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.504744 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.504687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrqdz\" (UniqueName: \"kubernetes.io/projected/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-api-access-xrqdz\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.504830 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:15.504744    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-serving-cert: secret "error-404-isvc-2aa9e-predictor-serving-cert" not found
Sep 17 18:18:15.504830 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:15.504809    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls podName:c5bf2834-b504-440c-b5e4-c36e8cdd84c0 nodeName:}" failed. No retries permitted until 2026-09-17 18:18:16.004790156 +0000 UTC m=+1298.757530476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls") pod "error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" (UID: "c5bf2834-b504-440c-b5e4-c36e8cdd84c0") : secret "error-404-isvc-2aa9e-predictor-serving-cert" not found
Sep 17 18:18:15.505292 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.505269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.515802 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.515776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrqdz\" (UniqueName: \"kubernetes.io/projected/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-api-access-xrqdz\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:15.653399 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.653369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:15.925024 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.924991    2577 generic.go:356] "Generic (PLEG): container finished" podID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerID="22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1" exitCode=2
Sep 17 18:18:15.925192 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:15.925074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" event={"ID":"e6a9c759-12f5-492c-a6cb-e621dd9e8930","Type":"ContainerDied","Data":"22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1"}
Sep 17 18:18:16.007662 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.007635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:16.010136 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.010112    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls\") pod \"error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") " pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:16.169039 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.169002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:16.441205 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.441175    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"]
Sep 17 18:18:16.443078 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:18:16.443052    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5bf2834_b504_440c_b5e4_c36e8cdd84c0.slice/crio-490f1d6b10281a1c7e7bc8a025214ab6e970983f43364634e47d5315d39f1172 WatchSource:0}: Error finding container 490f1d6b10281a1c7e7bc8a025214ab6e970983f43364634e47d5315d39f1172: Status 404 returned error can't find the container with id 490f1d6b10281a1c7e7bc8a025214ab6e970983f43364634e47d5315d39f1172
Sep 17 18:18:16.931743 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.931707    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" event={"ID":"c5bf2834-b504-440c-b5e4-c36e8cdd84c0","Type":"ContainerStarted","Data":"50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734"}
Sep 17 18:18:16.931948 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.931768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" event={"ID":"c5bf2834-b504-440c-b5e4-c36e8cdd84c0","Type":"ContainerStarted","Data":"f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1"}
Sep 17 18:18:16.931948 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.931791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" event={"ID":"c5bf2834-b504-440c-b5e4-c36e8cdd84c0","Type":"ContainerStarted","Data":"490f1d6b10281a1c7e7bc8a025214ab6e970983f43364634e47d5315d39f1172"}
Sep 17 18:18:16.931948 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.931896    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:16.949395 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:16.949347    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podStartSLOduration=1.949333553 podStartE2EDuration="1.949333553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:18:16.948163663 +0000 UTC m=+1299.700903993" watchObservedRunningTime="2026-09-17 18:18:16.949333553 +0000 UTC m=+1299.702073880"
Sep 17 18:18:17.613366 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.613325    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.36:8643/healthz\": dial tcp 10.133.0.36:8643: connect: connection refused"
Sep 17 18:18:17.924968 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.924939    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:18:17.937208 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.937186    2577 generic.go:356] "Generic (PLEG): container finished" podID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerID="6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a" exitCode=0
Sep 17 18:18:17.937306 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.937226    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"
Sep 17 18:18:17.937306 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.937278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" event={"ID":"e6a9c759-12f5-492c-a6cb-e621dd9e8930","Type":"ContainerDied","Data":"6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a"}
Sep 17 18:18:17.937385 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.937334    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq" event={"ID":"e6a9c759-12f5-492c-a6cb-e621dd9e8930","Type":"ContainerDied","Data":"5d09270c6a3fe12074370eb875feec7d58d1a119a8ff108a3d329b6183f439b6"}
Sep 17 18:18:17.937385 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.937362    2577 scope.go:117] "RemoveContainer" containerID="22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1"
Sep 17 18:18:17.937584 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.937561    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:17.938968 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.938946    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Sep 17 18:18:17.946738 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.946722    2577 scope.go:117] "RemoveContainer" containerID="6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a"
Sep 17 18:18:17.954340 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.954324    2577 scope.go:117] "RemoveContainer" containerID="22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1"
Sep 17 18:18:17.954565 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:17.954546    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1\": container with ID starting with 22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1 not found: ID does not exist" containerID="22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1"
Sep 17 18:18:17.954656 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.954569    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1"} err="failed to get container status \"22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1\": rpc error: code = NotFound desc = could not find container \"22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1\": container with ID starting with 22eac27f8f501829903d6a4b2b58d257783c32da7d70fcc26fce062d830e54a1 not found: ID does not exist"
Sep 17 18:18:17.954656 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.954585    2577 scope.go:117] "RemoveContainer" containerID="6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a"
Sep 17 18:18:17.954833 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:18:17.954819    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a\": container with ID starting with 6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a not found: ID does not exist" containerID="6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a"
Sep 17 18:18:17.954881 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:17.954837    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a"} err="failed to get container status \"6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a\": rpc error: code = NotFound desc = could not find container \"6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a\": container with ID starting with 6497198c8bdf497fc89a427a8fec9ec10b6f697af77d3bf4fe8f9b1f23d0239a not found: ID does not exist"
Sep 17 18:18:18.024210 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.024189    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pxdj\" (UniqueName: \"kubernetes.io/projected/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-api-access-5pxdj\") pod \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") "
Sep 17 18:18:18.024355 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.024301    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls\") pod \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") "
Sep 17 18:18:18.024355 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.024332    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-rbac-proxy-sar-config\") pod \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\" (UID: \"e6a9c759-12f5-492c-a6cb-e621dd9e8930\") "
Sep 17 18:18:18.024700 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.024672    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e6a9c759-12f5-492c-a6cb-e621dd9e8930" (UID: "e6a9c759-12f5-492c-a6cb-e621dd9e8930"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:18:18.026408 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.026388    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-api-access-5pxdj" (OuterVolumeSpecName: "kube-api-access-5pxdj") pod "e6a9c759-12f5-492c-a6cb-e621dd9e8930" (UID: "e6a9c759-12f5-492c-a6cb-e621dd9e8930"). InnerVolumeSpecName "kube-api-access-5pxdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:18:18.026488 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.026465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e6a9c759-12f5-492c-a6cb-e621dd9e8930" (UID: "e6a9c759-12f5-492c-a6cb-e621dd9e8930"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:18:18.125144 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.125121    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e6a9c759-12f5-492c-a6cb-e621dd9e8930-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:18:18.125144 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.125141    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:18:18.125270 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.125152    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pxdj\" (UniqueName: \"kubernetes.io/projected/e6a9c759-12f5-492c-a6cb-e621dd9e8930-kube-api-access-5pxdj\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:18:18.258775 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.258747    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"]
Sep 17 18:18:18.264407 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.264389    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b0976-predictor-65dc4f7b7d-4n7pq"]
Sep 17 18:18:18.942586 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:18.942554    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Sep 17 18:18:19.325628 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:19.325598    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" path="/var/lib/kubelet/pods/e6a9c759-12f5-492c-a6cb-e621dd9e8930/volumes"
Sep 17 18:18:20.878623 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:20.878587    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 17 18:18:23.948302 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:23.948274    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:18:23.948777 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:23.948750    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Sep 17 18:18:30.878431 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:30.878393    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 17 18:18:31.324938 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:31.324881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:18:33.949622 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:33.949577    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Sep 17 18:18:40.878632 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:40.878594    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Sep 17 18:18:43.948929 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:43.948865    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Sep 17 18:18:50.879116 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:50.879034    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:18:53.949589 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:18:53.949554    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Sep 17 18:19:01.550166 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:01.550129    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:01.681203 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:01.681169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:03.949534 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:03.949508    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:19:11.645448 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.645412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:11.738417 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.738387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:11.745837 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.745808    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"]
Sep 17 18:19:11.746151 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.746116    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container" containerID="cri-o://10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932" gracePeriod=30
Sep 17 18:19:11.746867 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.746387    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kube-rbac-proxy" containerID="cri-o://7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544" gracePeriod=30
Sep 17 18:19:11.832119 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.832084    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:11.903843 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.903754    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:11.927587 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927554    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"]
Sep 17 18:19:11.927883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927871    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container"
Sep 17 18:19:11.927942 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927885    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container"
Sep 17 18:19:11.927942 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927912    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kube-rbac-proxy"
Sep 17 18:19:11.927942 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927921    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kube-rbac-proxy"
Sep 17 18:19:11.928038 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927987    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kube-rbac-proxy"
Sep 17 18:19:11.928038 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.927998    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a9c759-12f5-492c-a6cb-e621dd9e8930" containerName="kserve-container"
Sep 17 18:19:11.930889 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.930873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:11.933654 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.933636    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-04b70-predictor-serving-cert\""
Sep 17 18:19:11.933751 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.933636    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-04b70-kube-rbac-proxy-sar-config\""
Sep 17 18:19:11.942986 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:11.942966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"]
Sep 17 18:19:12.002547 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.002516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-proxy-tls\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.002666 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.002554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xhs\" (UniqueName: \"kubernetes.io/projected/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-api-access-b5xhs\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.002666 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.002650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.003424 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.003401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:12.103964 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.103942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.104065 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.104002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-proxy-tls\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.104124 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.104106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xhs\" (UniqueName: \"kubernetes.io/projected/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-api-access-b5xhs\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.104837 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.104766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.105430 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.105405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:12.106874 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.106857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-proxy-tls\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.112432 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.112410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xhs\" (UniqueName: \"kubernetes.io/projected/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-api-access-b5xhs\") pod \"error-404-isvc-04b70-predictor-5cff8969d4-8k7db\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") " pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.169936 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.169873    2577 generic.go:356] "Generic (PLEG): container finished" podID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerID="7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544" exitCode=2
Sep 17 18:19:12.169936 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.169928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" event={"ID":"3707b25a-b382-4f65-bc24-5d97d035ad62","Type":"ContainerDied","Data":"7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544"}
Sep 17 18:19:12.241429 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.241408    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:12.406676 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.406650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:12.511324 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:12.511295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"]
Sep 17 18:19:12.516597 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:19:12.516569    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989023f8_495b_4a1c_8ff2_47ee07d4f3e2.slice/crio-5f0e8da003cc20eeb9f87397ebb2d83a2b5de593d03a701926cce97c9836bd8a WatchSource:0}: Error finding container 5f0e8da003cc20eeb9f87397ebb2d83a2b5de593d03a701926cce97c9836bd8a: Status 404 returned error can't find the container with id 5f0e8da003cc20eeb9f87397ebb2d83a2b5de593d03a701926cce97c9836bd8a
Sep 17 18:19:13.177178 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.177136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" event={"ID":"989023f8-495b-4a1c-8ff2-47ee07d4f3e2","Type":"ContainerStarted","Data":"419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c"}
Sep 17 18:19:13.177535 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.177219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" event={"ID":"989023f8-495b-4a1c-8ff2-47ee07d4f3e2","Type":"ContainerStarted","Data":"9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f"}
Sep 17 18:19:13.177535 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.177251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" event={"ID":"989023f8-495b-4a1c-8ff2-47ee07d4f3e2","Type":"ContainerStarted","Data":"5f0e8da003cc20eeb9f87397ebb2d83a2b5de593d03a701926cce97c9836bd8a"}
Sep 17 18:19:13.177535 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.177281    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:13.177535 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.177308    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:13.178751 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.178725    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:19:13.193498 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:13.193458    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podStartSLOduration=2.193444826 podStartE2EDuration="2.193444826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:19:13.192422448 +0000 UTC m=+1355.945162771" watchObservedRunningTime="2026-09-17 18:19:13.193444826 +0000 UTC m=+1355.946185153"
Sep 17 18:19:14.182270 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.182227    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:19:14.397466 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.397445    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:19:14.425868 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.425841    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls\") pod \"3707b25a-b382-4f65-bc24-5d97d035ad62\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") "
Sep 17 18:19:14.426025 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.425884    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-rbac-proxy-sar-config\") pod \"3707b25a-b382-4f65-bc24-5d97d035ad62\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") "
Sep 17 18:19:14.426025 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.425983    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbb6d\" (UniqueName: \"kubernetes.io/projected/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-api-access-tbb6d\") pod \"3707b25a-b382-4f65-bc24-5d97d035ad62\" (UID: \"3707b25a-b382-4f65-bc24-5d97d035ad62\") "
Sep 17 18:19:14.426299 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.426273    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3707b25a-b382-4f65-bc24-5d97d035ad62" (UID: "3707b25a-b382-4f65-bc24-5d97d035ad62"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:19:14.428070 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.428051    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-api-access-tbb6d" (OuterVolumeSpecName: "kube-api-access-tbb6d") pod "3707b25a-b382-4f65-bc24-5d97d035ad62" (UID: "3707b25a-b382-4f65-bc24-5d97d035ad62"). InnerVolumeSpecName "kube-api-access-tbb6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:19:14.428524 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.428493    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3707b25a-b382-4f65-bc24-5d97d035ad62" (UID: "3707b25a-b382-4f65-bc24-5d97d035ad62"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:19:14.527132 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.527108    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbb6d\" (UniqueName: \"kubernetes.io/projected/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-api-access-tbb6d\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:19:14.527132 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.527130    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3707b25a-b382-4f65-bc24-5d97d035ad62-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:19:14.527249 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:14.527139    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3707b25a-b382-4f65-bc24-5d97d035ad62-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:19:15.169386 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.169356    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:15.188395 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.188363    2577 generic.go:356] "Generic (PLEG): container finished" podID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerID="10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932" exitCode=0
Sep 17 18:19:15.188725 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.188419    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"
Sep 17 18:19:15.188725 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.188441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" event={"ID":"3707b25a-b382-4f65-bc24-5d97d035ad62","Type":"ContainerDied","Data":"10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932"}
Sep 17 18:19:15.188725 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.188503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5" event={"ID":"3707b25a-b382-4f65-bc24-5d97d035ad62","Type":"ContainerDied","Data":"cac4862384874f4f3aa6c0243debaa965bbb0b3a56a72f24466ddb3fb91f735e"}
Sep 17 18:19:15.188725 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.188531    2577 scope.go:117] "RemoveContainer" containerID="7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544"
Sep 17 18:19:15.198208 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.198189    2577 scope.go:117] "RemoveContainer" containerID="10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932"
Sep 17 18:19:15.208928 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.208889    2577 scope.go:117] "RemoveContainer" containerID="7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544"
Sep 17 18:19:15.209504 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:19:15.209480    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544\": container with ID starting with 7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544 not found: ID does not exist" containerID="7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544"
Sep 17 18:19:15.209597 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.209516    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544"} err="failed to get container status \"7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544\": rpc error: code = NotFound desc = could not find container \"7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544\": container with ID starting with 7672365216e0f1483ead19b42b37f63fac4ea34ff5ebaf7a52204b346ddbd544 not found: ID does not exist"
Sep 17 18:19:15.209597 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.209538    2577 scope.go:117] "RemoveContainer" containerID="10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932"
Sep 17 18:19:15.209896 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:19:15.209877    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932\": container with ID starting with 10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932 not found: ID does not exist" containerID="10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932"
Sep 17 18:19:15.209991 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.209924    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932"} err="failed to get container status \"10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932\": rpc error: code = NotFound desc = could not find container \"10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932\": container with ID starting with 10e059cf657299d54955f7141dfa37e4da62d55211479c92eab4e2d325e85932 not found: ID does not exist"
Sep 17 18:19:15.210933 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.210894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"]
Sep 17 18:19:15.213288 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.213268    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-fb34c-predictor-67b8546c54-4wjz5"]
Sep 17 18:19:15.312451 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.312410    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:19:15.326537 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:15.326511    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" path="/var/lib/kubelet/pods/3707b25a-b382-4f65-bc24-5d97d035ad62/volumes"
Sep 17 18:19:19.186173 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:19.186147    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:19:19.186627 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:19.186596    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:19:29.186702 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:29.186664    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:19:39.186620 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:39.186581    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:19:49.187038 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:49.187006    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:19:59.187707 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:19:59.187680    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:20:11.902550 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:20:11.902505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:20:12.074238 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:20:12.074202    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:20:31.974578 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:20:31.974509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:20:43.346293 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:20:43.346263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:21:39.384716 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:21:39.384690    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:21:39.389596 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:21:39.389577    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:21:39.393152 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:21:39.393131    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:21:39.397626 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:21:39.397610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:21:39.841979 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:21:39.841951    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:25:03.428325 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:25:03.428251    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:26:39.412338 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:26:39.412308    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:26:39.418889 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:26:39.418870    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:26:39.421499 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:26:39.421478    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:26:39.427330 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:26:39.427313    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:27:29.798815 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:29.798774    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:27:29.893012 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:29.892975    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:27:29.943043 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:29.943011    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"]
Sep 17 18:27:29.943548 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:29.943520    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container" containerID="cri-o://f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1" gracePeriod=30
Sep 17 18:27:29.943788 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:29.943618    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kube-rbac-proxy" containerID="cri-o://50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734" gracePeriod=30
Sep 17 18:27:29.967753 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:29.967732    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:27:30.044454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044428    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"]
Sep 17 18:27:30.044763 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044752    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kube-rbac-proxy"
Sep 17 18:27:30.044809 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044765    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kube-rbac-proxy"
Sep 17 18:27:30.044809 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044780    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container"
Sep 17 18:27:30.044809 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044785    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container"
Sep 17 18:27:30.044936 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044838    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kserve-container"
Sep 17 18:27:30.044936 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.044847    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3707b25a-b382-4f65-bc24-5d97d035ad62" containerName="kube-rbac-proxy"
Sep 17 18:27:30.047923 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.047874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.048321 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.048297    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:27:30.050398 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.050327    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e0a3a-predictor-serving-cert\""
Sep 17 18:27:30.050398 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.050334    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e0a3a-kube-rbac-proxy-sar-config\""
Sep 17 18:27:30.058765 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.058742    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"]
Sep 17 18:27:30.100418 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.100389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.100539 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.100435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w994v\" (UniqueName: \"kubernetes.io/projected/f637e287-3f12-4437-b888-bb632303b794-kube-api-access-w994v\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.100539 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.100466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f637e287-3f12-4437-b888-bb632303b794-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.201713 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.201687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.201830 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.201720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w994v\" (UniqueName: \"kubernetes.io/projected/f637e287-3f12-4437-b888-bb632303b794-kube-api-access-w994v\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.201830 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.201741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f637e287-3f12-4437-b888-bb632303b794-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.202012 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:27:30.201858    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-serving-cert: secret "error-404-isvc-e0a3a-predictor-serving-cert" not found
Sep 17 18:27:30.202012 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:27:30.201952    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls podName:f637e287-3f12-4437-b888-bb632303b794 nodeName:}" failed. No retries permitted until 2026-09-17 18:27:30.701932439 +0000 UTC m=+1853.454672758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls") pod "error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" (UID: "f637e287-3f12-4437-b888-bb632303b794") : secret "error-404-isvc-e0a3a-predictor-serving-cert" not found
Sep 17 18:27:30.202334 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.202317    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f637e287-3f12-4437-b888-bb632303b794-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.212367 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.212339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w994v\" (UniqueName: \"kubernetes.io/projected/f637e287-3f12-4437-b888-bb632303b794-kube-api-access-w994v\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.331021 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.330959    2577 generic.go:356] "Generic (PLEG): container finished" podID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerID="50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734" exitCode=2
Sep 17 18:27:30.331021 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.330992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" event={"ID":"c5bf2834-b504-440c-b5e4-c36e8cdd84c0","Type":"ContainerDied","Data":"50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734"}
Sep 17 18:27:30.448549 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.448521    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:27:30.564608 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.564580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:27:30.705601 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.705538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.708087 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.708063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls\") pod \"error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") " pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:30.962653 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:30.962564    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:31.235435 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:31.235364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"]
Sep 17 18:27:31.238953 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:27:31.238926    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf637e287_3f12_4437_b888_bb632303b794.slice/crio-c12cc8dc1689135a6bed1ac2097bcc2bef970c6fdffcedc7afaf38ba46d133a3 WatchSource:0}: Error finding container c12cc8dc1689135a6bed1ac2097bcc2bef970c6fdffcedc7afaf38ba46d133a3: Status 404 returned error can't find the container with id c12cc8dc1689135a6bed1ac2097bcc2bef970c6fdffcedc7afaf38ba46d133a3
Sep 17 18:27:31.336935 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:31.336889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" event={"ID":"f637e287-3f12-4437-b888-bb632303b794","Type":"ContainerStarted","Data":"a0d90402dfb4d9893a65475f4c2e98861b1aed51e8b1cb5c023f69eb4525c4fd"}
Sep 17 18:27:31.337040 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:31.336960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" event={"ID":"f637e287-3f12-4437-b888-bb632303b794","Type":"ContainerStarted","Data":"c12cc8dc1689135a6bed1ac2097bcc2bef970c6fdffcedc7afaf38ba46d133a3"}
Sep 17 18:27:32.342975 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.342939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" event={"ID":"f637e287-3f12-4437-b888-bb632303b794","Type":"ContainerStarted","Data":"b07682aae3a815c4edbe6184f23f0e2178d9719c644951530cdd261d6db7b588"}
Sep 17 18:27:32.343369 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.343036    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:32.361250 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.361207    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podStartSLOduration=2.36119296 podStartE2EDuration="2.36119296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:27:32.360126257 +0000 UTC m=+1855.112866579" watchObservedRunningTime="2026-09-17 18:27:32.36119296 +0000 UTC m=+1855.113933288"
Sep 17 18:27:32.696407 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.696384    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:27:32.721088 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.721058    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-rbac-proxy-sar-config\") pod \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") "
Sep 17 18:27:32.721233 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.721211    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrqdz\" (UniqueName: \"kubernetes.io/projected/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-api-access-xrqdz\") pod \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") "
Sep 17 18:27:32.721521 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.721294    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls\") pod \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\" (UID: \"c5bf2834-b504-440c-b5e4-c36e8cdd84c0\") "
Sep 17 18:27:32.721945 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.721892    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c5bf2834-b504-440c-b5e4-c36e8cdd84c0" (UID: "c5bf2834-b504-440c-b5e4-c36e8cdd84c0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:27:32.723801 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.723772    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-api-access-xrqdz" (OuterVolumeSpecName: "kube-api-access-xrqdz") pod "c5bf2834-b504-440c-b5e4-c36e8cdd84c0" (UID: "c5bf2834-b504-440c-b5e4-c36e8cdd84c0"). InnerVolumeSpecName "kube-api-access-xrqdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:27:32.723935 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.723897    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c5bf2834-b504-440c-b5e4-c36e8cdd84c0" (UID: "c5bf2834-b504-440c-b5e4-c36e8cdd84c0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:27:32.822437 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.822414    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:27:32.822437 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.822437    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:27:32.822570 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:32.822447    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrqdz\" (UniqueName: \"kubernetes.io/projected/c5bf2834-b504-440c-b5e4-c36e8cdd84c0-kube-api-access-xrqdz\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:27:33.348690 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.348661    2577 generic.go:356] "Generic (PLEG): container finished" podID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerID="f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1" exitCode=0
Sep 17 18:27:33.349138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.348733    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"
Sep 17 18:27:33.349138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.348743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" event={"ID":"c5bf2834-b504-440c-b5e4-c36e8cdd84c0","Type":"ContainerDied","Data":"f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1"}
Sep 17 18:27:33.349138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.348822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85" event={"ID":"c5bf2834-b504-440c-b5e4-c36e8cdd84c0","Type":"ContainerDied","Data":"490f1d6b10281a1c7e7bc8a025214ab6e970983f43364634e47d5315d39f1172"}
Sep 17 18:27:33.349138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.348852    2577 scope.go:117] "RemoveContainer" containerID="50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734"
Sep 17 18:27:33.349337 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.349312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:33.350920 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.350870    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Sep 17 18:27:33.357286 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.357265    2577 scope.go:117] "RemoveContainer" containerID="f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1"
Sep 17 18:27:33.365189 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.365146    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"]
Sep 17 18:27:33.365356 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.365331    2577 scope.go:117] "RemoveContainer" containerID="50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734"
Sep 17 18:27:33.365657 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:27:33.365639    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734\": container with ID starting with 50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734 not found: ID does not exist" containerID="50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734"
Sep 17 18:27:33.365738 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.365663    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734"} err="failed to get container status \"50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734\": rpc error: code = NotFound desc = could not find container \"50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734\": container with ID starting with 50541608cdc407d70c3b9830874c1baf39b8d18e37f995c9df1776f1b609d734 not found: ID does not exist"
Sep 17 18:27:33.365738 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.365680    2577 scope.go:117] "RemoveContainer" containerID="f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1"
Sep 17 18:27:33.365988 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:27:33.365968    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1\": container with ID starting with f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1 not found: ID does not exist" containerID="f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1"
Sep 17 18:27:33.366109 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.365994    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1"} err="failed to get container status \"f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1\": rpc error: code = NotFound desc = could not find container \"f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1\": container with ID starting with f877f9ebd953e88352779a189420f47b8482ccd863cae9c79a6b91b04e97d6b1 not found: ID does not exist"
Sep 17 18:27:33.366986 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:33.366965    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-2aa9e-predictor-7ff7b8dffd-82f85"]
Sep 17 18:27:34.354576 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:34.354541    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Sep 17 18:27:35.326636 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:35.326605    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" path="/var/lib/kubelet/pods/c5bf2834-b504-440c-b5e4-c36e8cdd84c0/volumes"
Sep 17 18:27:39.359084 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:39.359052    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:27:39.359459 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:39.359436    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Sep 17 18:27:49.360252 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:49.360206    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Sep 17 18:27:59.359672 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:27:59.359625    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Sep 17 18:28:09.360184 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:09.360141    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Sep 17 18:28:19.360484 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:19.360444    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:28:26.571578 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.571535    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:26.679864 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.679834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:26.696420 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.696394    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"]
Sep 17 18:28:26.696631 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.696608    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" containerID="cri-o://9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f" gracePeriod=30
Sep 17 18:28:26.696715 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.696648    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kube-rbac-proxy" containerID="cri-o://419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c" gracePeriod=30
Sep 17 18:28:26.772628 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.772597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:26.847153 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.847064    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:26.870056 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870028    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"]
Sep 17 18:28:26.870392 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870379    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container"
Sep 17 18:28:26.870454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870394    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container"
Sep 17 18:28:26.870454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870410    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kube-rbac-proxy"
Sep 17 18:28:26.870454 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870419    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kube-rbac-proxy"
Sep 17 18:28:26.870614 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870485    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kube-rbac-proxy"
Sep 17 18:28:26.870614 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.870494    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5bf2834-b504-440c-b5e4-c36e8cdd84c0" containerName="kserve-container"
Sep 17 18:28:26.873626 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.873611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:26.875818 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.875796    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8365d-kube-rbac-proxy-sar-config\""
Sep 17 18:28:26.875949 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.875796    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-8365d-predictor-serving-cert\""
Sep 17 18:28:26.884038 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.884014    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"]
Sep 17 18:28:26.908124 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:26.908100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:27.002978 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.002952    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:27.007994 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.007973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wzzg\" (UniqueName: \"kubernetes.io/projected/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-api-access-4wzzg\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.008086 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.008020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b14627ec-b437-4b19-a2f4-251fa231c2ec-proxy-tls\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.008086 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.008040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.109315 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.109248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wzzg\" (UniqueName: \"kubernetes.io/projected/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-api-access-4wzzg\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.109315 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.109293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b14627ec-b437-4b19-a2f4-251fa231c2ec-proxy-tls\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.109315 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.109313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.110118 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.110059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.112040 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.112021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b14627ec-b437-4b19-a2f4-251fa231c2ec-proxy-tls\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.118646 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.118623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wzzg\" (UniqueName: \"kubernetes.io/projected/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-api-access-4wzzg\") pod \"error-404-isvc-8365d-predictor-7567c8f6b-jgvv5\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") " pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.185247 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.185221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.456042 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.456017    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"]
Sep 17 18:28:27.458363 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:28:27.458335    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14627ec_b437_4b19_a2f4_251fa231c2ec.slice/crio-a6b9ea5bdf1ad7366d0fa051991571c37f988ae3ac5f00e8d4dc01541acb43f8 WatchSource:0}: Error finding container a6b9ea5bdf1ad7366d0fa051991571c37f988ae3ac5f00e8d4dc01541acb43f8: Status 404 returned error can't find the container with id a6b9ea5bdf1ad7366d0fa051991571c37f988ae3ac5f00e8d4dc01541acb43f8
Sep 17 18:28:27.601165 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.601140    2577 generic.go:356] "Generic (PLEG): container finished" podID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerID="419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c" exitCode=2
Sep 17 18:28:27.601476 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.601216    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" event={"ID":"989023f8-495b-4a1c-8ff2-47ee07d4f3e2","Type":"ContainerDied","Data":"419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c"}
Sep 17 18:28:27.602959 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.602931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" event={"ID":"b14627ec-b437-4b19-a2f4-251fa231c2ec","Type":"ContainerStarted","Data":"5bd4f9bdfca92d104632b4c5ae6aa1b71ec4e0ac0c1884b05189cb0f699fd2ef"}
Sep 17 18:28:27.603061 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.602992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" event={"ID":"b14627ec-b437-4b19-a2f4-251fa231c2ec","Type":"ContainerStarted","Data":"e703ee255b6d63686e0caeb36d75e507fe18daa2c581ebd6487a7bf7725da6ec"}
Sep 17 18:28:27.603061 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.603025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" event={"ID":"b14627ec-b437-4b19-a2f4-251fa231c2ec","Type":"ContainerStarted","Data":"a6b9ea5bdf1ad7366d0fa051991571c37f988ae3ac5f00e8d4dc01541acb43f8"}
Sep 17 18:28:27.603061 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.603048    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.603218 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.603107    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:27.604530 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.604510    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Sep 17 18:28:27.622129 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:27.622083    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podStartSLOduration=1.622069045 podStartE2EDuration="1.622069045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:28:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:28:27.619706004 +0000 UTC m=+1910.372446333" watchObservedRunningTime="2026-09-17 18:28:27.622069045 +0000 UTC m=+1910.374809430"
Sep 17 18:28:28.607862 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:28.607810    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Sep 17 18:28:29.183158 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.183112    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.39:8643/healthz\": dial tcp 10.133.0.39:8643: connect: connection refused"
Sep 17 18:28:29.187413 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.187387    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Sep 17 18:28:29.545699 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.545670    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:28:29.614518 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.614483    2577 generic.go:356] "Generic (PLEG): container finished" podID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerID="9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f" exitCode=0
Sep 17 18:28:29.614854 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.614524    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"
Sep 17 18:28:29.614854 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.614564    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" event={"ID":"989023f8-495b-4a1c-8ff2-47ee07d4f3e2","Type":"ContainerDied","Data":"9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f"}
Sep 17 18:28:29.614854 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.614616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db" event={"ID":"989023f8-495b-4a1c-8ff2-47ee07d4f3e2","Type":"ContainerDied","Data":"5f0e8da003cc20eeb9f87397ebb2d83a2b5de593d03a701926cce97c9836bd8a"}
Sep 17 18:28:29.614854 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.614643    2577 scope.go:117] "RemoveContainer" containerID="419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c"
Sep 17 18:28:29.623434 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.623417    2577 scope.go:117] "RemoveContainer" containerID="9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f"
Sep 17 18:28:29.631114 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631098    2577 scope.go:117] "RemoveContainer" containerID="419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c"
Sep 17 18:28:29.631297 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631273    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5xhs\" (UniqueName: \"kubernetes.io/projected/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-api-access-b5xhs\") pod \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") "
Sep 17 18:28:29.631400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631329    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-rbac-proxy-sar-config\") pod \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") "
Sep 17 18:28:29.631400 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:28:29.631353    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c\": container with ID starting with 419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c not found: ID does not exist" containerID="419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c"
Sep 17 18:28:29.631400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631383    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c"} err="failed to get container status \"419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c\": rpc error: code = NotFound desc = could not find container \"419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c\": container with ID starting with 419390e8cc6519145dcd3827d1189c26a54d65bf5209a8a542d1f4c22cb8f93c not found: ID does not exist"
Sep 17 18:28:29.631589 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631405    2577 scope.go:117] "RemoveContainer" containerID="9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f"
Sep 17 18:28:29.631589 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631415    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-proxy-tls\") pod \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\" (UID: \"989023f8-495b-4a1c-8ff2-47ee07d4f3e2\") "
Sep 17 18:28:29.631731 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "989023f8-495b-4a1c-8ff2-47ee07d4f3e2" (UID: "989023f8-495b-4a1c-8ff2-47ee07d4f3e2"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:28:29.631819 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:28:29.631800    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f\": container with ID starting with 9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f not found: ID does not exist" containerID="9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f"
Sep 17 18:28:29.631870 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.631828    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f"} err="failed to get container status \"9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f\": rpc error: code = NotFound desc = could not find container \"9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f\": container with ID starting with 9cbee15359e3afb364499f42f7974b60b04f3e12f9bca4cee3e9111105e7253f not found: ID does not exist"
Sep 17 18:28:29.633447 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.633429    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-api-access-b5xhs" (OuterVolumeSpecName: "kube-api-access-b5xhs") pod "989023f8-495b-4a1c-8ff2-47ee07d4f3e2" (UID: "989023f8-495b-4a1c-8ff2-47ee07d4f3e2"). InnerVolumeSpecName "kube-api-access-b5xhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:28:29.633747 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.633727    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "989023f8-495b-4a1c-8ff2-47ee07d4f3e2" (UID: "989023f8-495b-4a1c-8ff2-47ee07d4f3e2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:28:29.732156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.732107    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:28:29.732156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.732125    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:28:29.732156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.732134    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5xhs\" (UniqueName: \"kubernetes.io/projected/989023f8-495b-4a1c-8ff2-47ee07d4f3e2-kube-api-access-b5xhs\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:28:29.937209 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.937183    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"]
Sep 17 18:28:29.941525 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.941502    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-04b70-predictor-5cff8969d4-8k7db"]
Sep 17 18:28:29.986843 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:29.986780    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:30.411045 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:30.411014    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:31.325536 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:31.325502    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" path="/var/lib/kubelet/pods/989023f8-495b-4a1c-8ff2-47ee07d4f3e2/volumes"
Sep 17 18:28:33.612232 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:33.612202    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:28:33.612678 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:33.612654    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Sep 17 18:28:40.088226 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.088196    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:40.187493 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.187464    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:40.188605 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.188556    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"]
Sep 17 18:28:40.188939 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.188898    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container" containerID="cri-o://a0d90402dfb4d9893a65475f4c2e98861b1aed51e8b1cb5c023f69eb4525c4fd" gracePeriod=30
Sep 17 18:28:40.189058 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.188917    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kube-rbac-proxy" containerID="cri-o://b07682aae3a815c4edbe6184f23f0e2178d9719c644951530cdd261d6db7b588" gracePeriod=30
Sep 17 18:28:40.259722 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.259694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:40.341878 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.341808    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:40.360268 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360236    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"]
Sep 17 18:28:40.360732 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360718    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container"
Sep 17 18:28:40.360779 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360736    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container"
Sep 17 18:28:40.360779 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360750    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kube-rbac-proxy"
Sep 17 18:28:40.360779 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360758    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kube-rbac-proxy"
Sep 17 18:28:40.360883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360829    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kserve-container"
Sep 17 18:28:40.360883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.360840    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="989023f8-495b-4a1c-8ff2-47ee07d4f3e2" containerName="kube-rbac-proxy"
Sep 17 18:28:40.364252 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.364232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.366974 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.366955    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-1a268-kube-rbac-proxy-sar-config\""
Sep 17 18:28:40.367082 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.366958    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-1a268-predictor-serving-cert\""
Sep 17 18:28:40.371971 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.371944    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"]
Sep 17 18:28:40.514097 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.514068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.514215 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.514164    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvps9\" (UniqueName: \"kubernetes.io/projected/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-api-access-cvps9\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.514215 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.514208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.615155 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.615091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvps9\" (UniqueName: \"kubernetes.io/projected/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-api-access-cvps9\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.615155 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.615143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.615314 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.615202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.615387 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:28:40.615319    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-1a268-predictor-serving-cert: secret "error-404-isvc-1a268-predictor-serving-cert" not found
Sep 17 18:28:40.615387 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:28:40.615385    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls podName:201e291b-5dd8-42f6-bbd5-80a7c5730f6f nodeName:}" failed. No retries permitted until 2026-09-17 18:28:41.115367754 +0000 UTC m=+1923.868108066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls") pod "error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" (UID: "201e291b-5dd8-42f6-bbd5-80a7c5730f6f") : secret "error-404-isvc-1a268-predictor-serving-cert" not found
Sep 17 18:28:40.615837 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.615812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.624315 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.624293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvps9\" (UniqueName: \"kubernetes.io/projected/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-api-access-cvps9\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:40.667228 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.667205    2577 generic.go:356] "Generic (PLEG): container finished" podID="f637e287-3f12-4437-b888-bb632303b794" containerID="b07682aae3a815c4edbe6184f23f0e2178d9719c644951530cdd261d6db7b588" exitCode=2
Sep 17 18:28:40.667350 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.667287    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" event={"ID":"f637e287-3f12-4437-b888-bb632303b794","Type":"ContainerDied","Data":"b07682aae3a815c4edbe6184f23f0e2178d9719c644951530cdd261d6db7b588"}
Sep 17 18:28:40.712450 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:40.712428    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:41.080341 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.080292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:28:41.119239 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.119214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:41.121846 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.121820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls\") pod \"error-404-isvc-1a268-predictor-58cf6c8694-2nfg5\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") " pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:41.276604 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.276580    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:41.551394 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.551370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"]
Sep 17 18:28:41.554076 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:28:41.554048    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201e291b_5dd8_42f6_bbd5_80a7c5730f6f.slice/crio-f0bf7bacc924a8b57fbf4b0d449ac4bfdcc4d27f5f4a342070cfaf2e19693c1f WatchSource:0}: Error finding container f0bf7bacc924a8b57fbf4b0d449ac4bfdcc4d27f5f4a342070cfaf2e19693c1f: Status 404 returned error can't find the container with id f0bf7bacc924a8b57fbf4b0d449ac4bfdcc4d27f5f4a342070cfaf2e19693c1f
Sep 17 18:28:41.674126 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.674103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" event={"ID":"201e291b-5dd8-42f6-bbd5-80a7c5730f6f","Type":"ContainerStarted","Data":"6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd"}
Sep 17 18:28:41.674223 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:41.674153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" event={"ID":"201e291b-5dd8-42f6-bbd5-80a7c5730f6f","Type":"ContainerStarted","Data":"f0bf7bacc924a8b57fbf4b0d449ac4bfdcc4d27f5f4a342070cfaf2e19693c1f"}
Sep 17 18:28:42.680659 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:42.680624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" event={"ID":"201e291b-5dd8-42f6-bbd5-80a7c5730f6f","Type":"ContainerStarted","Data":"7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce"}
Sep 17 18:28:42.681068 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:42.680734    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:42.699316 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:42.699273    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podStartSLOduration=2.699256658 podStartE2EDuration="2.699256658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 18:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:28:42.697433321 +0000 UTC m=+1925.450173651" watchObservedRunningTime="2026-09-17 18:28:42.699256658 +0000 UTC m=+1925.451996986"
Sep 17 18:28:43.613157 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:43.612696    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Sep 17 18:28:43.686154 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:43.686123    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:43.687604 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:43.687579    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Sep 17 18:28:44.355430 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:44.355395    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.40:8643/healthz\": dial tcp 10.133.0.40:8643: connect: connection refused"
Sep 17 18:28:44.690092 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:44.690054    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Sep 17 18:28:46.701606 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.701573    2577 generic.go:356] "Generic (PLEG): container finished" podID="f637e287-3f12-4437-b888-bb632303b794" containerID="a0d90402dfb4d9893a65475f4c2e98861b1aed51e8b1cb5c023f69eb4525c4fd" exitCode=0
Sep 17 18:28:46.702014 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.701647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" event={"ID":"f637e287-3f12-4437-b888-bb632303b794","Type":"ContainerDied","Data":"a0d90402dfb4d9893a65475f4c2e98861b1aed51e8b1cb5c023f69eb4525c4fd"}
Sep 17 18:28:46.744331 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.744309    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:28:46.765364 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.765341    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w994v\" (UniqueName: \"kubernetes.io/projected/f637e287-3f12-4437-b888-bb632303b794-kube-api-access-w994v\") pod \"f637e287-3f12-4437-b888-bb632303b794\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") "
Sep 17 18:28:46.765486 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.765392    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f637e287-3f12-4437-b888-bb632303b794-kube-rbac-proxy-sar-config\") pod \"f637e287-3f12-4437-b888-bb632303b794\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") "
Sep 17 18:28:46.765486 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.765426    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls\") pod \"f637e287-3f12-4437-b888-bb632303b794\" (UID: \"f637e287-3f12-4437-b888-bb632303b794\") "
Sep 17 18:28:46.765780 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.765757    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f637e287-3f12-4437-b888-bb632303b794-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f637e287-3f12-4437-b888-bb632303b794" (UID: "f637e287-3f12-4437-b888-bb632303b794"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:28:46.767622 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.767561    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f637e287-3f12-4437-b888-bb632303b794-kube-api-access-w994v" (OuterVolumeSpecName: "kube-api-access-w994v") pod "f637e287-3f12-4437-b888-bb632303b794" (UID: "f637e287-3f12-4437-b888-bb632303b794"). InnerVolumeSpecName "kube-api-access-w994v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:28:46.767818 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.767797    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f637e287-3f12-4437-b888-bb632303b794" (UID: "f637e287-3f12-4437-b888-bb632303b794"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:28:46.866062 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.866035    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f637e287-3f12-4437-b888-bb632303b794-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:28:46.866062 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.866057    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f637e287-3f12-4437-b888-bb632303b794-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:28:46.866194 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:46.866068    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w994v\" (UniqueName: \"kubernetes.io/projected/f637e287-3f12-4437-b888-bb632303b794-kube-api-access-w994v\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:28:47.708713 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:47.708629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc" event={"ID":"f637e287-3f12-4437-b888-bb632303b794","Type":"ContainerDied","Data":"c12cc8dc1689135a6bed1ac2097bcc2bef970c6fdffcedc7afaf38ba46d133a3"}
Sep 17 18:28:47.709156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:47.708718    2577 scope.go:117] "RemoveContainer" containerID="b07682aae3a815c4edbe6184f23f0e2178d9719c644951530cdd261d6db7b588"
Sep 17 18:28:47.709156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:47.708645    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"
Sep 17 18:28:47.718345 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:47.718325    2577 scope.go:117] "RemoveContainer" containerID="a0d90402dfb4d9893a65475f4c2e98861b1aed51e8b1cb5c023f69eb4525c4fd"
Sep 17 18:28:47.730066 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:47.729718    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"]
Sep 17 18:28:47.732234 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:47.732210    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e0a3a-predictor-64d96fc94-zpgcc"]
Sep 17 18:28:49.326482 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:49.326454    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f637e287-3f12-4437-b888-bb632303b794" path="/var/lib/kubelet/pods/f637e287-3f12-4437-b888-bb632303b794/volumes"
Sep 17 18:28:49.695336 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:49.695255    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:28:49.695872 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:49.695846    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Sep 17 18:28:53.613406 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:53.613357    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Sep 17 18:28:59.696585 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:28:59.696545    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Sep 17 18:29:03.612886 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:03.612845    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Sep 17 18:29:09.696232 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:09.696189    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Sep 17 18:29:13.614012 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:13.613982    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:29:19.696235 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:19.696188    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.42:8080: connect: connection refused"
Sep 17 18:29:26.766840 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:26.766791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:29:27.197825 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:27.197794    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:29:29.696820 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:29.696786    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:29:40.298896 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:40.298858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:29:40.464138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:29:40.464108    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:30:49.216060 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:30:49.216018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:31:26.930349 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:31:26.930267    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:31:27.013089 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:31:27.013051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:31:39.441558 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:31:39.441529    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:31:39.449399 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:31:39.449376    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:31:39.451239 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:31:39.451219    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:31:39.461402 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:31:39.461386    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:33:14.911832 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:33:14.911790    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:33:15.002138 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:33:15.002106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:35:27.553470 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:35:27.553372    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:36:39.471364 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:36:39.471340    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:36:39.479826 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:36:39.479802    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:36:39.481768 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:36:39.481753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:36:39.490444 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:36:39.490426    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:37:54.786245 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:54.786213    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:37:54.889397 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:54.889365    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"]
Sep 17 18:37:54.889652 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:54.889629    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container" containerID="cri-o://6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd" gracePeriod=30
Sep 17 18:37:54.889726 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:54.889636    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kube-rbac-proxy" containerID="cri-o://7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce" gracePeriod=30
Sep 17 18:37:55.319386 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:55.319353    2577 generic.go:356] "Generic (PLEG): container finished" podID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerID="7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce" exitCode=2
Sep 17 18:37:55.319522 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:55.319425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" event={"ID":"201e291b-5dd8-42f6-bbd5-80a7c5730f6f","Type":"ContainerDied","Data":"7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce"}
Sep 17 18:37:55.984256 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:55.984220    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:37:57.538252 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.538231    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:37:57.703808 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.703742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvps9\" (UniqueName: \"kubernetes.io/projected/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-api-access-cvps9\") pod \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") "
Sep 17 18:37:57.703808 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.703778    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls\") pod \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") "
Sep 17 18:37:57.703808 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.703799    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-rbac-proxy-sar-config\") pod \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\" (UID: \"201e291b-5dd8-42f6-bbd5-80a7c5730f6f\") "
Sep 17 18:37:57.704244 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.704210    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "201e291b-5dd8-42f6-bbd5-80a7c5730f6f" (UID: "201e291b-5dd8-42f6-bbd5-80a7c5730f6f"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:37:57.706073 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.706046    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-api-access-cvps9" (OuterVolumeSpecName: "kube-api-access-cvps9") pod "201e291b-5dd8-42f6-bbd5-80a7c5730f6f" (UID: "201e291b-5dd8-42f6-bbd5-80a7c5730f6f"). InnerVolumeSpecName "kube-api-access-cvps9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:37:57.706185 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.706168    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "201e291b-5dd8-42f6-bbd5-80a7c5730f6f" (UID: "201e291b-5dd8-42f6-bbd5-80a7c5730f6f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:37:57.804784 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.804757    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvps9\" (UniqueName: \"kubernetes.io/projected/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-api-access-cvps9\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:37:57.804784 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.804779    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:37:57.804784 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:57.804788    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/201e291b-5dd8-42f6-bbd5-80a7c5730f6f-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:37:58.335788 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.335754    2577 generic.go:356] "Generic (PLEG): container finished" podID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerID="6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd" exitCode=0
Sep 17 18:37:58.336002 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.335818    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"
Sep 17 18:37:58.336002 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.335822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" event={"ID":"201e291b-5dd8-42f6-bbd5-80a7c5730f6f","Type":"ContainerDied","Data":"6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd"}
Sep 17 18:37:58.336002 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.335971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5" event={"ID":"201e291b-5dd8-42f6-bbd5-80a7c5730f6f","Type":"ContainerDied","Data":"f0bf7bacc924a8b57fbf4b0d449ac4bfdcc4d27f5f4a342070cfaf2e19693c1f"}
Sep 17 18:37:58.336002 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.336009    2577 scope.go:117] "RemoveContainer" containerID="7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce"
Sep 17 18:37:58.346023 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.345996    2577 scope.go:117] "RemoveContainer" containerID="6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd"
Sep 17 18:37:58.355161 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.355143    2577 scope.go:117] "RemoveContainer" containerID="7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce"
Sep 17 18:37:58.355478 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:37:58.355450    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce\": container with ID starting with 7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce not found: ID does not exist" containerID="7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce"
Sep 17 18:37:58.355565 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.355488    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce"} err="failed to get container status \"7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce\": rpc error: code = NotFound desc = could not find container \"7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce\": container with ID starting with 7f85c13ba9937a690a96aa6aa42a7299ec88d5758b2ca413297f21319d1b66ce not found: ID does not exist"
Sep 17 18:37:58.355565 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.355511    2577 scope.go:117] "RemoveContainer" containerID="6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd"
Sep 17 18:37:58.355996 ip-10-0-133-113 kubenswrapper[2577]: E0917 18:37:58.355850    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd\": container with ID starting with 6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd not found: ID does not exist" containerID="6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd"
Sep 17 18:37:58.355996 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.355918    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd"} err="failed to get container status \"6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd\": rpc error: code = NotFound desc = could not find container \"6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd\": container with ID starting with 6dbfdf2c97e7090670af25389c4c99bf664a53525c9756976a9263b098317bbd not found: ID does not exist"
Sep 17 18:37:58.357685 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.357662    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"]
Sep 17 18:37:58.363525 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:58.363501    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-1a268-predictor-58cf6c8694-2nfg5"]
Sep 17 18:37:59.328328 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:37:59.328282    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" path="/var/lib/kubelet/pods/201e291b-5dd8-42f6-bbd5-80a7c5730f6f/volumes"
Sep 17 18:39:59.819167 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:39:59.819057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:41:15.522219 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:41:15.522182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:41:39.497537 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:41:39.497466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:41:39.506753 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:41:39.506729    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:41:39.509796 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:41:39.509778    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:41:39.518564 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:41:39.518547    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:45:45.870601 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:45.870561    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:45:45.973818 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:45.973789    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"]
Sep 17 18:45:45.974064 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:45.974041    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container" containerID="cri-o://e703ee255b6d63686e0caeb36d75e507fe18daa2c581ebd6487a7bf7725da6ec" gracePeriod=30
Sep 17 18:45:45.974155 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:45.974080    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kube-rbac-proxy" containerID="cri-o://5bd4f9bdfca92d104632b4c5ae6aa1b71ec4e0ac0c1884b05189cb0f699fd2ef" gracePeriod=30
Sep 17 18:45:46.548321 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:46.548291    2577 generic.go:356] "Generic (PLEG): container finished" podID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerID="5bd4f9bdfca92d104632b4c5ae6aa1b71ec4e0ac0c1884b05189cb0f699fd2ef" exitCode=2
Sep 17 18:45:46.548483 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:46.548326    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" event={"ID":"b14627ec-b437-4b19-a2f4-251fa231c2ec","Type":"ContainerDied","Data":"5bd4f9bdfca92d104632b4c5ae6aa1b71ec4e0ac0c1884b05189cb0f699fd2ef"}
Sep 17 18:45:47.356204 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:47.356167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:45:47.462574 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:47.462545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:45:48.559879 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.559840    2577 generic.go:356] "Generic (PLEG): container finished" podID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerID="e703ee255b6d63686e0caeb36d75e507fe18daa2c581ebd6487a7bf7725da6ec" exitCode=0
Sep 17 18:45:48.560250 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.559938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" event={"ID":"b14627ec-b437-4b19-a2f4-251fa231c2ec","Type":"ContainerDied","Data":"e703ee255b6d63686e0caeb36d75e507fe18daa2c581ebd6487a7bf7725da6ec"}
Sep 17 18:45:48.615229 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.615208    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:45:48.654225 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.654205    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wzzg\" (UniqueName: \"kubernetes.io/projected/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-api-access-4wzzg\") pod \"b14627ec-b437-4b19-a2f4-251fa231c2ec\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") "
Sep 17 18:45:48.654349 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.654252    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b14627ec-b437-4b19-a2f4-251fa231c2ec-proxy-tls\") pod \"b14627ec-b437-4b19-a2f4-251fa231c2ec\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") "
Sep 17 18:45:48.654349 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.654283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-rbac-proxy-sar-config\") pod \"b14627ec-b437-4b19-a2f4-251fa231c2ec\" (UID: \"b14627ec-b437-4b19-a2f4-251fa231c2ec\") "
Sep 17 18:45:48.654690 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.654659    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "b14627ec-b437-4b19-a2f4-251fa231c2ec" (UID: "b14627ec-b437-4b19-a2f4-251fa231c2ec"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 18:45:48.656380 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.656353    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14627ec-b437-4b19-a2f4-251fa231c2ec-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b14627ec-b437-4b19-a2f4-251fa231c2ec" (UID: "b14627ec-b437-4b19-a2f4-251fa231c2ec"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 18:45:48.656463 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.656428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-api-access-4wzzg" (OuterVolumeSpecName: "kube-api-access-4wzzg") pod "b14627ec-b437-4b19-a2f4-251fa231c2ec" (UID: "b14627ec-b437-4b19-a2f4-251fa231c2ec"). InnerVolumeSpecName "kube-api-access-4wzzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 18:45:48.755156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.755095    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b14627ec-b437-4b19-a2f4-251fa231c2ec-proxy-tls\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:45:48.755156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.755127    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:45:48.755156 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:48.755138    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wzzg\" (UniqueName: \"kubernetes.io/projected/b14627ec-b437-4b19-a2f4-251fa231c2ec-kube-api-access-4wzzg\") on node \"ip-10-0-133-113.ec2.internal\" DevicePath \"\""
Sep 17 18:45:49.566157 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.566130    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"
Sep 17 18:45:49.566505 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.566175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" event={"ID":"b14627ec-b437-4b19-a2f4-251fa231c2ec","Type":"ContainerDied","Data":"a6b9ea5bdf1ad7366d0fa051991571c37f988ae3ac5f00e8d4dc01541acb43f8"}
Sep 17 18:45:49.566505 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.566249    2577 scope.go:117] "RemoveContainer" containerID="5bd4f9bdfca92d104632b4c5ae6aa1b71ec4e0ac0c1884b05189cb0f699fd2ef"
Sep 17 18:45:49.578492 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.577031    2577 scope.go:117] "RemoveContainer" containerID="e703ee255b6d63686e0caeb36d75e507fe18daa2c581ebd6487a7bf7725da6ec"
Sep 17 18:45:49.584827 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.584769    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"]
Sep 17 18:45:49.588610 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.588587    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5"]
Sep 17 18:45:49.608248 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:49.608214    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-8365d-predictor-7567c8f6b-jgvv5" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 17 18:45:51.326446 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:45:51.326408    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" path="/var/lib/kubelet/pods/b14627ec-b437-4b19-a2f4-251fa231c2ec/volumes"
Sep 17 18:46:18.699699 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:18.699658    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:46:18.862021 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:18.861992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:46:18.961018 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:18.960956    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:46:21.638242 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:21.638206    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tmbzr_104f3713-9564-4733-90e1-cc0923af9610/global-pull-secret-syncer/0.log"
Sep 17 18:46:21.688066 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:21.688036    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log"
Sep 17 18:46:21.794521 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:21.794492    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-113.ec2.internal_1687c29f4de0497448ee89348c1bced3/haproxy/0.log"
Sep 17 18:46:24.351477 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:24.351438    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:46:24.404262 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:24.404233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:46:26.046960 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.046926    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-cbmzz_0d39c881-ca4e-4128-98d4-702c46369144/cluster-monitoring-operator/0.log"
Sep 17 18:46:26.147282 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.147261    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bbcd4674c-4zh24_99eb04ac-7e42-424c-b2b2-d11d6615630b/metrics-server/0.log"
Sep 17 18:46:26.171189 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.171169    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-9pkdr_f84054da-483a-44a2-bdb1-0e5ff05677de/monitoring-plugin/0.log"
Sep 17 18:46:26.291989 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.291966    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-65c6t_5d480734-a1c1-48ae-9691-ce55db689a2e/node-exporter/0.log"
Sep 17 18:46:26.316856 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.316794    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-65c6t_5d480734-a1c1-48ae-9691-ce55db689a2e/kube-rbac-proxy/0.log"
Sep 17 18:46:26.335366 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.335349    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-65c6t_5d480734-a1c1-48ae-9691-ce55db689a2e/init-textfile/0.log"
Sep 17 18:46:26.739677 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.739593    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-sfssp_53206f4d-6da1-4fc0-81cc-3d03efa3787b/prometheus-operator/0.log"
Sep 17 18:46:26.756735 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:26.756709    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-sfssp_53206f4d-6da1-4fc0-81cc-3d03efa3787b/kube-rbac-proxy/0.log"
Sep 17 18:46:28.885174 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:28.885144    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:46:28.890287 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:28.890261    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/3.log"
Sep 17 18:46:29.295799 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.295773    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-79b49468d-jpbx9_75ccb779-e6a3-494d-9869-15e372a58a4f/console/0.log"
Sep 17 18:46:29.330266 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.330238    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-w54ns_54c6ffdb-2319-45b4-9f0f-c9125886434b/download-server/0.log"
Sep 17 18:46:29.672651 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672574    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"]
Sep 17 18:46:29.672944 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672929    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kube-rbac-proxy"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672945    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kube-rbac-proxy"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672956    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kube-rbac-proxy"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672962    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kube-rbac-proxy"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672979    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672984    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.672994    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kube-rbac-proxy"
Sep 17 18:46:29.672999 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673000    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kube-rbac-proxy"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673011    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673024    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673029    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673093    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kserve-container"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673102    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14627ec-b437-4b19-a2f4-251fa231c2ec" containerName="kube-rbac-proxy"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673108    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kube-rbac-proxy"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673114    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f637e287-3f12-4437-b888-bb632303b794" containerName="kserve-container"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673120    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kube-rbac-proxy"
Sep 17 18:46:29.673251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.673126    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="201e291b-5dd8-42f6-bbd5-80a7c5730f6f" containerName="kserve-container"
Sep 17 18:46:29.676214 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.676196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.678570 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.678549    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bs2q6\"/\"kube-root-ca.crt\""
Sep 17 18:46:29.679476 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.679456    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bs2q6\"/\"default-dockercfg-5rqxp\""
Sep 17 18:46:29.679476 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.679469    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bs2q6\"/\"openshift-service-ca.crt\""
Sep 17 18:46:29.686292 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.686266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"]
Sep 17 18:46:29.859251 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.859225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-sys\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.859365 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.859262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-proc\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.859365 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.859320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-lib-modules\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.859462 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.859364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-podres\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.859462 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.859399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjs5r\" (UniqueName: \"kubernetes.io/projected/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-kube-api-access-xjs5r\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.959988 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.959894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-lib-modules\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.959988 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.959969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-podres\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjs5r\" (UniqueName: \"kubernetes.io/projected/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-kube-api-access-xjs5r\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-sys\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-proc\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-lib-modules\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960136    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-podres\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-sys\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.960400 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.960219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-proc\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.969307 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.969282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjs5r\" (UniqueName: \"kubernetes.io/projected/02cbd2d6-ff66-4c06-8a54-0a652e70ff91-kube-api-access-xjs5r\") pod \"perf-node-gather-daemonset-xzv22\" (UID: \"02cbd2d6-ff66-4c06-8a54-0a652e70ff91\") " pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:29.988284 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:29.988260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:30.260303 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.260242    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"]
Sep 17 18:46:30.266008 ip-10-0-133-113 kubenswrapper[2577]: W0917 18:46:30.265979    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod02cbd2d6_ff66_4c06_8a54_0a652e70ff91.slice/crio-352685372a988afd853736009896482d594dcecab1bc8542aa027062935a751a WatchSource:0}: Error finding container 352685372a988afd853736009896482d594dcecab1bc8542aa027062935a751a: Status 404 returned error can't find the container with id 352685372a988afd853736009896482d594dcecab1bc8542aa027062935a751a
Sep 17 18:46:30.591142 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.591106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5pcfw_6e35697e-1b29-401b-9729-5e222483ed9f/konnectivity-agent/0.log" limit=1024
Sep 17 18:46:30.767158 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.767128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22" event={"ID":"02cbd2d6-ff66-4c06-8a54-0a652e70ff91","Type":"ContainerStarted","Data":"e13a739552fdd1e512fbdaefbec498ef69032f3cc3629720efc78262d3d4cb8d"}
Sep 17 18:46:30.767313 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.767182    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22" event={"ID":"02cbd2d6-ff66-4c06-8a54-0a652e70ff91","Type":"ContainerStarted","Data":"352685372a988afd853736009896482d594dcecab1bc8542aa027062935a751a"}
Sep 17 18:46:30.767313 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.767250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:30.784205 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.784159    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22" podStartSLOduration=1.7841443350000001 podStartE2EDuration="1.784144335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 18:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 18:46:30.782994643 +0000 UTC m=+2993.535734972" watchObservedRunningTime="2026-09-17 18:46:30.784144335 +0000 UTC m=+2993.536884663"
Sep 17 18:46:30.792644 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.792625    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqd7j_7c5fd24e-55a0-445a-9c31-0502336fa9fd/dns/0.log"
Sep 17 18:46:30.815165 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.815147    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lqd7j_7c5fd24e-55a0-445a-9c31-0502336fa9fd/kube-rbac-proxy/0.log"
Sep 17 18:46:30.946782 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:30.946725    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tvbl4_7ed9af67-a459-4e78-8e14-d5e6a492f7a7/dns-node-resolver/0.log"
Sep 17 18:46:31.416701 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:31.416676    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cb77949f7-62bth_164d59ff-24ca-4a95-81c1-51ccc590c511/registry/0.log"
Sep 17 18:46:31.459883 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:31.459863    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m25vn_a033a4bf-2f57-4cc8-8235-4aaa23f96261/node-ca/0.log"
Sep 17 18:46:32.538463 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:32.538438    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fklv_d3c40b9d-ccff-42de-9041-00d5cde9bf61/serve-healthcheck-canary/0.log"
Sep 17 18:46:32.907679 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:32.907594    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-4l8gr_98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4/insights-operator/0.log"
Sep 17 18:46:32.908936 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:32.908897    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-4l8gr_98aa99ea-ad93-4ff3-ae88-ba6061bfbbd4/insights-operator/1.log"
Sep 17 18:46:33.058570 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:33.058550    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gtp8l_ecbb2ca1-13db-4a89-96c0-96758a179e5e/kube-rbac-proxy/0.log"
Sep 17 18:46:33.080361 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:33.080344    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gtp8l_ecbb2ca1-13db-4a89-96c0-96758a179e5e/exporter/0.log"
Sep 17 18:46:33.099629 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:33.099611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gtp8l_ecbb2ca1-13db-4a89-96c0-96758a179e5e/extractor/0.log"
Sep 17 18:46:35.342163 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:35.342133    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-5bf6d75b64-vsqcr_fb896b1f-332e-4ed8-a6e4-05c08d391a0a/manager/0.log"
Sep 17 18:46:35.371137 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:35.371113    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-645f9c8fd6-n6jpt_59180624-f11e-44f4-9fba-0327ff8e89d2/manager/0.log"
Sep 17 18:46:35.483735 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:35.483715    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-7b966d7984-j9rgz_60e06181-3e6d-4555-af7c-8d39eaa02203/manager/0.log"
Sep 17 18:46:36.783092 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:36.783051    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bs2q6/perf-node-gather-daemonset-xzv22"
Sep 17 18:46:39.524889 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:39.524866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:46:39.542749 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:39.542723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:46:39.546425 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:39.546405    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-gbq8n_54092044-dada-45e5-bd9c-87a374b0ec2c/console-operator/2.log"
Sep 17 18:46:39.555971 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:39.555897    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:46:41.121756 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.121730    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/kube-multus-additional-cni-plugins/0.log"
Sep 17 18:46:41.148715 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.148643    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/egress-router-binary-copy/0.log"
Sep 17 18:46:41.167750 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.167732    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/cni-plugins/0.log"
Sep 17 18:46:41.186116 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.186099    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/bond-cni-plugin/0.log"
Sep 17 18:46:41.203665 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.203649    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/routeoverride-cni/0.log"
Sep 17 18:46:41.222073 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.222030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/whereabouts-cni-bincopy/0.log"
Sep 17 18:46:41.241602 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.241575    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-24ngd_06618c28-7ec8-4f43-aae8-5eaff3e4d55b/whereabouts-cni/0.log"
Sep 17 18:46:41.646373 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.646339    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zxfhr_e7006b69-52b5-423f-989e-69b139de701a/kube-multus/0.log"
Sep 17 18:46:41.753132 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.753111    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6mtq_de9a5ba3-4824-48c9-9498-d6c8963cada3/network-metrics-daemon/0.log"
Sep 17 18:46:41.771103 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:41.771066    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q6mtq_de9a5ba3-4824-48c9-9498-d6c8963cada3/kube-rbac-proxy/0.log"
Sep 17 18:46:42.882154 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.882112    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-controller/0.log"
Sep 17 18:46:42.898860 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.898841    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/1.log"
Sep 17 18:46:42.899050 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.898934    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovn-acl-logging/0.log"
Sep 17 18:46:42.917470 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.917449    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/kube-rbac-proxy-node/0.log"
Sep 17 18:46:42.935617 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.935595    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 18:46:42.955201 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.955180    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/northd/0.log"
Sep 17 18:46:42.972931 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.972899    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/nbdb/0.log"
Sep 17 18:46:42.991971 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:42.991949    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/sbdb/0.log"
Sep 17 18:46:43.031761 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:43.031744    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ww9br_c7dc4fca-6bcc-4a13-ba13-c76c0be8efd9/ovnkube-controller/0.log"
Sep 17 18:46:44.136645 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:44.136623    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7cbc45fddc-6bppp_3ea28118-979d-4284-a921-8baa8e2310c9/check-endpoints/0.log"
Sep 17 18:46:44.206692 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:44.206669    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tvgp2_04b43c83-4a08-4d2d-8bba-1f16853d7410/network-check-target-container/0.log"
Sep 17 18:46:45.165252 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:45.165223    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qlwg7_d483dbc2-17ca-43c8-8738-22f5584b3f71/iptables-alerter/0.log"
Sep 17 18:46:45.892555 ip-10-0-133-113 kubenswrapper[2577]: I0917 18:46:45.892529    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-k9nfk_e2f5f34f-39bb-4098-a77b-6c9b1bfe55c4/tuned/0.log"